One of the biggest concerns is prompt injection, a technique in which attackers manipulate AI systems using malicious or deceptive inputs that alter model behaviour, bypass safeguards, or trigger unintended actions. Security experts increasingly compare prompt injection to phishing because of its scalability and low barrier to execution. However, instead of targeting humans directly, attackers are now targeting the interaction layer between humans, machines, and AI agents.
As organisations deploy more autonomous AI systems, the risks extend beyond prompts alone. AI agents are increasingly functioning as digital workers with privileged access to enterprise systems, applications, and datasets. This creates new governance and security challenges because agents may execute commands, access sensitive files, or interact with critical infrastructure without sufficient oversight.
A major issue highlighted by security leaders is the lack of visibility into AI behaviour after deployment. Enterprises can see prompts and outputs, but they often cannot fully observe the reasoning paths, runtime actions, or system-level operations occurring behind the scenes. This makes AI systems difficult to monitor using conventional cybersecurity approaches. Runtime monitoring is therefore becoming essential for tracking agent activity, including scripts, file access, network behaviour, and command execution.
At the same time, organisations are also struggling with the rise of shadow AI, unsanctioned AI applications, plugins, runtimes, and development tools introduced without formal governance or security review. These unmanaged AI systems increase the risk of data leakage, policy violations, and hidden vulnerabilities across enterprise environments.
However, security leaders argue that waiting for perfect AI governance frameworks is no longer realistic. Instead, enterprises must evolve security alongside innovation through stronger visibility, monitoring, prevention, and response capabilities. As AI systems become embedded in workflows, prompts, and autonomous agent behaviour are emerging as major cybersecurity battlegrounds. As a result, organizations that fail to secure these layers risk data exposure, operational loss, and machine-speed attacks.
ソース：
