Skip to main content

What is an AI agent?

An AI agent is an LLM-based system that decides its own steps and uses tools to complete a task, such as investigating a security alert end to end.

Glossary
Updated 2 min read

Definition

AI agent

Also called Agentic AI, LLM agent, Autonomous agent

An AI agent is a system in which a large language model dynamically directs its own process and tool use to complete a task, deciding which steps to take rather than following a fixed, predefined script.

How it works

Anthropic groups LLM systems that use tools under the umbrella of agentic systems, and draws a line between workflows, where LLMs and tools are orchestrated through predefined code paths, and agents, where the LLM dynamically directs its own process and tool use. Its basic building block is an LLM augmented with retrieval, tools, and memory, which can generate its own search queries, choose tools, and decide what to retain.

An agent runs in a loop: read the task, decide on a next step, call a tool (run a query, fetch a file, call an API), read the result, and repeat until it can answer or needs a human. Tools are often connected through standards like the Model Context Protocol. Anthropic recommends starting with the simplest solution that works, noting that agentic systems often trade latency and cost for better task performance.

OWASP's Agentic Security Initiative points out that integrating LLMs has expanded agents' scale, capabilities, and risks. An agent with tools can be manipulated through prompt injection, can misuse permissions it was given, and can act on a hallucinated conclusion.

Example

A triage agent receives an alert for a suspicious OAuth app consent. It looks up the app's publisher and permissions, queries sign-in logs for the user, checks whether other users granted the same app, and finds that a single user consented from their usual device to a well-known productivity app. It closes the alert with that evidence attached. Had the app requested mailbox access and come from an unverified publisher, it would have escalated with the same summary.

Why it matters for a SOC

Agents can do the repetitive context-gathering behind most alerts, which is why they underpin the AI SOC. The questions that matter are control and evidence: which model, which tools, which instructions, and which actions need approval. Cotool's AI SOC lets teams control the prompt, model choice, tools, and output format for each agent, stores agents and skills in Git as YAML with review and rollback, and measures them with evals.

Go deeper

FAQ

What is the difference between an AI agent and a workflow?
Anthropic distinguishes the two: workflows orchestrate LLMs and tools through predefined code paths, while agents let the LLM decide its own steps and tool use. Workflows are more predictable for well-defined tasks, and agents suit tasks that need flexibility.

Sources

  1. Building effective AI agents | Anthropic · accessed November 16, 2026
  2. Agentic AI - Threats and Mitigations | OWASP Gen AI Security Project · accessed November 16, 2026
  3. AI SOC Without the Black Box | Cotool · accessed November 16, 2026

Attackers are scaling with tokens

Cotool helps defenders operate at machine speed. See how security teams are scaling Detection & Response.

Book a demo