Checklist ¡ 5 minute read
Prompt Injection Defense Checklist
Prompt injection defense is adequate when instructions are structurally separated from all data the model reads, untrusted content is labeled and screened, tools are least privilege so a manipulated model cannot exceed its scope, every output and action is validated against policy outside the model, consequential actions require approval, anomalies are detected, and an adversarial suite runs in CI.
Prompt injection is the defining security problem of LLM applications: anything the model reads can try to become an instruction. It cannot be fully solved at the model layer, so defense is layered, and the layers that matter most are the ones that hold when the model has already been manipulated. This checklist covers them. It is the operational form of the injection sections of the AI agent security architecture whitepaper and complements what is prompt injection and the LLM security checklist.
Who should use this checklist?
Security reviewers and engineering owners of any LLM application or agent that reads content from users, documents, emails, web pages, tools, or other agents.
Have you mapped every content channel?
- Every source of text the model reads is inventoried: user input, retrieved documents, emails, chat history, web content, tool results, memory, other agents' outputs.
- Each channel is classified as trusted (system configuration) or untrusted (everything else).
- The inventory is maintained as channels are added.
Is structural separation in place?
- System instructions are delivered through the mechanism the model treats as privileged, not concatenated with data.
- Untrusted content is delimited and labeled as data in the prompt.
- Instruction-like patterns in retrieved content are neutralized or flagged where feasible.
- The model is instructed to treat content as data, understood as a weak layer, not a control.
Reference: context engineering explained.
Is detection in place?
- Input screening for known injection patterns runs on user input where feasible.
- Retrieved and tool-returned content is screened before it enters context.
- Classifier or heuristic detection is tuned on your own adversarial suite.
- Detections are logged and alerted, not silently dropped.
Is capability bounded? (Most important)
| Check | Evidence |
|---|---|
| Tools are least privilege with read and write separated | Tool registry and scopes |
| No tool can send data to arbitrary destinations; egress is allowlisted | Network and tool policy |
| User-facing actions use delegated, user-scoped authorization | Access design |
| Code, file, and network execution is sandboxed | Sandbox configuration |
| Agents hold no credentials beyond their specification | Permission audit |
| Memory writes are policy-controlled and not triggered by arbitrary content | Memory design |
Reference: how to build tool use for llm agents and ai access control.
Are outputs and actions validated outside the model?
- Tool arguments are validated against schemas and policy (targets, values, rates).
- Outputs are checked for sensitive data and prohibited content before leaving the system.
- Consequence classification routes irreversible, costly, external, or regulated actions to approval.
- Validation failures have deterministic behavior: block, escalate, degrade.
- Content rendered downstream is encoded to prevent injection into browsers or systems.
Reference: llm output validation and ai agent guardrails.
Are gates real?
- Approval gates on consequential actions are enforced in code.
- Approvers see the proposed action, evidence, and trajectory, including retrieved content.
- Queues are staffed, and gate metrics detect ceremonial review.
Reference: how to build a human review queue.
Is anomalous behavior detected?
- Trajectory logging captures retrieved content, tool calls, and decisions.
- Baselines for normal tool sequences, data volumes, and destinations exist.
- Alerts fire on unusual tool chains, first-seen destinations, data spikes, and repeated validation failures.
- Security telemetry flows to the security operations center.
Reference: the AI observability whitepaper.
Are multi-agent and memory surfaces protected?
- Handoffs between agents are validated against schemas and policy, so manipulated output cannot steer downstream agents.
- Memory writes are validated, restricted by source, and monitored.
- Sub-agents reading untrusted content do not hold consequential tools.
Reference: how to build a multi-agent system and how to build long-term memory for ai agents.
Is the adversarial suite comprehensive and continuous?
- Payloads cover direct injection in user input.
- Payloads cover indirect injection through every retrieved and tool-returned channel.
- Objectives tested: instruction override, data exfiltration, unauthorized actions, policy violations, memory poisoning.
- Success rates are measured with thresholds; the suite runs in CI on every change.
- Red-team findings are added to the suite.
- Provider model updates trigger a full suite run.
Reference: ai red teaming guide and how to build an agent evaluation harness.
Is incident response ready for injection events?
- Containment actions (autonomy drop, credential revocation, tool block) are pre-authorized.
- The audit trail can reconstruct which content influenced which action.
- Poisoned content can be identified and removed from indexes.
Reference: ai incident response checklist.
How should gaps be prioritized?
Capability bounding and validation first, because they hold under full manipulation. Then the adversarial suite in CI, because it tells you where you stand. Then separation, detection, gates, and monitoring. Treat any channel without adversarial coverage as untested.
How FISTA Solutions defends against injection
FISTA Solutions builds every LLM application and agent with layered injection defense as standard: channel inventory, structural separation, screening, least-privilege sandboxed tools, validation and consequence gates outside the model, trajectory monitoring, protected handoffs and memory, and an adversarial suite in CI. The AI enablement practice delivers the gateway, tool, and validation platform, AI agents are built on it, and forward deployed engineers work with your security team on testing. The record behind the approach is 150+ projects with 99.9% uptime.
To assess injection defenses on an existing system, message FISTA on WhatsApp, or read what is jailbreaking in ai for the related attack class.
Share-ready article cover
Download the generated social format.
Clear answers
Questions raised by this field note.
Straightforward guidance for evaluating scope, fit, and the next step.
01What is prompt injection?
An attack in which content the model reads, whether typed by a user or embedded in documents, emails, web pages, or tool results, contains instructions that override or subvert the system's intended behavior, causing data disclosure, unauthorized actions, or policy violations.
02Can prompt injection be prevented completely?
Not at the model layer with current techniques. Defense in depth reduces likelihood through separation and detection and, more importantly, bounds impact through least-privilege tools, output and action validation, gates, and monitoring, so successful injection becomes a contained event.
03What is indirect prompt injection?
Injection delivered through content the system retrieves or receives rather than typed by the user: a poisoned document in the knowledge base, an email with hidden instructions, a web page, or a tool result. It is harder to detect and triggers without user awareness.
04How do you test for prompt injection?
Maintain an adversarial suite of direct and indirect payloads across every content channel the system reads, attempt instruction override, data exfiltration, and unauthorized actions, measure success rates, run it in CI on every change, and supplement with red-team exercises whose findings join the suite.
05Which defenses matter most?
Least-privilege tools and validation outside the model, because they hold even when the model is fully manipulated. Structural separation and detection reduce how often manipulation succeeds; gates and monitoring limit and reveal what gets through.
Continue exploring
Related capabilities
Start with the hard problem
Need the outcome owned, not merely analyzed?
Tell us where delivery is constrained. Weâll map the fastest credible path from intent to verified production.