Prompt Injection
59 items from fonduai/awesome-prompt-injection ★679
-
Indirect Prompt Injection Through MCP Tools: A Defense Guide stackone.com
Feb 2026 guide explaining why any MCP tool that reads data written outside your trust boundary (CRM notes, calendar invites, API responses) is an injection vector, with concrete mitigations per tool category.
-
ToxicSkills: Snyk Finds Malware and Prompt Injection in 36% of AI Agent Skills snyk.io
Feb 2026 Snyk research across the ClawHub AI agent skills registry: 36% of audited skills contained security flaws, 1,467 malicious payloads found, and 2.9% used curl | bash remote instruction loading to evade static analysis. Covers indirect injection via poisoned web content…
-
New Prompt Injection Papers: Agents Rule of Two and The Attacker Moves Second simonwillison.net
Simon Willison's Nov 2025 commentary on both landmark papers, including the finding that 12 published defenses were bypassed at >90% success rate using gradient descent and RL-based adaptive attacks.
-
Design Patterns for Securing LLM Agents against Prompt Injections simonwillison.net
Overview of various strategies to mitigate the risk of prompt injection.
-
Prompt injection explained simonwillison.net
Video, slides, and a transcript of an introduction to prompt injection and why it's important.
-
Prompt injection: What's the worst that can happen? simonwillison.net
General overview of Prompt Injection attacks, part of a series.
-
Simon Willison's Blog simonwillison.net
The most consistent independent tracker of real-world prompt injection incidents, new papers, and tooling across the field.
-
Google AI Red Team: Securing AI services.google.com
Google's red team walkthrough of how AI systems are attacked in practice. An early foundational report, useful for framing rather than for current technique.
-
r/llmsecurity reddit.com
The most active subreddit dedicated to LLM security research; a good early-warning channel for real-world incidents and new disclosures.
-
PromptTrace prompttrace.airedlab.com
Free AI security training platform with 7 hands-on prompt injection labs and a 15-level CTF (the Gauntlet) with progressively harder defenses, from prompt-level rules to code guards to LLM classifiers. Unique feature: Context Trace shows the full prompt stack (system prompt…
-
Adversarial Prompting promptingguide.ai
A guide on the various types of adversarial prompting and ways to mitigate them.
-
Augustus praetorian.com
Feb 2026 open-source tool from Praetorian. A single Go binary with 210+ vulnerability probes across 47 attack categories, 28 LLM providers, 90+ detectors, and 7 payload transformation buffs. Built for penetration testing workflows without Python/npm dependencies.
-
Continuously Hardening ChatGPT Atlas Against Prompt Injection Attacks openai.com
OpenAI's Dec 2025 disclosure of a real attack chain (malicious email → agent sends resignation letter) and the RL-trained automated attacker they built to find new injection classes before external adversaries do. OpenAI explicitly states deterministic guarantees are not…
-
How Microsoft Defends Against Indirect Prompt Injection Attacks microsoft.com
Microsoft MSRC's Jul 2025 post on FIDES, an information-flow control system enforcing privilege separation and prompt isolation to deterministically block IPI in Copilot-class agents.
-
Prompt Injection learnprompting.org
Prompt Injection tutorial from Learn Prompting.
-
Synthetic Recollections - A Case Study in Prompt Injection for ReAct LLM Agents labs.withsecure.com
A practical scenario showing how prompt injection can be used to hi-jack the ReAct loop used by LLM agents to inject forged thoughts and associated observations into the LLM context, thus altering the intended behavior.
-
Agent-targeted bounty honeypots: a reproducible corpus github.com
Field notes on a live GitHub operation advertising $219,000 across 43 issues, each stapling a request for the contributor's "complete pre-session instructions" onto a genuine engineering task. Documents the sandwich injection in CONTRIBUTING.md, where a truthful human-visible…
-
OWASP Top 10 for Agentic Applications (2026) genai.owasp.org
Companion list for autonomous and agentic systems, released Dec 2025 with input from over 100 contributors. Covers the agent-specific failure modes that the LLM list does not reach, including tool misuse and agent hijacking.
-
OWASP GenAI LLM Top 10 (2026) genai.owasp.org
The canonical community reference for LLM application risk, with prompt injection at number one. Supersedes the 2025 edition; the per-risk 2025 pages remain online as an archive.
-
OWASP Gen AI Security Project genai.owasp.org
The standards body behind the LLM and Agentic Top 10 lists, with working groups, cheat sheets and guidance updated continuously by practitioners across the industry.
-
Gandalf gandalf.lakera.ai
Your goal is to make Gandalf reveal the secret password for each level. However, Gandalf will level up each time you guess the password, and will try harder not to give it away. Can you beat level 7? (There is a bonus level 8).
-
ChatGPT Plugins: Data Exfiltration via Images & Cross Plugin Request Forgery embracethered.com
This post shows how a malicious website can take control of a ChatGPT chat session and exfiltrate the history of the conversation.
-
Don't you (forget NLP): Prompt injection with control characters in ChatGPT dropbox.tech
A look into how to achieve prompt injection from control characters from Dropbox.
-
Prompt-Injection Cascades in a Multi-Agent Enterprise (ATLAS) doi.org
Forensic study in which one poisoned support ticket drives four agents across three model families to a fraudulent transfer in 17 of 18 trials, with no model jailbroken. Argues the failure is topological rather than per-model. Synthetic data, CC BY 4.0.
-
Authority Framing in Agentic CI/CD (RELAY) doi.org
Pre-registered factorial study of a five-agent CI/CD pipeline built from five production LLMs. A fabricated "pre-approved, do not re-review" claim gets secret-exfiltration code shipped in up to 55% of runs, and roughly 80% of laundered pull requests pass a capable LLM code…
-
Learn Prompting discord.com
Discord server from Learn Prompting.
-
Why content-based prompt-injection detection has a structural blind spot dev.to
Walks through a disguised "already-scanned, classified DATA" annotation that passes both a regex layer and a local LLM classifier (qwen2.5:3b and 14b), with the gap pinned as a failing test. Detection is necessary but not sufficient.
-
CrowdStrike AI Unlocked crowdstrike.com
Released Feb 2026, designed to train security, developer, and AI teams on prompt injection against increasingly capable agents. Built by CrowdStrike's Counter Adversary Operations team.
-
Indirect Prompt Injection Attacks: Hidden AI Risks crowdstrike.com
CrowdStrike's Dec 2025 analysis of IPI TTPs targeting enterprise GenAI, including attacker-controlled document poisoning, RAG context manipulation, and practical detection signals for SOC workflows.
-
Prompt Injection Cheat Sheet: How To Manipulate AI Language Models blog.seclify.com
A prompt injection cheat sheet for AI bot integrations.
- next page of items loading…
