Topic
prompt injection
Technology Prompt Injection Attacks Are Thwarting AI Hacking Agents with Context Bombing
Tracebit researchers found that planting prompt injections alongside secrets on AWS can disrupt AI hacking agents. In tests across five models, context bombing reduced admin privilege escalation from 57% to 5% and complete compromise from 36% to 1%, offering a new defensive tactic against AI-driven attacks.
Prompt Injection Attacks on LLM-Based Grading Systems Pose Security Risks for Enterprise AI
A study by researchers at arXiv explores prompt injection attacks on large language model-based automatic grading systems, finding that current systems remain highly vulnerable to manipulation that could artificially inflate scores. The findings raise awareness of security threats in educational AI and serve as a warning for enterprise LLM deployments.
MUZZLE Framework Automates Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
MuZZLE is an automated agentic framework that evaluates the security of LLM-based web agents against indirect prompt injection attacks. It discovered 44 new attacks across 4 web applications, including cross-application injection and agent-tailored phishing, by adaptively generating context-aware malicious instructions based on agent execution trajectories.
New Defense Keeps Attack Success Rate Below 4% for Adaptive Prompt Injection on LLM Agents
Researchers propose RETA, a training-based defense that grounds LLM agent security on user tasks rather than attack patterns. Using chain-of-thought reasoning and red-teaming with diversity reward, RETA keeps average attack success rate below 4% across six adaptive attacks while preserving utility.