ToolWarden AI
🛡️ Firewall between AI agents and their tools — stops hijacked instructions from becoming rogue actions
AI agents that browse the web or call APIs can be hijacked by instructions hidden inside what they read — a webpage telling the agent to send an email nobody asked for. ToolWarden sits between the agent and every tool call, scores each one with a trained ML ensemble (DeBERTa + LightGBM), and actually blocks, quarantines, or holds risky calls for human approval, not just flags them. Reported honestly: on real novel attacks the model never trained on, it still catches 91% of threats, but roughly 7 in 10 of what it flags is a false positive — published as the real number, not a friendlier blended one.
131 tests · 3 integration paths · block / quarantine / hold enforcement
View on GitHub →