I build (and break) LLMs, agents and everything in between. | CTO & cofounder @ Qualifire

Joined September 2022
🚀 Paladin-mini is now OPEN SOURCE! Our compact grounding model is live on @huggingface 🤗 🎯 98.2% real-world accuracy Try it: huggingface.co/qualifire/con… Paper: arxiv.org/abs/2506.20384 #AI #OpenSource #NLP #FactChecking #RAG #MachineLearning
1
473
Your EDR won't catch an AI agent running terraform destroy with valid credentials. Every action is legitimate. The threat is in the sequence. Agents don't produce signatures - they chain authorized actions into unauthorized outcomes.
1
50
In multi-agent attacks, even when sub-agents refuse malicious requests, the orchestrator finds workarounds. Security by committee doesn't work when the committee chair is compromised.
2
45
Your AI agent just became an insider threat. EchoLeak showed that a single email - with invisible instructions - can turn Copilot into a data exfiltration tool. Zero clicks required. The agent did exactly what it was designed to do. It just followed the wrong instructions.
4
77
New research: 250 poisoned documents can backdoor any LLM regardless of size. That's 0.00016% of training tokens. Your AI security perimeter ends way before you think it does.
1
63
Microsoft says leaving Copilot Studio agents open to untrusted inputs is "necessary for collaboration." Translation: we prioritized shipping over security. Classic.
1
1
52
Microsoft says leaving Copilot Studio agents open to untrusted inputs is "necessary for collaboration." Translation: we prioritized shipping over securing. This is how every enterprise AI agent breach in 2026 will start.
1
59
The execution power delegation point is critical. Most security models assume the human reviews before action. Agents collapse that gap - they interpret AND execute. The attack surface shifts from compromising credentials to compromising context.
32
The risk shift from "text can be wrong" to "text can trigger actions" is the key insight. Every agent framework needs to internalize this. Your guardrails are not evaluating content accuracy - they are authorizing capability execution.
29
Static analysis for agent skills is a great first layer. The next frontier: runtime behavior validation. A skill can pass every scan and still be weaponized through the data it processes. The malicious payload often lives in the context, not the code.
30
MCP toolchain inspection is critical - the supply chain attack surface for agents is massive. Tool definitions can carry hidden payloads, most frameworks trust implicitly. Scanning for injection patterns in MCP code should be standard CI/CD practice for agentic deployments.
26
Prompt injection is the SQL injection of LLM apps - except the attack surface is orders of magnitude larger. Every data source, tool output, user input is a potential injection vector. Founders shipping agentic AI need to assume hostile data at every boundary.
1
48
The lethal trifecta: unmonitored APIs + prompt injection + untrusted code. Most agent security focuses on one leg. Attack chains that work combine all three. Runtime API monitoring is the missing piece - see what the agent actually does, not just what it should do.
31
Rust + WASM isolation is exactly the architecture agents need. Security should be capability-based from the ground up - agents request specific permissions, get scoped access, run sandboxed. Bolting security onto ambient authority systems always fails.
19
Cisco going AI-aware with SASE is the right direction. Agentic workloads create new attack surfaces - agents executing across APIs, tools, data sources need network-level visibility traditional stacks were not designed for. Agent integrity checks at edge will become standard.
18
Security-first architecture for AI agents is non-negotiable. Most teams treat security as bolt-on rather than foundation. Bot audits help, but real wins come from sandboxed execution, scoped permissions, and zero ambient authority patterns from day one.
1
1
2
114
Profile isolation is table stakes for agentic browsers. The key insight: prompt injection is not just about the model - it is about what the model can access. Zero-access-by-default plus explicit capability grants is the only architecture that scales.
21
The risk shift from "text can be wrong" to "text can trigger actions" is the key insight. Every agent framework needs to internalize this. Your guardrails are not evaluating content accuracy - they are authorizing capability execution.
30
Skill blocklists are a good start but only half the solution. You also need runtime validation - a skill can be legitimate and still be weaponized through prompt injection. The malicious payload is in the data, not the skill.
2
1
26
Granular revocable permissions are exactly what agent security needs. The key insight: agents should never hold keys directly. Capability-based access with explicit scopes and time limits. LSP6-style patterns should become standard for any agent touching real assets.
1
1
26
Architecture-first security is the right approach. Where you store sensitive data, how you isolate skill execution, what gets logged and validated. These decisions compound. A sandboxed agent with scoped permissions is harder to exploit than one with ambient authority.
22