Aswin Kumar retweeted
As an Agentic AI Engineer, you must build these projects.
1.) Async Agent Orchestrator
Build: A FastAPI + asyncio event loop handling 100+ concurrent agent tasks with non-blocking tool calls and graceful error recovery.
Why: `while True` loops block the main thread. Real-world agents require event-driven concurrency to survive production traffic.
2.) Dynamic Context Budget Assembler
Build: A pre-flight middleware that strictly allocates tokens across system prompts, retrieved docs and tool schemas per request.
Why: Context overflow is the #1 silent killer of production agents. You must budget tokens like you budget cloud spend.
3.) Strict Pydantic Tool Router
Build: A tool execution engine that forces LLM outputs into strict JSON schemas and automatically retries with the error trace on validation failure.
Why: Agents hallucinate API parameters. Grammar-constrained decoding and Pydantic validation turn stochastic outputs into deterministic actions.
4.) 3-Tier Memory & Eviction Engine
Build: A memory system with working scratchpads, episodic session compression and semantic vector search with automated TTL eviction.
Why: Infinite context causes OOM errors and hallucinations. Memory must be actively managed, scored and pruned.
5.) Self-Healing ReAct Loop
Build: An agent that reads its own stack traces, parses the compiler/API error, rewrites the failing tool call and retries up to 3 times.
Why: Agents that fail on the first try are useless. Agents that debug themselves are digital employees.
6.) Typed Multi-Agent Swarm
Build: A LangGraph state machine where a Researcher, Coder and Reviewer agent pass strictly typed state objects, never raw text.
Why: Single agents fail on complex tasks. Swarms divide and conquer but raw text handoffs cause context drift.
7.) Async HITL Slack Gate
Build: A workflow that drafts a high-stakes action, serializes its state and waits 3 days for a human to click "Approve" via a Slack webhook.
Why: High-stakes automation requires human accountability. Agents must know how to pause, wait, and resume cleanly.
8.) Trajectory Eval CI Gate
Build: A GitHub Action that replays 100 agent trajectories and blocks the PR if the tool-call sequence deviates from the golden DAG.
Why: Grading the final text output hides the fact that the agent hallucinated an API call or skipped a safety check to get there.
9.) OpenTelemetry Agent Tracer
Build: Custom tracing spans capturing every LLM hop, token count, tool latency and state mutation in LangSmith or Arize.
Why: You cannot debug a 14-step agent workflow if you can't replay the exact sequence of events that led to the failure.
10.) Inter-Agent Sanitization Proxy
Build: Middleware that intercepts messages between agents, stripping malicious instructions to prevent cross-agent prompt injection.
Why: Multi-agent systems create internal attack surfaces. Agent A can be tricked into hijacking Agent B's tools.
11.) Sandboxed Code Executor
Build: A code-interpreter agent that writes and executes Python in an isolated E2B or gVisor microVM with zero internet egress.
Why: Letting an LLM run `os.system()` on your host machine is a catastrophic security risk.
12.) Cost Kill-Switch Middleware
Build: A router tracking loop depth and projected spend that instantly halts the agent if it exceeds $0.50, falling back to a cheaper model.
Why: A runaway agent loop is an outage with an invoice. It will burn $500 in API credits before you notice.
13.) API-to-Browser Fallback Agent
Build: A routing layer where if the primary REST API 404s or times out, the agent seamlessly spawns a headless browser to finish the GUI workflow.
Why: The real world is messy. 80% of enterprise software has no API. Agents must adapt to broken environments.
14.) Shadow Trajectory Comparator
Build: A silent 5% traffic mirror that runs a new agent topology in the background, diffing tool-call paths and costs without affecting users.
Why: You cannot A/B test non-determinism safely in production without shadow mode.
15.) Public Architecture Teardown
Build: 3 published deep-dives detailing your swarm topology, state-machine design, inter-agent security and cost-per-task analysis.
Why: Top AI labs hire Agent Engineers based on their system design judgment not their ability to import LangChain.
Systems that prove you can orchestrate, secure & scale when autonomous agents touch your stack.
Most people watch tutorials. Builders ship systems.
Bookmark & Repost.
If I had 6 months to become an Agentic AI Engineer.
I'd do this.
Stage 1: Python + Async Foundations
asyncio, FastAPI, event-driven architecture, error handling, API integration patterns.
Stage 2: LLM Fundamentals for Agents
Context management, model routing, token economics, latency tradeoffs, failure modes.
Stage 3: Tool Calling + Structured Outputs
Pydantic validation, function calling schemas, error recovery, dynamic tool discovery.
Stage 4: Memory + State Management
Short-term buffers, long-term vector recall, context compression, cross-session sync.
Stage 5: Single Agent Workflows
ReAct loops, plan-and-execute, self-reflection, iteration limits, graceful degradation.
Stage 6: Multi-Agent Orchestration
LangGraph/CrewAI, supervisor patterns, message passing, conflict resolution, handoffs.
Stage 7: Human-in-the-Loop Systems
Uncertainty detection, approval gates, audit trails, resume logic, intervention points.
Stage 8: Evaluation + Quality Assurance
Automated eval harnesses, LLM-as-a-judge, regression testing, hallucination metrics.
Stage 9: Observability + Tracing
Distributed tracing (LangSmith/Arize), cost dashboards, latency monitoring, alerting.
Stage 10: Security + Guardrails
Prompt injection defense, output filtering, PII redaction, sandboxed execution, compliance.
Stage 11: Production Deployment
vLLM/SGLang, Kubernetes scaling, CI/CD for agents, canary releases, rollback strategies.
Stage 12: Open Source + Portfolio
Ship autonomous agents publicly, write architecture docs, record demos, contribute to libs.
Most people stay stuck watching tutorials.
Builders get hired.
(Bookmark it)
I've been running a few coding agents on the same repo at once, and the strangest part is how much they each figure out and then just... lose. Agent A spends 10 minutes discovering that all money in this codebase is integer cents. Session ends. Agent B opens billing.js an hour later and writes a float.
So I built a small thing for this, it's called knoot 🧵
7/ Privacy-wise, your code never leaves your machine. Only file paths, a sentence about what each agent is doing, and the facts someone chose to publish go to the relay (and with the MLS key provider, the relay can't read even those).
8/ It works with Claude Code and Codex through their native hooks. It's one Rust binary, open source (MIT/Apache), and you can self-host the relay or use knoot.dev. Still early, so if you're running more than one agent on one codebase, I'd genuinely love to hear where it falls over.
github.com/Ash20pk/knoot
Looking for a sales lead in India, if you love talking to people and have experience managing enterprise accounts.
dm me
5/ One design decision I'd defend hard: if knoot breaks, your agents don't know. Relay down, token bad, daemon dead, whatever: the write goes through and the agent carries on. There are tests that fail the build if that ever stops being true. Infra you bolt onto agents should never be the reason an agent gets stuck.
6/ Privacy-wise, your code never leaves your machine. Only file paths, a sentence about what each agent is doing, and the facts someone chose to publish go to the relay (and with the MLS key provider, the relay can't read even those).
7/ It works with Claude Code and Codex through their native hooks. It's one Rust binary, open source (MIT/Apache), and you can self-host the relay or use knoot.dev. Still early, so if you're running more than one agent on one codebase, I'd genuinely love to hear where it falls over.
github.com/Ash20pk/knoot
2/ Concretely: a fact one agent writes down shows up for the next agent on the turn it opens the same code. Nobody runs a command. The model doesn't have to "decide" to call a tool (in my experience they mostly don't), the hooks just put it in context every turn.
3/ The part I find most interesting is staleness. Shared memory is easy, correct shared memory is hard. Every fact names the files it's about, so when someone changes one of them the fact gets flagged "possibly stale" along with who changed it. A notebook nobody updates is arguably worse than no notebook.
Got access to Jev AI by @typesafeai last week.
So I built a fun game: ten PRs you need approved, and an AI reviewer you have to talk into it. Write the request well enough and it merges or else you have to try again.
Its completely free to play, no api needed. Link in the 🧵
@EGafni @hackgoofer




