Computer Science undergraduate passionate about Artificial Intelligence, self-hosted software solutions, and automation.

England/United Kingdom
Joined February 2025
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
Replying to @jitbit
most young people yes, but AI has also been an incredible tool that has helped me develop soft skills, meet new people, travel to new places and kick-started my career. Without AI I would probably still be stuck applying for a job at McDonalds.
198
SecretiveShell retweeted
My harness started as an experiment, I thought we were doing harnesses wrong: Why are we forcing agents to operate how humans operate? We can do better, and we should. In efficient orgs, humans do not even operate in clear hierarchies. Pics attached to see what I mean.
32
7
132
18,853
Replying to @Zer0dots
about to start working on my university dissertation on something almost identical to this
29
SecretiveShell retweeted
A hypothesis: agents don't need a sandbox. They need a platform that thinks, acts, remembers, and improves as one system. There's a debate running this week about sandboxes. One camp says sandboxes are dead and the future is a private cloud for every agent. Another says a sandbox is a compute primitive, like Postgres or Redis, and primitives don't win markets, platforms do. A third says sandboxes are a winner-takes-most market. I think all three are arguing about one layer of the problem. My hypothesis is that agents are the first workload that exercises every layer of a platform inside a single loop. They think, they act on real systems, they remember, and they improve. A web server touched compute and maybe a database. An agent touches inference, execution, tools, storage, retrieval, telemetry, and evaluation, in one task, often in less than a minute. So what an agent needs isn't a better sandbox. It's a platform where those four things run as one system. If that's right, the unit of competition isn't the sandbox and it isn't the model. It's the integrated cloud for agents. Whoever builds one that's compelling across agents, data, and model access at the same time wins. Let’s start with how an agent actually runs. One “prompt” fans out into a dozen model calls, a web search, a database query, a code execution, a tool call with a credential, a checkpoint, and a trace. Today a typical team buys those from five or six vendors and glues them together. Six vendors means fifteen seams. Every seam is an integration someone maintains, a credential someone stores, a network hop that adds latency, an egress fee, and a place where the trace dies. Point solutions are excellent but partial: most sandbox companies don't run inference, and model companies don't manage agent memory or observability. The loop is what breaks on a stitched stack. Models have to be routable, and routing only works when inference sits next to the agent. Every few weeks a new model tops a chart. Open-weight models went from <20% of token volume on our Inference Engine in April to >85% by August. My read: the model is the most swappable layer in the stack, so you want a router in front of it, not a hard-coded choice. We built an Inference Router for that. On Kimi K3 we see an aggregate cache-hit rate above 90% across our own workloads. The router has to know what the inference layer has cached, and the cache has to sit next to the sandbox that's going to need it. That's a function call on one platform. The agent and harness layer is where the business logic lives, so the runtime has to be built for it. I believe the harness, its prompts, its tool permissions, its memory, and its evals will hold more of a company's business logic than the model ever will. The model is rented. The agent is yours. So we built Managed Agents from the ground up as purpose-built primitives, not VMs with an agent sticker on them. Every session gets its own Firecracker microVM, resumes from pause in a few hundred milliseconds, and is billed for active CPU at $0.044 per vCPU-hour, so the wait costs zero. Action Gateway gives agents governed access to 20K+ tools across 600+ providers through one MCP endpoint, matched intent to tool with 99%+ accuracy in our testing, and brokers credentials at call time. The agent never sees the key. You can only make that promise when the runtime, the gateway, and the secret store are the same system. Data and recursive loops are what make an application more intelligent over time. This is the part I believe in most and the part with the least proof so far, because the products are weeks old. The hypothesis: two teams start with the same model and the same harness, and within a quarter they diverge, and the one with the loop wins. On DigitalOcean the loop runs on two services. Agent Data Services is one governed catalog where video, documents, logs, and agent sessions land agent-ready and searchable by meaning. Agent Learning Services closes the loop: Insights records every step, Signals flags the sessions where the agent stalled, looped, or lost the user, and Evaluations and Simulations test the fix before a customer sees it. In an internal demo, an optimized support agent went from failing to passing it with 90% fewer input tokens. Intelligence stops being something you rent via models and becomes something your application accumulates, tuned to the exact problem it's solving. And the whole thing has to go down to the floor. DigitalOcean builds the routing model and the microVM runtime operates the GPUs they run on, across 20 data centers with NVIDIA HGX B300 and AMD MI350X fleets. Much of the agent infrastructure market rents GPUs from someone who rents a data center from someone else, with margins stacked on margins. My view is that active CPU billing, a warm KV cache next to the sandbox, and a router that can see the inference layer are only possible when you control the data center, the hardware, and the software as one stack. The obvious objection is that "integrated" is a polite word for lock-in. I'd argue the opposite, and I think it's the real test of whether a platform is integrated or just bundled. Integration should be about removing seams, not closing doors. Bring Claude Code, Codex CLI, OpenCode, Hermes, LangGraph, or your own OCI image. Hit one endpoint compatible with OpenAI, Anthropic, and 60+ Open models. Bring your own key for a frontier model, or run open weights we host. Our routing model and the proxy under it are open source. The point is that the seams are gone, not that the exits are. One early signal that the hypothesis might be right: roughly 70% of our large AI customers have attached a one or more platform primitives. Agents come in through inference or a sandbox and pull the rest of the cloud behind them. That's what I'd expect if agents really do need every layer at once. So, back to the debate. The platform that wins won't be the one with the best sandbox, and I don't think it'll be the one with the best model. My bet is on the platform where an agent thinks, acts, remembers, and improves as one system. DM me if you are interested in trying our Agent primitives. #digitalocean #agents #Agenticloop #learning #Context #sandbox #Runtime #DOCN
22
11
4
106
11,025
Replying to @ccodyy69
dismantle the case and use a hair dryer on no heat mode to blow the dirt out of the holes from the back
2,936
the local harness that the pydantic AI sdk replaces would not have prevented this hack as it was the SaaS ai gateway that got hacked rather then the local agent
1
1
23
Replying to @Glitch253 @pydantic
yes, usually when I think of pydantic I think of the pydantic validation library used by fastapi/flask rather then the AI sdk so I used that in my example. You can even use opencode with your own inference provider and not opencode console.
1
27
Replying to @Glitch253 @pydantic
this is like saying if pydantic logfire got hacked that I should stop using the data validation library and use my own infrastructure
1
47
Replying to @OmLahorey
love the hexagon pattern
1
2
12
Replying to @leodev
if you have any small compute devices like RPi, network switches, routers, NUC that might work well. DVD or other physical media? Startup branded stuff like mugs you get from conventions and developer summits?
9
Replying to @kentcdodds
opensandbox has an egress proxy and credential vault if you want to self host instead of using cloud agents
43
SecretiveShell retweeted
What in the regulatory capture are we doing here
18
51
5
258
8,681
Replying to @zeeg
just point alibaba's opensandbox or tencent's CubeSandbox at any cloud K8S service and you have the same infrastructure for a lot cheaper with more control.
92
Replying to @ryanvogel
any custom workflow or internal process benefits from skills. Anything you want to use across agent sessions like preferences or PR templates also make decent skills.
69
amazing! congratulations.
1
20
use copy on write file systems and then its not as much of an issue to have 100 worktrees
2
1
233
Replying to @JamesMalsawm
sounds like you now have discovered a new hot water bottle alternative
13
It's better to ship something then spend months going round in circles on a specification
1
21
Replying to @Gosleepriya
Make the 4 into two straight lines for 9116
2
8
Replying to @solopribuilds
I think it needs to be a harness primitive to work well, or you run into annoying problems like backups
7