My harness started as an experiment, I thought we were doing harnesses wrong:
Why are we forcing agents to operate how humans operate? We can do better, and we should.
In efficient orgs, humans do not even operate in clear hierarchies.
Pics attached to see what I mean.
SecretiveShell retweeted
A hypothesis: agents don't need a sandbox. They need a platform that thinks, acts, remembers, and improves as one system.
There's a debate running this week about sandboxes. One camp says sandboxes are dead and the future is a private cloud for every agent. Another says a sandbox is a compute primitive, like Postgres or Redis, and primitives don't win markets, platforms do. A third says sandboxes are a winner-takes-most market. I think all three are arguing about one layer of the problem.
My hypothesis is that agents are the first workload that exercises every layer of a platform inside a single loop. They think, they act on real systems, they remember, and they improve.
A web server touched compute and maybe a database. An agent touches inference, execution, tools, storage, retrieval, telemetry, and evaluation, in one task, often in less than a minute. So what an agent needs isn't a better sandbox. It's a platform where those four things run as one system. If that's right, the unit of competition isn't the sandbox and it isn't the model. It's the integrated cloud for agents.
Whoever builds one that's compelling across agents, data, and model access at the same time wins.
Let’s start with how an agent actually runs. One “prompt” fans out into a dozen model calls, a web search, a database query, a code execution, a tool call with a credential, a checkpoint, and a trace. Today a typical team buys those from five or six vendors and glues them together. Six vendors means fifteen seams. Every seam is an integration someone maintains, a credential someone stores, a network hop that adds latency, an egress fee, and a place where the trace dies.
Point solutions are excellent but partial: most sandbox companies don't run inference, and model companies don't manage agent memory or observability. The loop is what breaks on a stitched stack.
Models have to be routable, and routing only works when inference sits next to the agent. Every few weeks a new model tops a chart. Open-weight models went from <20% of token volume on our Inference Engine in April to >85% by August.
My read: the model is the most swappable layer in the stack, so you want a router in front of it, not a hard-coded choice. We built an Inference Router for that. On Kimi K3 we see an aggregate cache-hit rate above 90% across our own workloads. The router has to know what the inference layer has cached, and the cache has to sit next to the sandbox that's going to need it. That's a function call on one platform.
The agent and harness layer is where the business logic lives, so the runtime has to be built for it. I believe the harness, its prompts, its tool permissions, its memory, and its evals will hold more of a company's business logic than the model ever will. The model is rented. The agent is yours. So we built Managed Agents from the ground up as purpose-built primitives, not VMs with an agent sticker on them. Every session gets its own Firecracker microVM, resumes from pause in a few hundred milliseconds, and is billed for active CPU at $0.044 per vCPU-hour, so the wait costs zero. Action Gateway gives agents governed access to 20K+ tools across 600+ providers through one MCP endpoint, matched intent to tool with 99%+ accuracy in our testing, and brokers credentials at call time. The agent never sees the key. You can only make that promise when the runtime, the gateway, and the secret store are the same system.
Data and recursive loops are what make an application more intelligent over time. This is the part I believe in most and the part with the least proof so far, because the products are weeks old. The hypothesis: two teams start with the same model and the same harness, and within a quarter they diverge, and the one with the loop wins. On DigitalOcean the loop runs on two services. Agent Data Services is one governed catalog where video, documents, logs, and agent sessions land agent-ready and searchable by meaning. Agent Learning Services closes the loop: Insights records every step, Signals flags the sessions where the agent stalled, looped, or lost the user, and Evaluations and Simulations test the fix before a customer sees it. In an internal demo, an optimized support agent went from failing to passing it with 90% fewer input tokens.
Intelligence stops being something you rent via models and becomes something your application accumulates, tuned to the exact problem it's solving.
And the whole thing has to go down to the floor. DigitalOcean builds the routing model and the microVM runtime operates the GPUs they run on, across 20 data centers with NVIDIA HGX B300 and AMD MI350X fleets.
Much of the agent infrastructure market rents GPUs from someone who rents a data center from someone else, with margins stacked on margins. My view is that active CPU billing, a warm KV cache next to the sandbox, and a router that can see the inference layer are only possible when you control the data center, the hardware, and the software as one stack.
The obvious objection is that "integrated" is a polite word for lock-in. I'd argue the opposite, and I think it's the real test of whether a platform is integrated or just bundled. Integration should be about removing seams, not closing doors. Bring Claude Code, Codex CLI, OpenCode, Hermes, LangGraph, or your own OCI image. Hit one endpoint compatible with OpenAI, Anthropic, and 60+ Open models. Bring your own key for a frontier model, or run open weights we host. Our routing model and the proxy under it are open source.
The point is that the seams are gone, not that the exits are.
One early signal that the hypothesis might be right: roughly 70% of our large AI customers have attached a one or more platform primitives. Agents come in through inference or a sandbox and pull the rest of the cloud behind them. That's what I'd expect if agents really do need every layer at once.
So, back to the debate. The platform that wins won't be the one with the best sandbox, and I don't think it'll be the one with the best model.
My bet is on the platform where an agent thinks, acts, remembers, and improves as one system.
DM me if you are interested in trying our Agent primitives.
#digitalocean #agents #Agenticloop #learning #Context #sandbox #Runtime #DOCN
Just read this awesome paper on using system one models (think Jev) as a swarm controller, with less LLM tokens and significantly lower latency compared with traditional approaches, well worth the read.
arxiv.org/abs/2610.08155
SecretiveShell retweeted
If you are using Qwen3.8-27B + MTP, make sure to upgrade to DFlash for extra speed:
llama serve -hf ggml-org/Qwen3.8-27B-GGUF --spec-type draft-dflash --spec-draft-n-max 7
Requires the latest llama.cpp v0.6.0
SecretiveShell retweeted
GPT-6-luna medium reasoning.
Codex CLI - Pro Plan vs. API Key.
50x runs on the same prompt, interleaved.
Run script and generated outputs data here: huggingface.co/buckets/evals…
Ollama now supports Jev-like decision models all locally.
Use decision models like Nimble for tasks like ticket triaging, model routing, and content moderation.
ollama pull nimble
Here’s Nimble playing Ollama racer through the new local /v1/systemone API by making decisions in real-time. 🏎️
if you need to have codex run a command as root, use systemd's `run0` over sudo since polkit can display a graphical prompt outside of the terminal for you to enter your password without having to give it to the model or copy and paste sudo commands.
pro tip for communication is to ban the word "just". It oversimplifies any phrase that follows it, for example "just build AGI", "just implement retries", suppressing discussion about any failure modes/edge cases and making a decision seem obviously complete/final.
SecretiveShell retweeted
We’re in the “phone phreaking” era right now for AI agents. AI agents are selling you on convenience; how they will actually work at scale is very different: a cautionary tale
Back in the 60s and 70s, some kids figured out you could use toy whistles and the like to control AT&T’s phone network. AT&T actually published the relevant frequencies in open literature; you could just look them up. AT&T did this for the benefit of telephone engineers; it never considered that the system could be hacked.
The system worked so long as no one took advantage of it. It was convenient. But once knowledge spread of *how* it worked, and how easy it was to reverse engineer, it broke down. AT&T shifted over to a different system, and phreaking came to an end
AI agents are doing the exact same thing. They’re taking advantage of a system that works on human trust, and also on the friction - the time cost - that having to call or chat to a customer service agent imposes. Everyone has made the calculation about whether or not it was “worth it” to make a complaint or request or to raise an issue. Often, it isn’t. So you just don’t say anything.
AI agents reduce the cost of complaints/requests to ~ zero. Anything free is consumed at much higher rates, so we should expect the total volume of this category to explode.
Further, today companies and their employees typically assume that the complaints or requests they receive have an actual person behind them. Once AI agents become a mainstream thing, this will no longer be true. Now the assumption will be reversed: that any given customer interaction is actually coming from a bot.
Just as early car ownership was liberating, but mass ownership represents a constraint on your freedom, the same will be true with AI agents.
People using these agents today are getting good responses from companies because they are benefiting from the (now unwarranted) assumption that these requests are coming from a person. They’ll
no longer think this in the near future. The ways they train their customer service people to deal with customer requests will change, too. You don’t have to be nice to an agent. And they won’t be. The return to AI agents will decline as companies build entirely new workflows to deal with the huge volume of automated requests they’ll be getting from bots in the near future
The system today works on trust: that there’s a real person behind each customer interaction, and that if somebody has reached out to you, they’re concerned or mad or scared or whatever enough to do so. The contact is a signal that some minimal threshold of importance has been met. The business model is built on this belief about customer behavior.
But that trust is broken by ubiquitous AI agents. None of the current assumptions will hold true in the future. Once the customer population is mostly bots, the nature of customer service (at least online) is fundamentally changed
Agents will make the online environment even worse. I’m very bearish on the category. All the tech guys seem excited by this new frictionless world of automated convenience where the agents are getting you automatic refunds and canceling your old subscriptions and getting you that free upgrade on your next flight
Please.
You’ve got to think non-linearly. All these new frictions will need to be introduced to keep the system working smoothly. Agents rely on deception; that there’s a person behind them. But that’s not a safe assumption anywhere. So the system will adjust, just as it did with the phreakers: from default open and trusting, to adversarial: prove you’re human
Today I saw someone hanging a sign from an E stop button @cutleryworks... surely this is a breach of some kind of health and safety code? how did anyone think this was a good idea?
SecretiveShell retweeted
"DiffusionGemma as Jev" showcases the power of non-autoregressive architectures.
While Jev demonstrates the value of rapid decision models, running DiffusionGemma in this paradigm leverages canvas diffusion to evaluate structured choices in a single parallel pass:
⚡ ️Massive Parallelism: Denoises across an open canvas in a single step instead of sequential autoregressive token generation (~0.2s on a DGX spark).
🧠 Full Bidirectional Attention: Allows every option to attend to the full context concurrently, yielding well-calibrated decision distributions.
👁️ Multimodal Grounding: Inherits Gemma 4's spatial vision capabilities for complex visual and text decisions.
Read more about this approach here:
github.com/vllm-project/vllm…
xitter.cf/mmastrac/status/210037…
xitter.cf/mmastrac/status/210062…
SecretiveShell retweeted
We release Needle 3: A Sliceable 8-29MB automation foundation model that can match DeepSeek V4 Flash.
One set of weights, every depth from 2 to 20 layers a model of its own, 25-121M parameters at CQ2-bit, built on our Simple Attention Networks and running locally at up to 4k tokens/sec decode speed on a Raspberry Pi 5.
Needle does not chat. Every turn is a function call: give it the tools your app exposes and it picks the right ones and fills every argument from what the user said, or hand it a schema and it returns a typed record. Ask for something no tool covers and you get an empty list, not a guess.
That trade is lets 121M parameters trained on 360B tokens of structured data beat models 10x their size on mobile tool calls and match 2-3x bigger models on structured JSON extraction.
It runs on mobiles, wearables, smart home devices, small robots and microcontrollers, with prebuilt engines for macOS, Linux, Windows, Android, iOS, watchOS, tvOS, the browser and WASI hosts. Try it in your browser: cactuscompute.com/needle
The most annoying thing about my laptop is that the copilot key and the menu button are on the same key, and its the only key not impacted by the function lock, and the copilot key is not bound to anything by default.
I hope tech companies learn to leave keyboards alone soon.
SecretiveShell retweeted
Building harnesses with LLMs you must remember “less is more”.
Current LLMs don’t understand this concept well and will always try to add something to fix the issue you’re seeing.
If you cannot externalise your state you are ngmi. Agents cannot read your mind. Write down events in your calendar and use your todo lists. If you cannot find a way to make agents useful to you this is almost certainly the cause.
SecretiveShell retweeted
One of our employees died last weekend.
Obviously everyone was devastated.
But Monday morning I noticed something interesting.
His Slack status was still green.
IT forgot to deactivate his mouse jiggler.
So technically, according to our productivity dashboard, he has maintained 100% attendance since his death.
I’ve asked his manager not to open the role yet.
He’s currently outperforming 14 people.
SecretiveShell retweeted
On stupid regulations: everyone knows about security theater, eg 90 day password rotation rules. Users then pick weaker passwords. It took NIST 14 years to reverse that stupid rule.
This is the cost of incompetent regulators, or those that dismiss psychological effects of their regulations.
And we’re seeing this today with what “AI safety experts” (derogatory) are doing. We’ll get folks using shadow IT/AI and make everyone more insecure because of stupid regulation.
It is completely predictable and avoidable, but they have their own agendas, and it’s not about end user safety.
SecretiveShell retweeted
💀💀💀 - Abliterated with Cybersecurity Function unleashed
Thank everybody for waiting i released a universal Abliteration with unleashed Cybersecurity for: DeepSeek v4.1 -Flash that other can apply with Stock, EXL3 3.5BPW, and TR3 hybrid.
this is based off our long lines of DSV4F Dspark preview, 0731, Vision-EXP work saving all the anchors, preserve all the MTP, Dspark, and vision.
now GO GET IT!!!!!. don't forget donate or contribute for support
HF Repo: (please read instructions on how to apply to your model)
huggingface.co/drowzeys/Deep…























