Co-founder & CEO, Mettle Networks | Telecom products & strategy | Building with AI/LLMs | Tracking & sharing the frontier daily to rethink what comes next.

Joined March 2007
LightOnOCR-3: document understanding becomes a compact, open-weight capability Released: October 8 The important development is not simply better text extraction. The models combine: OCR + document layout + bounding boxes + image descriptions + chart-data extraction. Previously, these capabilities often required multiple specialized models and processing stages.
1
42
Critical LMCache vulnerability: inference optimization introduces another security boundary JFrog disclosed CVE-2026-105192, an unauthenticated remote-code-execution vulnerability in LMCache’s multiprocess transport. Severity: CVSS 9.8. Affected releases include LMCache 0.3.9 through 0.5.5, with vulnerable code also identified in 0.5.6 release candidates. The vulnerability involves unsafe deserialization of messages received through an unauthenticated ZeroMQ interface. The critical qualification: remotely reachable exposure requires the multiprocess service to be bound to a routable address. Default localhost-only deployments are not remotely exposed in the same way. No patched release was available at disclosure. JFrog recommends restricting access to the multiprocess interface until a fix is released.
1
71
Researchers cut a coding agent's tool output by 38%. The bill went up 6.8%. Not noise: 2,908 provider-billed Claude Code runs, 95% CI +2.8% to +11.3% (arXiv 2607.12161). The reason is arithmetic, and it explains the most-shared AI chart of the summer. An agent loop re-sends its whole history on every turn. So input grows with the square of the turns: - 20K-token prompt, 2K new tokens per turn, 50 turns - 3.45M input tokens billed, 118K actually new - 96.6% of the input is the agent re-reading itself That's why 85%+ of agent tokens on OpenRouter are cache reads (a16z, Aug 2026). It isn't how agents behave. It's the shape of the loop. Caching cuts the price about 10×. It doesn't change the curve. So compression saved a few fresh tokens, the agent took extra turns, and every extra turn re-read the whole context. Where the cost gap actually lives: → Loop design and framework: roughly 4–50× → Cache discipline: up to ~10× on input → Model routing: modest on hard work, and a mid-session model switch throws the cache away → Token compression: small, sometimes negative Four rules that cost nothing if adopted early: 1. Stable prompt prefix. No timestamps at the top. 2. Append-only context. 3. Deterministic serialisation of tools and JSON. 4. Sub-agents instead of model switches. Measure cost per successful task, cache-hit rate and turns per task. Not tokens.
4
2
189
Full analysis, sources, and a reference table of the 12 levers of agent cost: anil.org.in/2026/10/06/why-t… Part 2 is next: budgeting for agents, tail risk, and cost per outcome.
1
44
Worth reading in full: - @sayashk @random_walker and team on HAL: two agent setups 9× apart in cost for a 2-point accuracy gap - Their "AI Agents That Matter": a simple baseline beat LATS at ~1/50th the cost - @OpenRouter's agent vs human token data
14
Fine-tuning an agent on what it already does well is wasted compute. Fine-tuning it on everything it fails is worse. ServiceNow's AutoSynthData targets the narrow band between: tasks the student solves ≤1 in 3 tries, but a stronger teacher solves ≥2 in 3. Failure says where to look. Teacher success says it's learnable. The loop: 
→ Run student + teacher in the target environment 
→ Distil failures into sanitised "capability cards" (eval prompts never reach the generator) 
→ Generate fresh tasks; teacher demonstrates 
→ Gate each one: does the reference solution actually pass? Do near-miss wrong states fail? 
→ Fine-tune, re-evaluate, move the frontier On EnterpriseOps-Gym (Gemma-4-26B-A4B student, SFT only): 
• Hybrid: +7.2 pts Pass@1 (+35% relative), 59% of the gap to the reference model closed. 2,000 samples, ~18 hrs to generate 
• ITSM: 18.8% → 27.2% Not shown yet: an ablation against untargeted synthetic data from the same teacher. Until then, failure-targeting isn't isolated from plain distillation. The CTO takeaway: your moat isn't the model. It's the environment, the verifiers and the failure telemetry. The eval harness you already run is a training-data factory you haven't switched on.
1
1
124
Source, ServiceNow AI on Hugging Face: huggingface.co/blog/ServiceN…
 The negative-verification gate is the underrated part: mutate the expected end state and confirm the verifier rejects it. Weak verifiers quietly reward wrong behaviour.
55
Open Secure AI Alliance, originally established by NVIDIA, now has a new leadership. After the recent real-world agent-containment incidents, security is beginning to move from individual labs publishing postmortems toward shared defensive infrastructure and incident-learning standards. That is a healthy maturation signal. The Linux Foundation announced yesterday that the Open Secure AI Alliance is moving under their governance. Its scope explicitly spans models, inference, agents, context, identity, policy, enforcement, containment and infrastructure.
1
88
Sovereign AI, scoped: a builder’s guide for governments and regulated businesses Sovereignty is not a product tier. It is a list of dependencies you decide to keep or cut, and the scoping is where the money is saved or wasted.
1
49
BRICS proposes an open-source AI zone spanning the Global South If implemented, the initiative could become an alternative distribution, localization and standards channel for countries that cannot afford frontier-model development or prefer reduced dependence on US providers. The valuable layer may be multilingual adaptation, regional hosting, evaluation and government procurement—not the base weights alone.
1
52
→ Model routing picks the right intelligence → Reasoning routing picks the right thinking strategy → Custom kernels pick the efficient execution path → Runtime controls decide what the agent is allowed to do None of these are the foundation model. All of them decide whether it works in production.
1
48