St. John's, NL, Canada
Joined April 2009
Jason Normore retweeted
I love the “Joys of the Craft” passage from The Mythical Man-Month. The joy of making things. Making things people use. Building complex systems and watching them work. Always learning. Turning something in your head into something real. Almost none of it is about writing code.
1
1
6
317
yet another fun jev experiment... i took a particle fluid simulation, pulled out the part that does the physics (what happens when two particles collide) and let jev handle it at the micro scale. 6.3 million decisions for this one, and the only laws it's told to follow are conservation of momentum and energy, and it never once broke them.
1
1
18
1,828
The problem of large LLM memory footprint doesn't seem to have a scalable architectural solution. Full attention is a necessity for modern LLMs. I ran a genetic algorithm over LLM architectures + hyperparams. They all lose on retrieval vs plain attention. The exception I wanted isn't there. jasonnormore.com/blog/search…
4
251
Jason Normore retweeted
turbopuffer crossed $100M run-rate in March. 19mo after $1M. Profitable & <$1M raised. Cursor・Anthropic・Notion・Cognition・Harvey・Bridgewater・Ramp・Linear・Legora・Superhuman・Atlassian・Granola We’d be nowhere without them. We work like hell to exceed their expectations.
248
143
138
3,449
1,421,502
Attention isn't all you need - some attention is. I've been exploring ways to reduce the compute and memory footprint of LLMs. I put it together in a repo: Calibrated Sparse Attention (CSA) is a one-time calibration pass on an existing model that figures out which keys each head in each layer actually uses, and you skip the rest. At matched LM quality I'm seeing potential for: ~10× longer context at the same memory + bandwidth budget ~10× less KV-read bandwidth per token (with a sparse kernel) ~10× fewer attention FLOPs ~10× more requests per GB of KV memory (composed with eviction) No retraining or labels needed.
1
2
5
348
Been on a quest to make models run with a smaller memory footprint, especially locally on my laptop, so I built a hybrid SSM+attention model with three memory layers: • minimal attention KV for turns • SSM state, MB-scale memory footprint for episodic • LoRA from captures for long-term learning Long context without the memory-bandwidth tax of GB KV caches, no prompt inflation. I'm curious to see how it scales to larger models. github.com/jnormore/cognit
1
2
233
Jason Normore retweeted
Back with another product update courtesy of my favourite @JonnieSimpson. Manually triggered flows are now live on @heymantle LFG. 🚀 Until now, every flow in Mantle ran on a schedule: daily, weekly, on a trigger event. Useful, but not every flow wants to be a cron job.
2
1
5
504
"Make each program do one thing well" assumed humans were writing them. Slow, deliberate, by hand. Agents flip this. They can author small, single-purpose programs constantly, for one task, for one user, torn down when no longer useful. The philosophy scales in a way its authors couldn't have imagined. But durable work needs somewhere to live. Not a conversation context that evaporates. Not a workflow SaaS built for humans clicking through a GUI. cue is that runtime. Agents push code into it over MCP. Actions they author become callable — by a schedule, a webhook, an app the agent spun up, another agent. Each call runs in a fresh sandboxed VM, so scale doesn't mean blast radius. Here's how an agent OS starts.
2
1
4
529
Pulled this out of a project I'm working on: unitask: a sandbox for the code your LLM (or your users) generate. Fresh unikernel per call. Super fast boot, run, destroy. I love the Unix philosophy of "make each program do one thing well." With AI in the loop, a program is dynamic and ephemeral, written for one task, run once, then thrown away.
1
1
6
451
Jason Normore retweeted
New on @heymantle: Marketing Sites 🔍 Mantle's AI already helps you write docs and accelerate customer support for your app. But the full customer journey? It was a blackbox until now. We shipped tracking pixel for Marketing Sites.
1
1
8
441
most teams have no view into what LLM calls they're actually making, or how cost breaks down across their business. they can't even try a different provider or model version, locked in by an implementation decision they can barely remember making, and the unknown of how each model behaves is too much. most companies are juggling thousands of API keys and Claude Max subs so employees can use AI. no way to route by use case, no idea which teams are using which models. i've been working on modelux to fix this. the control plane for your LLMs. modelux.ai
2
2
534
My favourite part is the simulator modelux.ai/experimentation/
1
1
184
Jason Normore retweeted
A while back we shipped one-click affiliate payouts at @heymantle. Everyone loved it. 💛 But we kept hearing the same thing: "I still have to remember to log in and do it." Turns out, even one click is one too many. So we took the last click away.
1
1
4
321
Jason Normore retweeted
New on @heymantle: Smarter email suppression 🎯 We just shipped a small feature with a big impact on deliverability. You can now automatically suppress role-based email addresses like support@, info@, noreply@ from your marketing sends.
4
2
13
694