I dive into internals. 🇫🇷🇬🇧🇸🇦🌉

Mauritius
Joined May 2019
My book on SQLite internals, the first free and open book on the subject now comes up first on Google. compileralchemy.com/books/sq…
1
18
2
230
18,124
Been paying the bills for LLM-generated codes. Came to the conclusion that human review is needed.
Over a year ago, I stopped reading code and started automating adversarial agents to perform recursive code reviews instead. The result: low-defect systems that do what I want. Can't believe anyone engaging seriously with these tools still believes human code review is superior
1
94
Mind boggling
Strong argument from Samuel on why Graphs are a bad idea, and why Pydantic Monty and @temporalio are a better option.
2
118
Slop ^ 2 -> Slop reviewer ^ 2 to the rescue -> Slofware
Agent contributions to Omarchy are not only very welcome, but I usually prefer them! Rare is the human who has the patience to match an agent in providing all the pertinent details in a bug report. Also, PRs are mostly just proofs of concept now anyway.
1
75
Acquire + fire is a common pattern!
Today we’re laying off a large part of the Airtable team. This is not a reflection of their work but a reflection of our deep belief that small teams ship more and better. For Airtable, better is about to look like: - A new Core team shipping your top requests monthly (already 30+ shipped in 3 weeks) - Upgraded Omni, Airtable Canvas, a stronger MCP, and BYO agents, coming soon - New Performance and Infra teams focusing on speeding up bases and increasing limits on records, fields, and syncs To everyone leaving: thank you. If you’re hiring, these are excellent people and worth a call.
1
78
gh: Abdur-RahmaanJ retweeted
It's been 10 years of CalVer, which means it's high time for CalVer 26.0: sedimental.org/calver_26.htm… CalVer counts among its users @nvidiadeveloper @Apple @Tesla and many more, I even put together a timeline here: calver.org/timeline.html
5
2
1
10
596
It's Sci-Farce at this point.
1
67
My french-speaking brain always see essays as some half-finished artifacts (essayer/essaie)
My "Yes, And" essay is on the front page of HN
1
6
161
Recurrent advice to read the original paper. It clearly enounces residual connection as part of the paper ...
One of my most aha moments in understanding transformers: "Stop thinking about a transformer as a pipeline: as if each layer transforms the output of the layer before it." "Start thinking as a residual stream" Each transformer block has a residual connection that adds the input of the block back to it's output. x' = f(x) + x This "addition" connection means the attention/MLP block inside a layer (the function f above) does NOT actually transform the input - instead it computes the information that must be ADDED to the input before passing on to the next block! Think of the whole transformer backbone like a shared whiteboard. Each block reads what it needs from the board and writes its notes on the board. Additive changes. In fact, layers can talk at a distance. A block in layer 1 can write information and a block in layer 5 can read it, even though there is no direct wire between them. Ideas thanks to this old Anthropic circuits paper: transformer-circuits.pub/202…
1
81
Counterculture #python
I love that when you're editing a draft message in Discourse, there's no annoying AI telling your English is incorrect.
1
3
83
Grok: JetBrains employees note the figures cover only the Czech legal entity after headquarters relocation to the Netherlands, with the broader company claiming solid profitability in 2025 amid AI-driven shifts in developer tooling.
When I mention AI changing the tech industry very fast, I get pushback every now of how this pushes FOMO. But that IS the thing with rapid change like now!! If a company ignores how the industry changes, their business could suffer. JetBrains missed out on agentic harnesses:
57
Interfaze founders missing the SHA, it seems
Looks like you copied Chandra OCR 2 into your repo, renamed it, changed the license, and made the output worse (your olmocr score is 83.8 vs our 85.8).
2
95
We at OpenAi??? Charlie ...
Nicholas Nethercote has been doing great work on speeding up the Rust compiler. I'm proud that we at OpenAI will be funding his work, alongside others, as part of a Rust Project Goal to make rustc faster.
57
According to local legends sourced directly from visiting SF, this comes from people avoiding to pay and dumping the scooters into the sea.
the marine wildlife in the bay area is so enchanting
1
49
gh: Abdur-RahmaanJ retweeted
"Understanding Transformers and Attention Mechanisms" is a concise mathematical introduction to the attention mechanism, a key idea behind modern language models. The document covers tokenization and embeddings, queries, keys and values, attention scores and weights, multi-head attention, self-attention, causal/masked attention, cross-attention, and the basic structure of the Transformer architecture. It also introduces some important techniques used in modern LLMs to make attention more efficient, including KV caching, Grouped Query Attention (GQA), Multi-Query Attention (MQA), and Latent Attention. arxiv.org/pdf/2604.00965
10
99
2
633
28,638
Antonio is doing awesome work, but, the original paper is king. This would be more useful alongside the original.
"Understanding Transformers and Attention Mechanisms" is a concise mathematical introduction to the attention mechanism, a key idea behind modern language models. The document covers tokenization and embeddings, queries, keys and values, attention scores and weights, multi-head attention, self-attention, causal/masked attention, cross-attention, and the basic structure of the Transformer architecture. It also introduces some important techniques used in modern LLMs to make attention more efficient, including KV caching, Grouped Query Attention (GQA), Multi-Query Attention (MQA), and Latent Attention. arxiv.org/pdf/2604.00965
1
1
139
Queen of vagueposting!
guess the linux distro
95
Example of how reading few papers in depth helps: When you see Jev, you understand how it works and you have a nice idea of why it did not release a paper and why it has so many quick clones.
1
3
87
gh: Abdur-RahmaanJ retweeted
Who's coming to PyBay on Saturday? You'll hear from lots of Pythonistas, including "that dude that wrote the pytest book" (a great book, btw!). pybay.org/
2
2
820
SQLite experts merge with Pg experts. SQLite as you know is the protégé of Pg.
Turso is joining @supabase. Together, we're building the database platform for the agentic era: everything agents need, from lightweight databases to Postgres at petabyte scale. More details in thread. 👇
1
103
Completed a complete commentary of the transformer paper with EVERY difficult line explained. Read: compileralchemy.com/annotate…
1
1
7
132
It's a commentary of the annotated transformer @harvard_nlp
11