Pinned Tweet
My book on SQLite internals, the first free and open book on the subject now comes up first on Google.
compileralchemy.com/books/sq…
Been paying the bills for LLM-generated codes. Came to the conclusion that human review is needed.
Mind boggling
Strong argument from Samuel on why Graphs are a bad idea, and why Pydantic Monty and @temporalio are a better option.
Slop ^ 2 -> Slop reviewer ^ 2 to the rescue -> Slofware
Acquire + fire is a common pattern!
Today we’re laying off a large part of the Airtable team.
This is not a reflection of their work but a reflection of our deep belief that small teams ship more and better.
For Airtable, better is about to look like:
- A new Core team shipping your top requests monthly (already 30+ shipped in 3 weeks)
- Upgraded Omni, Airtable Canvas, a stronger MCP, and BYO agents, coming soon
- New Performance and Infra teams focusing on speeding up bases and increasing limits on records, fields, and syncs
To everyone leaving: thank you. If you’re hiring, these are excellent people and worth a call.
gh: Abdur-RahmaanJ retweeted
It's been 10 years of CalVer, which means it's high time for CalVer 26.0: sedimental.org/calver_26.htm…
CalVer counts among its users @nvidiadeveloper @Apple @Tesla and many more, I even put together a timeline here: calver.org/timeline.html
Recurrent advice to read the original paper. It clearly enounces residual connection as part of the paper ...
One of my most aha moments in understanding transformers:
"Stop thinking about a transformer as a pipeline: as if each layer transforms the output of the layer before it."
"Start thinking as a residual stream"
Each transformer block has a residual connection that adds the input of the block back to it's output.
x' = f(x) + x
This "addition" connection means the attention/MLP block inside a layer (the function f above) does NOT actually transform the input - instead it computes the information that must be ADDED to the input before passing on to the next block!
Think of the whole transformer backbone like a shared whiteboard. Each block reads what it needs from the board and writes its notes on the board. Additive changes.
In fact, layers can talk at a distance. A block in layer 1 can write information and a block in layer 5 can read it, even though there is no direct wire between them.
Ideas thanks to this old Anthropic circuits paper: transformer-circuits.pub/202…
Counterculture #python
Grok: JetBrains employees note the figures cover only the Czech legal entity after headquarters relocation to the Netherlands, with the broader company claiming solid profitability in 2025 amid AI-driven shifts in developer tooling.
According to local legends sourced directly from visiting SF, this comes from people avoiding to pay and dumping the scooters into the sea.
gh: Abdur-RahmaanJ retweeted
"Understanding Transformers and Attention Mechanisms" is a concise mathematical introduction to the attention mechanism, a key idea behind modern language models.
The document covers tokenization and embeddings, queries, keys and values, attention scores and weights, multi-head attention, self-attention, causal/masked attention, cross-attention, and the basic structure of the Transformer architecture.
It also introduces some important techniques used in modern LLMs to make attention more efficient, including KV caching, Grouped Query Attention (GQA), Multi-Query Attention (MQA), and Latent Attention.
arxiv.org/pdf/2604.00965
Antonio is doing awesome work, but, the original paper is king. This would be more useful alongside the original.
"Understanding Transformers and Attention Mechanisms" is a concise mathematical introduction to the attention mechanism, a key idea behind modern language models.
The document covers tokenization and embeddings, queries, keys and values, attention scores and weights, multi-head attention, self-attention, causal/masked attention, cross-attention, and the basic structure of the Transformer architecture.
It also introduces some important techniques used in modern LLMs to make attention more efficient, including KV caching, Grouped Query Attention (GQA), Multi-Query Attention (MQA), and Latent Attention.
arxiv.org/pdf/2604.00965
Example of how reading few papers in depth helps:
When you see Jev, you understand how it works and you have a nice idea of why it did not release a paper and why it has so many quick clones.
gh: Abdur-RahmaanJ retweeted
Who's coming to PyBay on Saturday? You'll hear from lots of Pythonistas, including "that dude that wrote the pytest book" (a great book, btw!).
pybay.org/
SQLite experts merge with Pg experts. SQLite as you know is the protégé of Pg.
Turso is joining @supabase.
Together, we're building the database platform for the agentic era: everything agents need, from lightweight databases to Postgres at petabyte scale.
More details in thread. 👇
Completed a complete commentary of the transformer paper with EVERY difficult line explained.
Read: compileralchemy.com/annotate…


























