Pinned Tweet
My favourite iOS apps:
1. Things 3
A beautiful task manager for iOS and Mac. Truly a pleasure to use. @culturedcode
apps.apple.com/gb/app/things…
For AI applications - if you can nail Automated Evaluation of what good looks like, combined with some Durable Execution (which supports streaming/steps/retries/complex flows) - then you’re a lot further on than most!
We’re here at #TheAISummit at stand 3-2-1 in the South Expo Hall. We solve difficult problems through great software engineering and design. @parallax
Come say hello 👋
James Hall retweeted
We got GMail (full interface) working in @ladybirdbrowser, let's fricken gooooooo! 🚀
This one is nice because I've been told by many people "you'll never be able to handle modern web apps like GMail"
Don't listen to armchair defeatists. We can build whatever we want! 🤓
- Quantized it so it doesn't crash my M3 Mac. - Started a llama.cpp server, and use the raw (non-OpenAI-compatible) API to delve into the underlying logprob data. - Built a basic UI on top of this to start exploring.
Some interesting advantages to having greater insight into underlying probabilities is knowing when it might be wrong, debugging models issues, and for learning purposes.
Another weekend project, I've built another visualisation.
Commercial LLMs often don't expose their logits/logprobs. This is the chance that the next token/word appears.
What I've done:
- Pulled Llama3.3 locally from HuggingFace, converted it to GGUF for llama.cpp.
James Hall retweeted
Collection of insane and fun facts about SQLite. Let's go!
SQLite is the most deployed and most used database. There are over one trillion (1000000000000 or a million million) SQLite databases in active use.
It is maintained by three people. They don't allow outside contributions.
I've made a tool that lets you explore Text Embedding Vectors (an important step for AI tools which use Retrieval Augmented Generation) in a 3D space.
You can choose between different dimension reductions, which helps you compare features.
James Hall retweeted
Commemorating the remarkable accomplishments of these AWS Heroes in driving innovation and sharing knowledge:
▶ Keith Yau
▶ Kazuki Miura
▶ Kaushik Mohanraj
▶ James Hall
James Hall retweeted
This strange tweet got >25k retweets. The author sounds confident, and he uses lots of hex and jargon. There are red flags though... like what's up with the DEI stuff, and who says "stack trace dump"? Let's take a closer look... 🧵1/n
I've started a techy Substack, because why not. mrrio.substack.com/
Check out my latest article: Thoughts on Bun – a Fast JavaScript Runtime linkedin.com/pulse/thoughts-… via @LinkedIn
James Hall retweeted
Wow,what a great review in @thetimes @CharlotteIvers 5/5 top score!”possibly the perfect pub,actually “ thank you @stephen422smith & team heading up the kitchen & the rest of the gang that make it such a fab place !! Come & try for yourself,book online we have rooms at the inn !!
James Hall retweeted
"Operation Triangulation"
securelist.com/operation-tri…
A newly discovered spyware campaign targeting Apple iPhone using a zero-click remote code execution via an attack chain of 4 zero-days, including highly mysterious, completely undocumented MMIO registers and hardware features that are not even ever used by the firmware.
TLDR the attack begins with an iMessage to an arbitrary phone that, without any user action and invisibly, gets it to collect and upload tons of private data (and much more, e.g. microphone recordings) from there on, and actively takes steps to hide all of this activity from the user and aspiring forensic researchers. Apple has patched the core vulnerability on Oct 25, 2023.
"This is definitely the most sophisticated attack chain we have ever seen"
The talk itself, a lot more wild information there:
youtube.com/watch?v=7VWNUUld…
The author of this attack is unknown, as is the method by which they gained knowledge of these unused, undocumented hardware features. Russia's intelligence service accused Apple of providing the NSA with a backdoor.
For a more general audience intro to this underworld I usually recommend the book "Countdown to Zero Day".
In preparation for the OpenAI GPT Store, we've renamed Jira Helper to Ticket Helper.
* Other issue-tracking platforms are available.
chat.openai.com/g/g-9oWbx2S7…
- Is it good? Yeah you still have to do the thinking. It's not going to magic up the right answers, but it does help you get unstuck.



















