Director @parallax, AWS Hero, Co-host at Off Script Podcast https://xitter.cf/t.co/Kk1jc1TKnj, wrote some popular JS stuff like jsPDF many moons ago

Leeds, UK
Joined March 2008
My favourite iOS apps: 1. Things 3 A beautiful task manager for iOS and Mac. Truly a pleasure to use. @culturedcode apps.apple.com/gb/app/things…
1
1
11
3,644
For AI applications - if you can nail Automated Evaluation of what good looks like, combined with some Durable Execution (which supports streaming/steps/retries/complex flows) - then you’re a lot further on than most!
333
We’re here at #TheAISummit at stand 3-2-1 in the South Expo Hall. We solve difficult problems through great software engineering and design. @parallax Come say hello 👋
1
1
454
Better add this to the fucking list
Protip: Putting a lot of curse words in your conference talk makes you look immature and unserious.
1
396
We got GMail (full interface) working in @ladybirdbrowser, let's fricken gooooooo! 🚀 This one is nice because I've been told by many people "you'll never be able to handle modern web apps like GMail" Don't listen to armchair defeatists. We can build whatever we want! 🤓
63
118
11
1,950
67,930
- Quantized it so it doesn't crash my M3 Mac. - Started a llama.cpp server, and use the raw (non-OpenAI-compatible) API to delve into the underlying logprob data. - Built a basic UI on top of this to start exploring.
1
1
377
Some interesting advantages to having greater insight into underlying probabilities is knowing when it might be wrong, debugging models issues, and for learning purposes.
1
1
290
Getting your head around sampling (and constrained sampling - like used for Structured Outputs) is a good area to get stuck into.
1
268
Another weekend project, I've built another visualisation. Commercial LLMs often don't expose their logits/logprobs. This is the chance that the next token/word appears. What I've done: - Pulled Llama3.3 locally from HuggingFace, converted it to GGUF for llama.cpp.
1
2
306
James Hall retweeted
Collection of insane and fun facts about SQLite. Let's go! SQLite is the most deployed and most used database. There are over one trillion (1000000000000 or a million million) SQLite databases in active use. It is maintained by three people. They don't allow outside contributions.
125
1,230
156
10,926
2,152,542
I've made a tool that lets you explore Text Embedding Vectors (an important step for AI tools which use Retrieval Augmented Generation) in a 3D space. You can choose between different dimension reductions, which helps you compare features.
1
7
376
Add your own words or compare predefined sets. I'm working on a way to visualise the famous king - man + woman = queen example. Any other ideas?
1
168
Commemorating the remarkable accomplishments of these AWS Heroes in driving innovation and sharing knowledge: ▶ Keith Yau ▶ Kazuki Miura ▶ Kaushik Mohanraj ▶ James Hall
1
1
2
451
James Hall retweeted
This strange tweet got >25k retweets. The author sounds confident, and he uses lots of hex and jargon. There are red flags though... like what's up with the DEI stuff, and who says "stack trace dump"? Let's take a closer look... 🧵1/n
241
2,987
495
15,110
3,277,615
I've started a techy Substack, because why not. mrrio.substack.com/
1
708
Wow,what a great review in @thetimes @CharlotteIvers 5/5 top score!”possibly the perfect pub,actually “ thank you @stephen422smith & team heading up the kitchen & the rest of the gang that make it such a fab place !! Come & try for yourself,book online we have rooms at the inn !!
9
10
64
4,248
"Operation Triangulation" securelist.com/operation-tri… A newly discovered spyware campaign targeting Apple iPhone using a zero-click remote code execution via an attack chain of 4 zero-days, including highly mysterious, completely undocumented MMIO registers and hardware features that are not even ever used by the firmware. TLDR the attack begins with an iMessage to an arbitrary phone that, without any user action and invisibly, gets it to collect and upload tons of private data (and much more, e.g. microphone recordings) from there on, and actively takes steps to hide all of this activity from the user and aspiring forensic researchers. Apple has patched the core vulnerability on Oct 25, 2023. "This is definitely the most sophisticated attack chain we have ever seen" The talk itself, a lot more wild information there: youtube.com/watch?v=7VWNUUld… The author of this attack is unknown, as is the method by which they gained knowledge of these unused, undocumented hardware features. Russia's intelligence service accused Apple of providing the NSA with a backdoor. For a more general audience intro to this underworld I usually recommend the book "Countdown to Zero Day".
Today, I will be giving a talk on Operation Triangulation with @oct0xor and @bzvr_ at #37c3 in Hamburg. Come see our talk if you are interested in learning more about this attack!
91
713
136
3,691
1,454,538
In preparation for the OpenAI GPT Store, we've renamed Jira Helper to Ticket Helper. * Other issue-tracking platforms are available. chat.openai.com/g/g-9oWbx2S7…
1
1
594
- Is it good? Yeah you still have to do the thinking. It's not going to magic up the right answers, but it does help you get unstuck.
1
2
352
- Is better than a form? Yep, it'll ask probing questions and make you think. Like rubber-duck programming on steroids.
1
333