Author. Data scientist. Machine learner. Ex-physicist. 📚 Zefs Guide to Deep Learning @zefsguides, https://xitter.cf/t.co/DpfHkTGRIa 📗 Hiring DSs and MLEs book, https://xitter.cf/t.co/rCTmNulf1d

Houston, USA
Joined March 2013
RT to help Simon raise awareness of prompt injection attacks in LLMs. Feels a bit like the wild west of early computing, with computer viruses (now = malicious prompts hiding in web data/tools), and not well developed defenses (antivirus, or a lot more developed kernel/user space security paradigm where e.g. an agent is given very specific action types instead of the ability to run arbitrary bash scripts). Conflicted because I want to be an early adopter of LLM agents in my personal computing but the wild west of possibility is holding me back.
If you use "AI agents" (LLMs that call tools) you need to be aware of the Lethal Trifecta Any time you combine access to private data with exposure to untrusted content and the ability to externally communicate an attacker can trick the system into stealing your data!
102
505
46
2,969
436,171
Roy K retweeted
Grant Sanderson@3blue1brown1 Apr 2024
I just posted the first of what will be several chapters about transformers, which in the last year has been the most requested topic for the channel. youtu.be/wjZofJX0v4M
21
169
65
808
63,455
Roy K retweeted
I wrote a very long post on what a machine learning artifact is, how files work, safetensors, pickle, and a lot more, as a way to understand GGUF. Thanks especially to everyone in this thread who added historical context around safetensors. vickiboykis.com/2024/02/28/g…
Continuing digging deep on GGUF. Anyone have information/oral history of how we went from pickle in pytorch to safetensors, with explicit details around what actually is in a .pt file/state dictionary? Yep, I've looked at all the code/docs, I'm now looking for commentary
10
62
6
302
59,732
Roy K retweeted
Evaluating LLMs is HARD, so I'm excited to share a bit of what we've been working on at @MozillaAI from the NeurIPS 1 LLM + 1GPU + 1Day challenge last fall. The write-up includes background on eval + repo with sample K8s infra. More soon! blog.mozilla.ai/exploring-ll…
9
33
235
18,651
🚀 I've just launched the landing page for the Python Developer Tooling Handbook! A free ebook where I will dive deep into the tools that make Python development a breeze (from packaging to linting, type checking to formatting). Check it out 👉 pydevtools.com/
3
31
2
143
25,261
Hiring Data Scientists and Machine Learning Engineers by Roy Keyes is on sale on Leanpub! Its suggested price is $34.99; get it for $10.00 with this coupon: leanpub.com/sh/YsllZwVP @roycoding #Ai #BusinessAndManagement #DataScience #EngineeringManagement #MachineLearning
1
4
332
Zefs Guide to Deep Learning Flashcards (Flashcards (PDF, Anki, PNG formats)) by Roy Keyes is on sale on Leanpub! Its suggested price is $25.00; get it for $10.00 with this coupon: leanpub.com/sh/HUDnTw8B @roycoding #Ai #MachineLearning #DigitalTransformation
1
1
316
New YouTube video: 1hr general-audience introduction to Large Language Models youtube.com/watch?v=zjkBMFhN… Based on a 30min talk I gave recently; It tries to be non-technical intro, covers mental models for LLM inference, training, finetuning, the emerging LLM OS and LLM Security.
536
2,720
609
16,465
5,128,132
David Attenborough is now narrating my life Here's a GPT-4-vision + @elevenlabs python script so you can star in your own Planet Earth:
681
4,367
1,282
25,572
3,997,253
Happy 1700000000 for those who celebrate
2
12
52
5,955
True, personally, I think the best and shortest definition is that "Embeddings are learned transformations to make data more useful" from Roy Keyes. But a few examples like in Simon's blog post help illustrate the useful part. roycoding.com/blog/2022/embe…
If you're puzzled at why there's so much activity around "vector databases" at the moment, understanding embeddings should answer that question too
1
4
46
5,354
Hiring Data Scientists and Machine Learning Engineers by Roy Keyes is on sale on Leanpub! Its suggested price is $34.99; get it for $10.00 with this coupon: leanpub.com/sh/aPYd0bju @roycoding #Ai #BusinessAndManagement #DataScience #EngineeringManagement #MachineLearning
1
2
427
Hiring Data Scientists and Machine Learning Engineers by Roy Keyes is on sale on Leanpub! Its suggested price is $34.99; get it for $10.00 with this coupon: leanpub.com/sh/m5i7DEGN @roycoding #Ai #BusinessAndManagement #DataScience #EngineeringManagement #MachineLearning
1
1
300
I'm writing an updated version of The Illustrated Transformer for the upcoming Hands-On LLMs book I'm co-writing with @MaartenGr. What updates/developments in the past 5 years do you feel should be a definitive addition to an intro to the architecture? Lots of additions to models have been proposed/tried, but which have stood the test of time?
19
32
255
62,483
Zefs Guide to Deep Learning Flashcards (Flashcards (PDF, Anki, PNG formats)) by Roy Keyes is on sale on Leanpub! Its suggested price is $25.00; get it for $10.00 with this coupon: leanpub.com/sh/oqnVFrVQ @roycoding #Ai #MachineLearning #DigitalTransformation
2
1
2
566
Roy K retweeted
ok this is absolutely *wild* using AI to live translate and sync your lips
986
5,103
1,875
32,120
8,074,864
Anti-hype LLM Reading List This is actually a really good list of papers and reading materials on LLMs. Love the curation by @vboykis. gist.github.com/veekaybee/be…
10
365
9
1,493
168,910
This talk is the most complete version of my thinking around Large Language Models to date, including thoughts on personal AI ethics, practical applications and the enormous impact we are already feeling from Llama 2 Video, slides, transcript & links: simonwillison.net/2023/Aug/2…
10
111
15
651
118,204