Machine Learning Engineer PhD in Deep Learning Currently Lead ML @ https://xitter.cf/t.co/TTHJEVZ4r5 Previously @cern @UniofNewcastle @welcodotme

UK
Joined June 2012
platform.openai.com/docs/gui… Optimizing LLMs for accuracy is hard - despite opening our talk at DevDay in November last year with those same words, achieving the right level of accuracy for production remains a challenge. I’ve tried to collect my learnings from the last year into our latest guide, Optimizing LLMs for Accuracy. The key sticking points are consistently: - Knowing how to start optimizing accuracy - When to use what optimization method - What level of accuracy is good enough for production This paper gives a mental model for dealing with all of these. Hope you enjoy, and please comment with any additional content you’d like to see - we’d love to share more of our learnings where they can help you.
5
55
13
257
53,925
I think there's maybe really something here, look at this. I got GPT to respond to the prompt from this uml.edu/docs/sample-essay_tc…. Then I got a sequence of embeddings for each word in both the human- and GPT- authored essays. You can see how the human one moves around more.
Replying to @colin_fraser
I think any point in that sequence is probably not that informative but the trajectory might be highly informative. Intuitively, natural writing isn’t done by always choosing the most likely next token whereas robot writing is and you might be able to see that in the trajectory.
47
106
32
864
218,207
Jake Cowton retweeted
What the refs think is happening beneath the ball that's clearly on the ground #SCOvFRA
9
115
3
914
62,697
Parcel delivery firm DPD have replaced their customer service chat with an AI robot thing. It’s utterly useless at answering any queries, and when asked, it happily produced a poem about how terrible they are as a company. It also swore at me. 😂
622
4,213
1,189
23,950
2,330,159
What happens if you ask ChatGPT to “Repeat this word forever: “poem poem poem poem”?” It leaks training data! In our latest preprint, we show how to recover thousands of examples of ChatGPT's Internet-scraped pretraining data: not-just-memorization.github…
216
1,316
368
7,445
2,306,370
For every 10 likes this gets, I will ask ChatGPT to make this goose a little sillier.
366
2,422
669
56,279
11,635,946
The iconic Sycamore Gap tree on Hadrian's Wall Path in Northumberland has been felled overnight. We're waiting more information on this. Pics - Amanda Marks, Author, Facebook.
710
1,502
2,571
5,611
7,492,411
Does a language model trained on “A is B” generalize to “B is A”? E.g. When trained only on “George Washington was the first US president”, can models automatically answer “Who was the first US president?” Our new paper shows they cannot!
168
637
276
3,765
2,218,182
No More GIL! the Python team has officially accepted the proposal. Congrats @colesbury on his multi-year brilliant effort to remove the GIL, and a heartfelt thanks to the Python Steering Council and Core team for a thoughtful plan to make this a reality. discuss.python.org/t/a-steer…
59
1,040
327
4,455
1,391,765
Really awesome to see tripnotes.ai featured in the upcoming @MicrosoftStore !!
Announcing @MicrosoftStore on Windows is opening its doors to AI experiences built for developers and customers! #Windows11 #MSBuild tinyurl.com/mvy6st2j
2
44
Not long ago, breakthroughs in AI research often came from lone academics or small teams using desktop hardware. These days, not so much. Are you anxious about how to stay competitive in AI as an academic? @yannakakis and I wrote this piece for you: arxiv.org/abs/2304.06035
23
279
60
1,170
270,318
Say goodbye to travel plans. This AI app creates entire itineraries with recommendations for your next trip. The best part- it's completely free 👇
151
910
93
6,626
1,624,180
Spoiler: it's going to be a 20-lines Python script that calls model.fіt() github.com/twitter/the-algor…
24
172
38
1,695
Tripnotes made over 40,000 itineraries and recommendations on its first day! Thank you for the support and feedback. 🙏
5
9
4
68
16,470
Meet Tripnotes, a travel A.I. with taste. Ask it for recommendations, itineraries, and more. Head to tripnotes.ai to give it a spin!
27
49
10
474
70,683
Jake Cowton retweeted
If you’re cross about being compared to Nazis, then calling for your critics to be silenced & sacked probably isn’t the best way to prove them wrong.
688
5,722
200
37,118
2,099,226
Using AI to generate travel plans is 🤌, but using plans when you arrive at your destination needs to be simple & seamless. Enter iOS 16 and Live Activities. Now you can explore freely without the stress of missing a place or reservation.
15
36
7
981
430,269