Its miracle that models learn anything substantial from pretraining when you think about how much of the loss is actually dominated by non meaningful tokens
3
13
3,031
Still using GPT-4.5 for almost everything, even easy queries. Can’t put in words why it’s better but I like knowing that the most possible resources are being spent per token to get me the answer. I’ve lived the luxe life and can’t go back
1
14
1,972
I don’t know why but middle row economy gives me the highest quality uninterrupted chain of thought
2
7
858
My post-AI career interests:
- Raw travel youtuber
- Train in soccer and see if I can get to college level
- Learn to sing
- Doing science experiments on my own body (current one is how to improve nasal breathing flow, which I measure with an instrument)
Been chatting with a few friends in AI and you have no idea how often people admit to having the same intrusive thought of quitting to open a cafe / coffee shop when the ai wars are over 😂
1
11
2,036
Just scrolled through some of my tweets from 2023 and god they are so cringe, i can't believe i wrote some of that
3
13
1,630
Science is broken. I bought a tempur-pedic mattress, wear blue-light glasses, don't eat after 7pm, take melatonin and still can't get a good night's sleep. Meanwhile my girlfriend eats mcdonalds and drinks coffee right before bed and sleeps like a baby
2
9
1,565
A week ago I watched Messi play in the Argentina vs Equador Copa America quarterfinal in Houston. Paid good money ($700/ticket) for a decent seat, so wanted to write down some lessons learned
1
3
1,336
4. I felt that I didn't know enough about soccer to fully appreciate all the nuances I saw in person. E.g., my first time watching pro tennis in person was profound, because I was good enough at tennis to comprehend how hard the things they did were. Should study more next time
1
1
948