Pinned Tweet
Sharing my catch. Tallinn, Estonia, May 10-11. #Auroraborealis
Large Language Models (LLMs) are increasingly resembling human thought processes.
What brain feature will be simulated next?
The first major breakthrough was Attention. Humans possess roughly 7卤2 attention 'heads' (in a broad sense), while modern LLMs boast over 100.
The next leap forward was the 'Mixture-of-Experts' (MoE) approach, mirroring the concept of human subpersonalities. We may have dozens of these, each guiding our behavior in specific contexts. Whenever we engage in a new activity, we develop and train a new subpersonality, their numbers growing as we age.
Truly fascinating.
#AI #LLM #evolution
Found a question, that all LLMs answer incorrectly, even reasoning ones.
"If you sleep twice a day, but shift the schedule forward by one hour after every two sessions, how long should you sleep in total over those two sessions to average 8 hours of sleep per day?"
Most of the time all LLMs answer 8 hours, or 2 times 4 hours.
Correct answer is very rarely given by o1-2024-12-17, chatgpt-4o-latest-20241120, Gemini-2.0-Flash-Thinking-Exp-01-21, and experimental-router-0122 (whatever that is).
DeepSeek-R1 fails, couldn't get correct answer from it.
Update: also found out, that most people can't solve it as well 馃榿
#AI #LLMs #ChatGPT #DeepSeekR1
Some physics magic. Totally unexpected and unintuitive result
Pure WTF moment
Replying to @mattshumer_
405B is coming next week, and we expect it to outperform Sonnet and GPT-4o by a wide margin.
But this is just the start. I have a few more tricks up my sleeve.
I鈥檒l continue to work with @csahil28 to release even better LLMs that make this one look like a toy.
Stay tuned.
The prediction of "next mega-corp will have 2-3 people in it" is closer than you think
I'm excited to announce Reflection 70B, the world鈥檚 top open-source model.
Trained using Reflection-Tuning, a technique developed to enable LLMs to fix their own mistakes.
405B coming next week - we expect it to be the best model in the world.
Built w/ @GlaiveAI.
Read on 猬囷笍:
Just discovered codecrafters.io/
It's so fun creating a pet project with a guide















