HOLY CRAP. Bloomberg has the goods on Gemini 4!
"it does less well when employees actually put it to work .. The model struggles to handle certain coding tasks"
Bloomberg: "As Alphabet Inc.βs Google prepares for the coming launch of Gemini 4, itβs grappling with internal skepticism over how well the flagship artificial intelligence model performs in key areas, such as coding.
While Gemini 4 has performed well on benchmarks the industry uses to gauge model efficacy, it does less well when employees actually put it to work, according to people with direct access to the effort. The model struggles to handle certain coding tasks, said the people, who requested anonymity to discuss an internal matter."
Between opus 5.5 and sol 6.1 you can actually get meaningful work done on both $20/mo plans now
There it is
xitter.cf/claudeai/status/210463β¦
Donβt see that too often
Replying to @ArtificialAnlys
Both models regress in GDPval-AA v2.1 at max effort, driven by shorter deliverables that more often omit required elements.
Only right to have @Muse turn this into a ebook for me
Mark, by @colossusjeremy.
This is a story about the head of history's largest nonterritorial empire, who nonetheless remains a prisoner of his rivals. Has he finally found a way out?
The profile has been nearly a year in the making. Stern interviewed three dozen people, including Zuckerberg, his MMA coach, and his critics and competitors at the frontier AI labs. He spoke with his parents, Karen and Ed, and watched their son get punched in the face.
The story spans Meta HQ in Menlo Park, the Zuckerbergs' homes in Palo Alto and Lake Tahoe, and a party in a Manhattan warehouse with Kylie Jenner and TimothΓ©e Chalamet. There is also a sneak peek of Aaron Sorkin's forthcoming sequel about Zuckerberg, sourced via a Hollywood fixer Stern first encountered in Russia.
The result is a profile unlike one you've read before.
colossus.com/article/mark-zuβ¦











