Sports & Emerging Tech .. Building at Snorkel AI đ€ż and always findable on a footy pitch or an ice rink somewhere.
Planet Earth
Joined February 2026
- Tweets78
- Following303
- Followers37
- Likes235
Yessss check these out!
Frontier Data Summit talks are live: youtube.com/playlist?list=PLâŠ
Ten sessions from researchers and builders on how we evaluate frontier AI, from agent evaluation and reward hacking to open benchmarks and real-world expert judgment.
Thank you to our speakers: @fchollet, @dawnsongtweets, @alexgshaw, @sanmikoyejo, @sudip_r0y, @ysu_nlp, @nikogrupen, @HuaxiuYaoML, @bradenjhancock, @dlwh, @StevenDillmann, @RussellYang16, @GOrlanski, @ajratner, @vincentsunnchen, @fredsala, and more!
Seriously debated trying to pull off the baby nap in carrier with noise headphones for this matinee matchup.
Letâs go Caps!!! #ALLCAPS
SCREAGLE GAMEDAY!
The Caps and the Devils get set to duel today at 1 PM on @MonSportsNet
#CapsDevils preview: washcaps.com/vsNJD-Oct17
My older brother taught me the game, but as a winger taught by a GK, purring that biscuit behind his basket was the glory. EVERY TIME!
Brothers Lane and Cole Hutson will face off as NHL opponents for the very first time tonight!
đș: @CanadiensMTL vs. @Capitals TONIGHT at 7:30 PM ET on @SportsOnPrimeCA
Read more about what is anticipated to be an intense sibling showdown âĄïž nhl.com/news/hutson-brothersâŠ
ALT Photos of Lane Hutson in a Canadiens jersey and Cole Hutson in a Capitals jersey with the NHL.com logo in the top right. White text reads, âIâm pretty positive that whoever doesnât win is not going to be happy. And when I say not happy, theyâre going to really not be happy.â Attribution: âRob Hutson on his sons facing off.â
Was so excited to get a chance to attend the @SnorkelAI #FrontierDataSummit.
As somebody who focuses on the Public Sector mission space, learning from Academia, Industry and Feds who made the trip to SF so rewarding
Shoutout to my Snorkel Fed Team Colleagues that made it!
WHOA. I expected @SnorkelAIâs #FrontierDataSummit to be packed given itâs sold out, but who knew the @BlueAngels would be in attendance? What a view of them practicing for SF Fleet Week!
Designing long-horizon agent evals is such an important community and ecosystem led discussion. Humbled to be hearing from such distinguished members representing key Academic Institutions and leading vertical AI startups, such as @harvey, @adaption_ai, @OhioState, @UNCchapelkill moderated by @vincentsunnchen!
#frontierdatasummit
Benchmarking AI in Cybersecurity is such an important and critically timed topic with all the buzz around some of the Cyber models coming out of the Frontier Labs such as @OpenAI and @AnthropicAI, @GeminiApp and others..
@dawnsongtweets (UC Berkeley and AgentsLastExam )and @ajratner gracing the main stage!
#frontierdatasummit
Loving hearing @sanmikoyejo and @alexgshaw chatting about reimagining a science of AI measurement & evaluation moderated by @SnorkelAIâs Francesca Vera!
Catch some of the key sessions from #frontierdatasummit on @YouTube
We're streaming live from the Frontier Data Summit soon. Catch select sessions:
Morning (~10 AM PT)
- @ajratner: The research era of AI data
- @fchollet & @fredsala: Measuring and advancing true general intelligence toward AGI
Afternoon (~3 PM PT)
-@StevenDillmann, @RussellYang16, @GOrlanski, and
@vincentsunnchen: Behind the benchmarks: Terminal-Bench-Science, JudgmentBench, and SlopCodeBench
xitter.cf/i/broadcasts/1jxXgBoAoâŠ
Next up from @SnorkelAIâs Frontier Data Summit, fireside đ„ chat with @fchollet and @fredsala on âMeasuring and advancing true general intelligence toward AGIâ
#frontierdatasummit
Live from San Francisco, @ajratner kicking off @SnorkelAIâs Inaugural Frontier Data Summit! đđ€żđ
đŻđŻ
If youâre a researcher or building open-source benchmarks & evals, itâs a great opportunity to get funding & research support with @SnorkelAI $30M Open Benchmark Grant. Apply below
Today, weâre expanding @SnorkelAIâs Open Benchmarks Grants by 10x to a $30M commitment:
- Funding a more diverse, robust, and continuously-updated ecosystem of open benchmarks
- Launching the Open Benchmarks Red Team to continually test and strengthen them
- Introducing the Snorkel Research Fellowship to support independent contributors developing new evaluation methods
Since our launch earlier this year, weâve been humbled to partner with the teams behind Terminal-Bench, TB-Science, ARC-AGI-3, OSWorld 2.0, Agentsâ Last Exam, Continual Learning Bench, Senior SWE-Bench, SlopCodeBench, and more. Alongside these teams, weâve helped design evaluation methodologies, develop task construction pipelines, and scale quality control. OBG-funded benchmarks have appeared on the latest model cards from every major frontier lab; have helped to index and measure frontier progress and alignment; and have contributed to guiding the frontier of AI development.
Benchmarks have always been guideposts forâand drivers ofâ AI progress: setting a metric and then âhillclimbingâ against it is the core of how AI works! But when benchmarks fall behind frontier capabilities, our ability to evaluate and align these systems does as well. They become too simple, static, or correlated, and the risk of âbenchmaxxingâ increases.
We need more diverse, robust, and continuously-updated benchmarks, developed by a broader ecosystem of researchers and domain leaders.
Weâre incredibly excited to accelerate frontier evaluation with Open Benchmarks Grantsâ raising the ambition and investment in robust, open, and independent measurement. Read our full announcement and apply here: benchmarks.snorkel.ai/frontiâŠ
đ„đ„đ„
Today on NYSE Live:
@ajratner, @SnorkelAI
@StevenBartlett, The Diary of a CEO
@TheJudgeCNBC, @CNBC @HalftimeReport
Tune in 9am ET. xitter.cf/i/broadcasts/1oKMvNaojâŠ
I would tune in - @vincentsunnchenâs got some amazing news to share with all those building out in the open!
You wonât wanna miss this! @SnorkelAI
@MTSlive
on @MTSlive this afternoon w/ @knowerofmarkets sharing some news on open benchmarks - tune in!!
Iâm not crying youâre crying đ„
Letâs go @Capitals baby! Our year!
Green Lights
Redskin greats honored at halftime and a @Commanders victory at home knocking off the reigning SB champs. đ€ Mariota. Hail.
Proud to support the development of PhilosophyBench through Open Benchmarks Grants with @michaelzheng, @StanfordAILab and @StanfordHCI.
Help shape the benchmark: philosophybench.org
