chunli retweeted
On this slow news day, we just launched Stripe evals to measure how well coding agents build real Stripe integrations.
A few cool (to me) learnings:
• Our plugin helped every harness/model pair we tested. All 14 configurations scored ~3–8 percentage points higher with Stripe’s recommended skills and tools.
• Agents searched less and wrote fewer tests with the plugin. Web searches dropped 96% and (often extraneous) test code dropped ~40%, while scores improved.
• We used another agent to role-play the developer. The role-player starts by sharing its imperfectly-stated goals, asks follow-up questions, and works through a few rounds of conversation with its coding agent.
• The last mile is hard. Agents satisfied ~78% of criteria on average, but only ~29% of runs met every required criterion.
Results and methodology: stripe.dev/evals
Based on @leviidev01 's great work, my coding agent added Linux and Windows support to Henge! Now my iPad Pro can do more than just a YouTube player. code is here github.com/chunlea/Henge/tre…
6
244
chunli retweeted
you already knew this, but repeating @stripe is hiring engineers/product people who wanna solve Hard Problems™️ in agentic commerce, e.g.:
- wallets
- payments
- identity
- risk
- discovery
- tokens
- tools
- provisioning
- catalogs
- micropayments
- etc.
jweinstein@stripe.com
wait, it's running Linux and it has color video passthrough accessories.
Steam Frame is here! Our wireless VR headset + controllers, available now in the following models:
Steam Frame 256GB
Steam Frame 1TB
Sign up now and learn more on @Steam store.steampowered.com/hardw…
131
chunli retweeted
looking to hire a few intensely self-motivated product-minded engineers to build tools for agents to discover, provision, manage, and pay for software tools. our team is fast and fun!
plz send a few words about yourself and what you’ve worked on recently to jweinstein@stripe.com
hammerspoon.org/ is underrated; it brings my favorite Alt+ESC for new window and double Ctrl > Ctrl + B for herdr to Ghostty
105
🚀
New providers now available on Stripe Projects:
@Wix
@laravelphp
@HeyGen
@prisma
@automattic
@p0
@ExaAILabs
@Base44
@ClickHouseDB
@supermemory
@usekernel
@blaxelai
@getmetronome
@AgentPhoneHQ
@e2b
@postalform
59
















