
everything GPU @mixedbreadai | Research, ColBERT, DSPy @Stanford
Stanford
Joined December 2013
- Tweets1.9K
- Following546
- Followers2.5K
- Likes8.7K
Pinned Tweet
DSRs, @DSPyOSS for Rust is here馃殌
Happy to finally announce the stable release of DSRs. Over the past few months, I鈥檝e been building DSRs with incredible support and contributions from folks Maguire Papay, @tech_optimist, and @joshmo_dev.
A big shout out to @lateinteraction and @ChenMoneyQ who were the first people to hear my frequent rants on this!! Couldn't have done this without all of them.
DSRs originally started as a passion project to explore true compilation and as it progressed I saw it becoming more. I can鈥檛 wait to see what the community builds with it.
DSRs is a 3 phase project:
1. API Stabilization. We are nearly done with this and it was mostly implementing the API design. We kept the DSPy style in mind and tried to keep it close to it so it's easier to onboard and while at it we tried to improve it and make it a bit more idiomatic and intuitive!
2. Performance Optimisation with benchmarking vs DSPy. We want to benchmark LLMs performance vs DSPy, with API design finalized we want to improve performance in every front. We'll improve the latency and improve the templates and optimizers in DSRs.
3. True Module Compilation. Why should you optimize signature when you can optimize and fuse much more? This is the idea of the final phase of DSRs. A true LLM workflow compiler. More on this after Phase 2.
Really grateful for @PrimeIntellect offering compute to drive Phase 2 and 3 experimentation for this! Big shoutout to them and @johannes_hage for this!!!
But what is DSRs? What does it offer? Let's see.
Herumb Shandilya 馃 retweeted
And if you think that鈥檚 even close to a ceiling, stay tuned
Make friends that bring you gifts like this. Thanks @halcyonrayes!
Great book @philipkiely 馃挴
Herumb Shandilya 馃 retweeted
I'm joining Mixedbread to build better information retrieval for AI agents
This @gepa_ai interface is soooo gooooodddd, Fable really cooks UI from vague ideas
Using GEPA to optimize @mixedbreadai's toast-1 harness!
Wrote up the recipe. Coming in a few days.
Finally a @DSPyOSS meetup that doesn鈥檛 clash with exams :)
Repos are huge these days. Not every question should mean digging through a thousand lines of code yourself or burning $20 on an agent to do it for you.
Introducing Repofetch
Talk to any GitHub repo, built on @mixedbreadai's toast-1 model.
Every answer points back to the code.
Click a citation and it opens the file directly at those lines.
Chats stay in your browser.
Mixedbread handles retrieval, toast-1 answers by default, and you can switch answers to OpenRouter if you want.
Try it on your own repo: repofetch.vercel.app/















