I make search go brrrrr. Founder of https://xitter.cf/t.co/NPdS6lZFDj, creator of Mighty Inference Server.
Flower City, NY
Joined March 2009
- Tweets2.5K
- Following453
- Followers761
- Likes3.1K
🚀 Announcing Mighty Inference Server!
☺️ Say goodbye to your NLP latency and cost pain.
⚡️ GPU speed on CPU, using our Rust webserver that works with many transformer models.
Your models. Your stack. Your rules. Try it now!
max.io
IT'S TERRIBLE. Look, I think ChatGPT is great and I'm a plus subscriber, but it's just an OK RAG on top of a web search engine (Bing API I think?). This isn't what a web search should be. The relevance is only bound to top 5, the UX is poor, and it's slow compared to web search.
I made a calculator a while ago that I use with clients and training. Here's a rough equivalent for hot (all vectors in RAM) using traditional compute, across various clouds/configs. The cost is on RAM and CPU, but I don't have numbers for QPS
Max Irwin retweeted
The year is 2027 and OpenAI just dropped AGI, but no one noticed because it was called
gpt-5.5-o3-large2-preview-2027-09-06
Max Irwin retweeted
Looking forward to seeing @CoPivotApp, @binarymax and Nikhil Shah from MARCIE app present tonight on AI and AI products! #startup #startupgrind #rochesterny #startupny startupgrind.com/events/deta…
I thoroughly enjoyed this riff. Hadn't seen this movie since 1991 as a teen - and got a bit nostalgic. The visuals and soundtrack are mesmerizing. Roger Ebert gave it 3.5/4 stars! But the riffs were so good. I'll be ordering cold pizza for breakfast via BuseyEats tomorrow.
Nice overview. I made a similar framework and spoke about it in early 2023. linkedin.com/posts/maxirwin_… ...while my first two levels are a bit different, I'd argue levels 4 and 5 are mostly unachievable, as they require complex social interactions.
I don't post on twitter anymore (well except for this) but I lurk every week or so. Apparently it wants my birthdate or I'll lose access. If I get kicked out then so be it. Catch me on linkedin, email, or slack. ✌️
Thanks for everything @evandawson it was a truly wonderful event. Looking forward to your show with Masum today. @RebeccaLeclair6 based on the praise and support we received, I think we'll have to do it again next year!
Thrilled to announce that @evandawson will be the emcee for next week's flowercity.ai conference. There's some amazing talent coming and sharing their work and passion. Going to be something amazing that Rochester's never seen before.
🎉 Flower City AI - the local Rochester NY community AI conference - is out of stealth! This is a not-for-profit community event on December 6th showcasing AI tech in Rochester. Tickets cover the cost of the event, and students attend free. flowercity.ai
Max Irwin retweeted
Big thanks to all the listeners and supporters! Many of you reached out to say thank you for the podcast and some of your became guests. Stay tuned for the new episodes :)
Max Irwin retweeted
FYI, we've just renamed the default branch from 𝘮𝘢𝘴𝘵𝘦𝘳 to 𝘮𝘢𝘪𝘯 for github.com/treygrainger/ai-p…. You can run the following to quickly update a previously pulled repo:
git branch -m master main
git fetch origin
git branch -u origin/main main
git remote set-head origin -a
