Growing @Basetenco: best-in-class model hosting for AI startups. Formerly @Stripe. NYC + SF. Let's talk GPUs, sales, or Brazilian jiu-jitsu.
New York City
Joined February 2023
- Tweets505
- Following502
- Followers338
- Likes284
Julien from Baseten retweeted
🚀 We’re excited to introduce our Speculative Decoding integration for our TensorRT-LLM Engine Builder!
Our new integration allows engineers to:
• Leverage SpecDec as part of our Engine Builder flow
• Hit the ground running with pre-optimized configs
• Lift the hood and tune for any custom use case
👉 Check out the launch blog to learn more: baseten.co/blog/speculative-…
Huge shoutout to our model performance team for this feature, including @aqaderb, Justin Yi, Bryce Dubayah, and @defpan!
Julien from Baseten retweeted
Croissants + cloud infra really is the breakfast of champions 🥐 Had a great time hosting the AI/ML Engineering Leaders Breakfast Club this week with @baseten and @morganbarrettx in NYC.
Julien from Baseten retweeted
A video of Trump’s call with RFK Jr. was leaked - Trump talks about vaccines, tells RFK Jr. doing something with him would be “big,” mentioned his call with Biden and said the bullet was like “the world’s largest mosquito.”
RFK Jr apologized for the leak.
Julien from Baseten retweeted
After witnessing so many AI builders encounter the limitations of real-time inference, we’re excited to announce async inference on Baseten! 🔄 🎉
Check out our blog to learn more: buff.ly/4cGrDr1
And don't miss our live webinar on August 15th! buff.ly/3zEyLpn
Julien from Baseten retweeted
If you’re building your own AI product, highly recommend working with @baseten
Their customer support and expertise in AI infra is off the charts ❤️
Julien from Baseten retweeted
We’re excited to launch Meta’s Llama 3 in our model library, in both 8B and 70B 🎉
The newly introduced Llama 3 is a significant improvement over Llama 2, with increased tokens, and reduced false refusal rates. These models deliver unparalleled performance, showcasing significant advancements in efficiency and speed.
Our Llama 3 8B runs on A100s and Llama 3 70B runs on H100s, optimized for production.
Julien from Baseten retweeted
I have used a LOT of GPU providers. Hands down the most reliable one is @baseten
They never have gone out for us, the team is always around, and the Truss system just…. makes sense…
Julien from Baseten retweeted
Spent the last few weeks hacking on Misgif, an app that puts your face in your favorite GIFs 🤯
Have you ever wanted to be in an episode of Seinfeld or star in a Marvel movie?
Now you can!
Link in the next tweet 👇
Julien from Baseten retweeted
We had an awesome time at #NYTechWeek talking about bringing ML to market. Special thanks to @anandnk24, @rahulgs, @dan_p_simpson, @tuhinone, and Charles Elkan for an engaging conversation!
Huge thank you to the ML creators who attended @baseten's #TechWeek events! Learned a ton from our panel of leaders at @tryramp, @NormalComputing, @PatronusAI, and @GoldmanSachs. Our ML party was a huge hit, with devs from @Meta, @stripe, and @Google. Can't wait for more!
Julien from Baseten retweeted
If you're in LA on Aug 1 and you like AI, don't miss this:
lu.ma/ofobyt2h
Julien from Baseten retweeted
#SDXL Stable Diffusion XL 1.0 is here: the largest, most capable open-source image generation model of its kind.
You can deploy it in 2 clicks from our model library: app.baseten.co/explore/stabl…
Note the accuracy and detail in the face and hands of this kind old wizard:
Julien from Baseten retweeted
It's not too late to sign up for tonight's event, where you'll hear from a fantastic line-up of speakers, including our very own @sidpshanker!
This quoted post is unavailable.
Julien from Baseten retweeted
This framework from @baseten looks like a game changer if you want to build LLM powered apps that approach the quality of ChatGPT, but need to host your own model securely to process proprietary text data instead of sending to OpenAI: – at San Francisco, CA
Deploy Falcon-7B in a couple clicks from our model library, or deploy Falcon-40B using Truss, our open source model packaging framework.
@sidpshanker shows you how in his latest blog post: baseten.co/blog/deploy-falco…
Julien from Baseten retweeted
We're hosting a meetup at the Baseten office in downtown SF tomorrow. Join us for pizza, drinks, and community demos.
partiful.com/e/45KbvmhrjUCzK…
Julien from Baseten retweeted
Many highly requested ML infra features are packed in 1 screenshot. I'll unpack some:
Julien from Baseten retweeted
AI meetup @baseten is bumpin, awesome to see the interest in community here in ny!
