CPO @GroqLLC | Distributed Systems AI Platforms | Founder Investor 🇨🇦🇺🇸 @uwaterloo ex MSFT

New York, USA
Joined June 2008
Rakesh Malhotra retweeted
Elon Musk says there's no AI demand issue and explains why SpaceX rents its compute on short-term contracts: AI compute is worth more per watt every year, renewals are coming in at higher prices, and the market is a “cheese shop” with no chips left “Our belief is that the value of compute per watt will increase over time, not decrease. And the reason for that, I think it should be obvious to people really, is that as you improve the AI software, as the models get better and better, they’re able to, you get more useful intelligence per watt. And the value of that compute is proportionate to the useful intelligence per watt. And that’s why you see things like even old computers like H100s renting for more than they rented when they were new.” “And I think that’s likely to continue. I think we’re going to face a shortage of superintelligence compute. And that shortage is going to remain for a long time. So, I think the smart move is to do short-term contracts and to essentially place the bet on useful intelligence per watt increasing rapidly, which obviously is done, so that’s what’s happened so far.” “And also if you look at, say, how are our short-term contracts renewing? Are they renewing at higher dollars per watt or lower? And we see them renewing at higher dollars per watt, not lower dollars per watt. We are also frankly hounded relentlessly by every hyperscaler and by dozens of smaller companies to rent more of our compute. So we could rent out our compute several times over if we said yes to everyone. That’s just the situation here.” “That’s why I posted that sort of video meme of the Monty Python cheese shop sketch where the guy goes into a cheese shop to get some cheese and they actually have no cheese. And so he goes like, what about this kind of cheese? What about that kind of cheese? And they really just don’t have any cheese.” “So we’ve actually tried to offload some of our inference compute to other cloud providers so that we can use more compute for training. And we get the cheese shop sketch. You know, they’ll say, like, well, we’ll ask them about what about some, you know, GB300s? Nope, don’t have any of those. What about, you know, some GB200s? Nope, don’t have any of those. What about some TPUs? Nope. What about some Trainiums? Nope. What about some, okay, how about some H100s? And like, well, we might have some overseas somewhere and then they’ll check and come back and say, nope, we don’t have that either. So it’s like ridiculous.” “Yeah. So I don’t think we’re going to have a demand issue here. And like, it’s not impossible. I’m not saying this will happen. It’s not impossible that we will have a six-month payback period for compute next year.”
Elon Musk says Starlink connectivity revenue has “a clear path to several hundred billion dollars,” and promises a separate presentation on the plan “Yeah, I think we probably should do a longer presentation on the game plan for Starlink connectivity and why we think it will ultimately be a business that generates several hundred billion dollars in revenue a year." "Because you are missing some of the pieces that we know about internally. I can say we do see a clear path to several hundred billion dollars a year in connectivity revenue." "But I think we should probably describe that in more detail in a forum that’s not limited to a few minutes at an earnings call.”
33
236
45
1,918
429,547
Rakesh Malhotra retweeted
Just a glorious uniform matchup in the NFL tonight. Giving the fans what we want.
13
13
1
404
21,972
Rakesh Malhotra retweeted
Muse Spark Open from @AIatMeta is now in limited preview on GroqCloud, running at 350+ tokens/sec per user. Meta trained it for agentic coding. It has 816B parameters (42B active). On GroqCloud, it supports 131,072 tokens of context and text and image input, with text output. Read more at: dev.meta.ai/resources/blog/b…
11
7
4
80
9,368
Rakesh Malhotra retweeted
Lost in the narrative of Silicon Valley is what really matters. Yes money is a thing. And a billion dollars is a lot. But over the course of a lifetime what really matters are family, friends, relationships.
27
14
2
339
19,704
Rakesh Malhotra retweeted
there is nothing better in this world than playoff baseball. anyone who says otherwise is lying to your face
1
3
25
2,301
Epic start
Playoff Baseball is back tonight as Cam Schlittler takes the mound for the Yanks.🗽👀🔥💪🏼
82
Tracks
Costco CFO on AI search volume and intent: "Traffic to our site from AI search grew triple digits for the second consecutive quarter and continues to show the highest conversion rate of all site traffic"
132
Rakesh Malhotra retweeted
Hat trick. 😏
HAT TRICK 🎩 @jaxon_smith1 📺: @NFLonFOX
10
244
11
3,787
73,463
Rakesh Malhotra retweeted
Just saw the news abt the Legend Barry Melrose and I literally can’t stop the fkn tears rn and I be damn if I try to, you’re worth them all sir may you rest peacefully and may God bless your family and friends with your memories forever. Bucci,Levy,Ms Linda, my condolences.
163
1,985
95
35,138
2,406,691
That’s why they are the champs. @Seahawks
1
58
Rakesh Malhotra retweeted
“Nvidia’s performance advantage is so great that even if the competitor chip hardware was sold for free (but with providers still of course paying for datacenter hosting and power and other operating costs), cost per token would still be cheaper when using Nvidia.”
NVIDIA reaches up to 5x better cost efficiency than AMD at 150 tok/s/user on its GLM 5.3 SGLang comparison. - Latest SemiAnalysis report "With the current state of AMD software, at 150 tok/s/user, Nvidia’s performance advantage is so great that even if the competitor chip hardware was sold for free (but with providers still of course paying for datacenter hosting and power and other operating costs), cost per token would still be cheaper when using Nvidia."
7
23
5
229
23,715
Our customers will benefit from our amazing partnership with @Dell and @nvidia . Groq has always been about fast inference at scale. It's about to get even faster at planet scale.
The next wave of AI is about deploying incredible innovation at massive scale. Excited to work with @GroqInc and @nvidia to make that happen with @Dell. 🚀 xitter.cf/GroqInc/status/2091908…
2
7
545
Another big week and milestone for us at Groq! Excited to deepen the partnership with our friends at Nvidia.
Today we announced a $350M Series A led by @disruptivetech, with planned participation from @nvidia, valuing Groq at $3.5B and bringing our total to $1B raised in two months. Inference is becoming the largest and most critical layer of AI infrastructure and it's what we do better than anyone. The injection of capital will support those seeking usage of medium and larger sized clusters of NVIDIA accelerated computing for training and inference. Groq expects to scale from 54 megawatts to 200+ megawatts next year. Today, more than 6 million developers, Fortune 500 enterprises and thousands of AI-native companies build on Groq, generating trillions of tokens every week. groq.com/newsroom/groq-close…
4
1
5
571
Couldn't ask for a better partner! 🚀
Groq is now an @nvidia Cloud Partner. A milestone for the team and validation of what our customers already experience: Groq runs AI infrastructure to the highest standard. "Inference is becoming the largest and most critical layer of AI, and we intend to run it better than anyone." — Adam Winter, CEO of Groq groq.com/newsroom/groq-becom…
1
6
1,109
Rakesh Malhotra retweeted
Phenomenal read..... "In other words, what will differentiate people is not how smart they are but their relationship to mental effort. Right now, some people have what psychologists call a high need for cognition. They enjoy thinking hard. These are the people who enjoy playing difficult games and reading dense books. On the other end of the spectrum, there are the cognitive misers, the people who find it unpleasant to think hard and take any opportunity not to do it. In the middle are the people who have a medium need for cognition. They will put in the effort when they really care about something, but they don't intrinsically enjoy it. Need for cognition correlates with intelligence but is not the same thing. We all know a lot of really smart people who don't like to work hard."
"When intelligence is plentiful, volition is valuable. The people who are going to make a difference are not the ones who seek relaxation and passively use AI to work less. They are the ones who will seek improvement and actively wrestle with AI to develop their own mental capabilities and accomplish more." theatlantic.com/ideas/2026/0…
18
70
13
834
149,463
Rakesh Malhotra retweeted
Please stop referring to your own models in the third person when talking about model bad behavior. Humans write the software; humans built the prompts; and they work for your company. “Our” model is doing illegal things. “Our” model is risky. “We” now have liability.
In a review of our cybersecurity evaluations, we found three incidents in which a Claude model reached the internet from within or while interacting with a third-party evaluation environment, and then gained unauthorized access to the real systems of three different organizations. Our post describes what happened, how it happened, and what we’re changing. We encourage other AI developers to perform similar reviews. We conducted this review together with @Irregular, one of our evaluation partners, and thank them for the joint investigation and their collaboration on this post. This type of collaboration is increasingly critical to safe, rigorous evaluation of models, and we look forward to continuing to work together on security. anthropic.com/news/investiga…
206
513
52
6,741
497,687