CTO @GroqInc. 2x co-founder (Apprenda & Nuvalence - acq. by @EY). Distributed systems. @RPI alum. Outdoors often.

New York, USA
Joined April 2007
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
And I'm betting that there's an inverse token consumption pyramid showing those 5,000 people consuming, by far the most tokens, and the 1 to 2 billion people consuming far fewer. And I'm not talking just on a per capita basis. Or if the consumption pyramid doesn't look that way right now, it will very soon.
2
117
Replying to @dhh
Precision software
31
Replying to @elonmusk
Always has been. Bits and bytes of today were ballistics of yesterday
2
503
“Nvidia’s performance advantage is so great that even if the competitor chip hardware was sold for free (but with providers still of course paying for datacenter hosting and power and other operating costs), cost per token would still be cheaper when using Nvidia.”
5
243
What an amazing journey Groq is on. From creating a blazing fast inference chip to building the world's premier, at scale inference cloud We're just getting started. Thanks for your partnership, @nvidia & @Dell
The next wave of AI is about deploying incredible innovation at massive scale. Excited to work with @GroqInc and @nvidia to make that happen with @Dell. 🚀 xitter.cf/GroqInc/status/2091908…
1
1
25
2,670
The "Price-per-task vs price-per-token" section Is an example of why obsessively focusing on token cost is idiotic. You have to measure models at a higher level of abstraction to really understand their performance as well as their clock speed. It's kind of like measuring a vehicle exclusively on an MPG basis: both a Ferrari and Escalade have the same MPG, but one moves more people per gallon of gas used. P databricks.com/blog/benchmar…
67
My dad grew up in Romania, under one of the world's most oppressive communist regimes. When I was a kid, he would always say "America is the best country on Earth". He wasn't wrong. Thanks for being America, America. Happy 250th
1
4
115
Replying to @sundeep
Upstate, NY 💪🏼💪🏼
5
135
For those of us with hyperactive inner monologues, we can totally understand how an LLM-based conversation protocol can control action and activity in the real world: reddit.com/r/Damnthatsintere…
180
Yeah, I'll take 7 once 8 is out :) I dumped my Orbi for TP Link Deco. Love it. Although with the recent TP Link news, I may be on the market again. I think we'll have to opt for tin can lines 🤣
1
1
110
Happy Thanksgiving, all. I'm thankful for the tremendous amount of Black Friday spam and how today serves as the ultimate 'unsubscribe' reminder.
220
Sigh...I know. It makes sense in my head, but not in written form
36
Warning, this is a mouthful: AI is the wholesale outsourcing of the crowdsourcing of anything crowdsourcable from a limited population with limited capacity for cognitive work (people) to an unlimited population with unlimited capacity for cognitive work (agents)
1
1
2
324
Sinclair Schuller retweeted
this is strangely heartwarming: the canadian pediatrics association now recommends that children engage in risky play—"thrilling and exciting forms of free play that involve uncertainty of outcome and a possibility of physical injury"—because of benefits e.g. to mental health
130
1,107
467
9,468
1,474,133
Sinclair Schuller retweeted
Phil Rosen
@philrosenn6 Oct 2023
Yes, your boss wants you to know how to use AI - but don't worry, you don't have to be an expert. That's according to @LinkedIn's chief economist and other labor market pros. New for @BusinessInsider from @mhofftweets and I: @sinclairx @nuvalence @hyams businessinsider.com/artifici…
2
2
556
I wrote a taxonomy blog post to help answer the question "what type of thing are we building?" when discussing generative AI solutions. The taxonomy aligns GenAI solutions with one of six categories. nuvalence.io/insights/a-6-ca…
1
147