Co-Founder & CEO, Brackett AI. Stop renting automation, own the intelligence that drives your business operations.

San Francisco, Paris, Seattle
Joined April 2009
This is a great time to build in the application stack! Also what’s amazing is that most of the large labs are now finally introducing concepts of “teach”. “Instruct” was the old paradigm. “Teach” will be the new one and when it works in real time that would be amazing! #whyweexist #llms #teachmachines #snt
3 frontier models in one day! - Grok 4.6: Fable 5-level, but 85% cheaper. - Qwen3.8-Max: 2.4T params, 95B active. Weights are out. - DeepSeek-V4-Pro-0813: weights could drop any time. Heard it’s good, not just benchmaxxing. Competition is great for consumers and businesses.
2
1
5
260
Impressive and a step in the right direction for more innovation on top. #distillation
Releasing the model weights and technical report of Kimi K3. Kimi K3 is our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window. New model architecture: 2.5x the intelligence per unit of compute, not just more params. Alongside Kimi K3, we're opening up more of the stack behind it — high-performance attention kernels, MoE communication library, and infrastructure for running agent environments at scale. Model weights: huggingface.co/moonshotai/Ki… Tech report: github.com/MoonshotAI/Kimi-K… Tech blog: kimi.com/blog/kimi-k3
2
42
The only robbing that’s been happening post the #argentina #egypt match is the not acknowledging the grit of #argentina as a team and the genius of the GOAT #messi. Egypt played a great game but could not capitalize on their lead and Messi showed the world why he is the GOAT.
2
42
Jaideep Sarkar retweeted
We dramatically underestimate how much change management it is going to take to automate most knowledge worker tasks. Between data being in legacy environments or systems or without good APIs, context missing for doing the task, teams that are less technical, and other factors, there’s still a lot of work to drive real AI transformation in an enterprise. This is actually great news if you’re building right now because the opportunity is to build the software bridges to make this easier, or to build new services firms to help with this change management. Opportunity is all around for those looking.
Silicon Valley thinks AI agents are a $20/mo self-serve subscription. Main Street is paying local agencies $10,000 just to turn them on. Everyone assumes AI will be bought primarily online like Slack or Zoom. I think they are wrong. Some of the biggest winners in the AI boom won't be the software vendors. It will be the humans installing it. Here is the reality of SMBs right now: • 54% lack internal AI expertise. • 41% have data quality too poor for AI to even work. • 41% already prefer buying AI through a local IT provider. You cannot "1-click install" a genius AI into a messy CRM or a 15-year-old server. It will just execute the wrong tasks at the speed of light. The AI software will be cheap and a lot will absolutely be bought online. Making it actually work for a messy, real-world business will be expensive. Very bullish on the "Do It For Me" economy being back.
118
119
22
1,186
267,041
Jaideep Sarkar retweeted
Reinforcement learning has shown success in eliciting reflection from LLMs, but what if this capability actually manifests earlier in pre-training? We investigated this question and our results are surprising 👇 [1/4]
13
98
25
796
138,060
Jaideep Sarkar retweeted
Imo the @cursor_ai + claude sonnet ai coding hype is blown out of proportion. As an early adopter and heavy user of cursor (at least 1,000 hours so far), here are 3 major issues I've noticed over the past couple of months: 1. The first generated output(s) often contains subtle bugs that could cost you a ton of time and money Most cursor demos I see on my timeline are focused on the UI, popular frontend frameworks and basic backend auth/api. These applications can afford to make mistakes and most aren't deployed to live paying users. But if your application is deployed to production and utilises complex or critical backend logic (i.e. payments processing), subtle bugs begin to emerge. For example, cursor ai generated the payment order manager class in the image attached below. At first glance it may look good for production, but upon close inspection you'd notice that the `totalPrice` of the order isn't updated when a product is removed. As a result, the system will charge customers incorrectly leading to loss in customer trust, cascading errors, and potential lawsuits. The same issue occurs when "refactoring" code using AI or when Cursor attempts to auto-fix problems for you. Often, changes are made to the original codebase that add hidden bugs to the logic. As a result, a lot of time can be wasted reviewing and refactoring AI generated code. Yes I know.... tests should be run before deployment to catch AI bugs, but let's be honest, most devs don't have the energy or discipline to unit test every commit. 2. Inconsistent quality of outputs If you provide the same prompt several times to the chatbot, you may end up with drastically different solutions to the problem. This can happen within the same session of usage or days/weeks apart. In fact, if you copy a previously generated AI solution and ask the cursor chatbot to "review the code for bugs", 9/10 times it finds something wrong. In addition, if you ask the AI any questions that contain suggestions or alternative solutions, it will apologize and refactor the entire code again. Example:- User question: Thank you for your solution. Is it better to handle the payment orders using a Map function or should I use something like Redis? AI response: "You're absolutely right, and I apologize for overlooking that crucial aspect." 3. It can significantly increase technical debt Even when the AI generates a "good" code block solution, it doesn't take into account the entire software design and architecture of the application. Due to the lack of a holistic perspective, problems emerge includes inconsistent error handling, modularity, and data modelling across the app. As a result, the short term quick fix often leads to scalability, performance, and maintenance issues over the long run. Once your codebase has grown to a large, complex web of messy components, refactoring will be a long, painful and costly process. TLDR: Cursor AI (or AI coding in general) is a useful autocompletion tool that can boost your development productivity in the short run, but in the long run, it can waste significant time and energy IF you don't thoroughly review generated outputs. In my experience, Cursor AI is best used as a "junior developer" who often makes mistakes and you have to review their work carefully to "guide" them correctly. If however, you simply "trust" the AI outputs due to lack of knowledge, skill, or willingness to review results, the long term damage will outweigh the initial productivity gains you got so "hyped" about.
205
176
92
1,770
297,742
Jaideep Sarkar retweeted
I love my black job 🖤
Simone Biles being the GOAT, winning Gold medals and dominating gymnastics is her black job.
22,879
117,126
7,129
1,102,115
67,633,610
Jaideep Sarkar retweeted
Developers, developers, developers! Nothing like the exhilaration of building 💻 @agihouse_org #multiagents #saturdays
7
16
2,254
Great presentation by @james_y_zou on mixture of agents and text grad at hackathon organized by @SambaNovaAI, @togethercompute, @NumbersStnAI at @agihouse_org . Multiple agents collaborating to achieve a task is becoming an increasingly important aspect to develop useful enterprise products! By combining multiple agents, they were able to beat #GPT4 on AlpacaEval leaderboard. These systems require switching between multiple agents and running them at extremely fast speed. This is where SambaNova’s SN40L chip really shines. 100s of models on a single node each at 1000s tokens per second. Try our apis at - 1.fast.snova.ai/ 2.sambaverse.sambanova.ai/
1
8
1
24
7,866
Jaideep Sarkar retweeted
We’re live at @agihouse_org Hackathon in Hillsborough! The SambaNova team is excited to see this community of hackers as they experience the speed and accuracy of SambaNova’s AI platform in action. 🚀 #Developers #API #FastAI
3
1
13
3,323
Jaideep Sarkar retweeted
The true impact of #GenerativeAI hinges on responsible application. We prioritize fairness, transparency, #security, and #dataprivacy in our generative #AI applications. Explore our commitment to #ResponsibleAI: sambanova.ai/blog/responsibl… #LLM #SovereignAI
1
1
11
1,797
Jaideep Sarkar retweeted
Much has been said about many companies’ desire for more compute (as well as data) to train larger foundation models. I think it’s under-appreciated that we have nowhere near enough compute available for inference on foundation models as well. Years ago, when I was leading teams at Google, Baidu, and Stanford that focused on scaling up deep learning algorithms, many semiconductor manufacturers, data center operators, and academic researchers asked me whether I felt that AI technology would continue to make good use of more compute if they kept on delivering it. For many normal desktop processing workloads, like running a web browser or a text editor, having a faster CPU doesn’t help that much beyond a certain point. So do we really need faster and faster AI processors to train larger and larger models? Each time, I confidently replied “yes!” and encouraged them to keep scaling up compute. (Sometimes, I added half-jokingly that I had never met a machine learning engineer who felt like they had enough compute. 😀) Fortunately, this prediction has been right so far. However, beyond training, I believe we are also far from exhausting the benefits of faster and higher volumes of inference. Today, a lot of LLM output is primarily for human consumption. A human might read around 250 words per minute, which is around 6 tokens per second (250 words/min / (0.75 words/token) / (60 secs/min)). So it might initially seem like there’s little value to generating tokens much faster than this. But in an agentic workflow, an LLM might be prompted repeatedly to reflect on and improve its output, use tools, plan and execute sequences of steps, or implement multiple agents that collaborate with each other. In such settings, we might easily generate hundreds of thousands of tokens or more before showing any output to a user. This makes fast token generation very desirable and makes slower generation a bottleneck to taking better advantage of existing foundation models. That’s why I’m excited about the work of companies like @GroqInc, which can generate hundreds of tokens per second. Recently, @SambaNovaAI also published an impressive demo that hit hundreds of tokens per second. Incidentally, faster, cheaper token generation will also help make running evaluations (evals), a step that can be slow and expensive today since it typically involves iterating over many examples, more palatable. Having better evals will help many developers with the process of tuning models to improve their performance. Fortunately, it appears that both training and inference are rapidly becoming cheaper. I recently spoke with @CathieDWood and @CCRobertsARK of the investment firm ARK, which is famous for its bullish predictions on tech. They estimate that AI training costs are falling at 75% a year. If they are right, a foundation model that costs $100M to train this year might cost only $25M to train next year. Further, they report that for “enterprise scale use cases, inference costs seem to be falling at an annual rate of ~86%, even faster than training costs.” I don’t know how accurate these specific predictions will turn out to be, but with improvements in both semiconductors and algorithms, I do see training and inference costs falling rapidly. This will be good for application builders and help AI agentic workflows lift off. [Original text: deeplearning.ai/the-batch/is… ]
41
222
40
1,270
252,200
Jaideep Sarkar retweeted
Replying to @AndrewYNg
Thanks for the shout out, Andrew. We are focused on improving inference throughput in tokens per second for the reasons you describe. Also pushing hard to make training and fine-tuning significantly more efficient. Same platform - training, fine-tuning and high speed inferencing at lowest possible power!
6
1
33
6,992
Jaideep Sarkar retweeted
Really excited to be part of this work and get this thing up quickly. A brilliant combination of the dataflow architecture and the great contribution of all open source models!
Running at 430 tokens/second using full precision and 8 sockets, #Llama3 from @AIatMeta is now available on SambaNova Platform: fast.snova.ai/ 🚀Get full 16-bit precision 🚀Spend on only 8 chips, not 576 chips for 430 tokens/second! Trim chips, not precision! Test out Llama 3 by Alat Meta at fast.snova.ai/ #Llama3 #SambaNova #LLM #AI #GenAI
3
6
307
This is exactly the problem @SambaNovaAI platform can help with! SN40L can serve 100s of expert versions of llama, mistral and other models at 400+ tokens/sec all on a 8-socket system! Helps with cost, helps either deployment and if one is able to use model merging, ensembling or contrastive decoding, you can get better accuracy than the individual models. Great article by @TechCrunch ! techcrunch-com.cdn.ampprojec…
Great article by @TechCrunch but what we've been saying for years is even more extreme than that. There's over 1M models on HF & thousands are released every day! Ultimately, there will be as many models as code repositories for every single company, use-case and features. The best model is the one you train, friends! techcrunch.com/2024/04/19/to…
5
5
527
Very insightful to understand how the french tech and ai scene shaped up to what its today. #FRENChTECh #GenAI
Someone asked me recently why the Paris AI ecosystem is so 🔥 these days. On the surface, it looks like Paris became a major #AI center overnight, but it didn't. It took time and didn't appear by accident. Here is a story that started more than 10 years ago. 👇
1
2
75
Check us out!
Our new AI Samba-CoE v0.2 already beats #Databricks DBRX and we’re just getting started. Samba-CoE v0.3, available soon with our partners at @LeptonAI. Try out the model and check out the speed here: coe-1.cloud.snova.ai. #ai #LLM #enterpriseAI #SambaNova #OpenAI #Mistral

1
63
Jaideep Sarkar retweeted
🚀 Lightning-fast speeds that put us far ahead of the pack 🚀 If you'll be at #GoogleCloudNext this year, we’ll be in booth 1063. Come put Samba-1 and Samba-CoE v.02 to the test. See what our 1+ trillion parameter model can accomplish for your enterprise. #GoogleCloudNext #ai #aichip #LLM #ml #enterpriseAI #cloud
8
27
1,212