AI Consultant 789Labs | Ex-Microsoft AI 🧑‍💻 🌉 👾

Joined November 2014
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
Based
DeepSeek
@deepseek_ai18h
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/DeepI… 1/4
14
Julien retweeted
Be extremely intentional with your friendships — not acquaintances, not business partners, actual friends Try to pick high-integrity people — the right people Invest time in those relationships Cut or downgrade folks who are transactional or who don’t show up for you Reallocate that time and energy to the right people who do It's ok to be cutthroat about this, as life is the memories you create with your friends and family. Invest in making moments.
282
408
69
5,108
443,709
Why are we calling every new kernel release a Megakernel. This is a well written CUDA graph engine with persistent kernels and PDL. The author didn’t even call this a megakernel github.com/vllm-project/vllm…
BREAKING NEWS🚨: NVIDIA has just achieved 423 tok/s/user 🚀 on the 2.8T Parameter Kimi K3 model via a new upstream vLLM optimization. 1.68x Faster on the Same Hardware! This was done by NVIDIA CentML's Benjamin, who wrote NVIDIA's new decode-specialized kernels in Cute DSL via aggressive Megakernel fusion. This is a 12,000 LoC Megakernel and is the future of advanced AI-assisted kernel generation. NVIDIA is already working on DeepSeekv4.1 and other models for vLLM too. Someone should give this NVIDIA 10x engineer a raise for this great new major feature!
29
19
4
362
27,619
When making money is no longer your goal, that is when you can start being truly effective.
69
94
16
1,300
49,308
Every person that moves to SF goes to a bunch of tech events in the first two weeks and realizes it's a complete waste of time.
180
66
25
2,560
87,272
Replying to @Sentdex
Did they collaboratively do anything useful ?
2
5
1,987
Julien retweeted
François Chollet
@fcholletOct 17
Some observations about the "total" automation of software engineering: 1. There are more software engineers now than in 2025, and demand is growing. 2. Software engineers have never worked harder than they do now. 3. They largely don't write code anymore, agents write ~100% of the code. 4. The bottom line of the companies that employs these engineers and agents (i.e. the terminal purpose of all this code) is typically not budging as a result of AI adoption. This is why you have to think in terms of systems. Automating one aspect of a system creates its own friction and moves the bottlenecks elsewhere.
317
251
71
2,780
279,624
I’m literally that weirdo who wrote (all by hand) a 15K word blog post on: - why one cant treat models as oracles - how models gaslight you all the time - what it takes to build confidence in the model’s output copyconstruct.medium.com/how… So yeah sure, I believe in magical woo-woo
Replying to @copyconstruct
I don't expect models to do things well automatically. I'm just pointing out that you believe in the magic too much. Including things "I gave it things to read" lol
15
36
5
793
43,502
Julien retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
863
2,605
1,421
19,653
4,372,447
Replying to @saranormous
Girlfriends….
18
Julien retweeted
I'm simply not going to have it output 100k loc Code is literally useless. Code in fact is a liability. Having more code is actually worse overall. I am trying to solve problems with the least amount of code possible. This is very, very important
Replying to @yacineMTB
what are you gonna do when it's sol-7-ultrafast putting out 100k loc/day?
77
99
19
2,484
87,636
Good question
It’s disappointing to see people say all code is going to be slop and we should be ok with it, because humans weren’t writing the best code either. Quality and reliability should be higher (as quantitatively measured), not lower. Why’re we lowering the bar for ourselves? 😔
40
Replying to @MMaxud
Funnier one* That’s some loud silence! Ok u got me. Tell em what ur working on…
13
Character AI has gone bankrupt. The AI startup announced its Chapter 11 filing through a late-night newswire press release
130
362
192
2,744
433,898
Making my way through this piece and enjoying every bit of it. Some 🔥 lines in there. "Treating debugging as an open-ended problem where an agent is free to conjure any hypothesis under the sun after reading some cherry-picked part of the code is tantamount to giving an agent enough rope to hang itself."
How to effectively debug with agents when you no longer read or understand the code In this post, I propose a debugging framework for agents that doesn’t rely on human knowledge of code to get to the right “root cause” The TL;DR are the screenshots. Link to post in the reply.
2
70
🌶️
sarah guo
@saranormousOct 12
Of course if the next company wants to sell $20M of inference at negative gross margin, with no path to scale supply, be my guest. 🙇‍♀️
39
Julien retweeted
it blows my mind how many people get on here and start giving advice i can barely figure out what we should be doing and how and every week things change and anything i do find conviction on is rarely generalizable but you all got advice for me
137
67
14
1,663
52,606
Replying to @ThePrimeagen
I’m excited to get one this month 🍎:)
305
Introducing Microsoft-Decision-1, our new model for fast decision-making. It delivers top performance on structured decision tasks, outperforming both LLMs and other decision models in latency and quality. We’re already testing it across Microsoft for everything from incident response and quality control to scientific discovery.
708
1,072
603
11,408
1,696,748