Elad Segal retweeted
Announcing NVIDIA Nemotron 3 Super!
💚120B-12A Hybrid SSM Latent MoE, designed for Blackwell
💚36 on AAIndex v4
💚up to 2.2X faster than GPT-OSS-120B in FP4
💚Open data, open recipe, open weights
Models, Tech report, etc. here:
research.nvidia.com/labs/nem…
And yes, Ultra is coming!
Elad Segal retweeted
Llama-Nemotron-v1 technical report is now available on arxiv arxiv.org/pdf/2505.00949v1
Elad Segal retweeted
We are excited to release Llama-Nemotron-Ultra! This is a reasoning ON/OFF, dense 253B model. Open weights and post-training data. huggingface.co/nvidia/Llama-… We started with llama-405B, changed it via NAS pruning then followed by reasoning-focused post-training: SFT + RL in FP8.
Elad Segal retweeted
Nvidia just dropped FFN Fusion
Rethinking Sequential Computation in Large Language Models
Elad Segal retweeted
Very excited about the release of the Llama Nemotron Super 49B model 🚀 #GTC25
Using distillation-based NAS (Puzzle) we achieved 5X throughput gain!
After SFT and RL, this model tops reasoning benchmarks among open 70B models
Elad Segal retweeted
"One bad apple can spoil the bunch 🍎", and that's doubly true for language agents!
Our new paper shows how monitoring and intervention can prevent agents from going rogue, boosting performance by up to 20%. We're also releasing a new multi-agent environment 🕵️♂️
Elad Segal retweeted
How can we interpret LLM features at scale? 🤔
Current pipelines use activating inputs, which is costly and ignores how features causally affect model outputs!
We propose efficient output-centric methods that better predict how steering a feature will affect model outputs.
New preprint led by my student @GurYoav with dream team @Roym4498, Chen Agassy, and Atticus Geiger 🧵1/
Elad Segal retweeted
What's in an attention head? 🤯
We present an efficient framework – MAPS – for inferring the functionality of attention heads in LLMs ✨directly from their parameters✨
A new preprint with @AmitElhelo 🧵 (1/10)
Elad Segal retweeted
📢 New Benchmark: SUPER for Setting UP and Executing tasks from Research repositories
Reproducibility is crucial in science. We introduce SUPER to evaluate LLMs' capabilities in autonomously running experiments from research repositories. ⬇️
arxiv.org/pdf/2409.07440
Elad Segal retweeted
Can AI agents solve realistic, time-consuming web tasks such as “Which gyms near me have fitness classes on the weekend, before 7AM?"
We introduce AssistantBench, a benchmark with 214 such tasks.
Our new GPT-4 based agent gets just 25% accuracy!
assistantbench.github.io
Elad Segal retweeted
1/7 🚨 What do LLMs do when they are uncertain? We found that the stronger the LLM, the more it hallucinates and the less it loops! This pattern extends to sampling methods and instruction tuning. 🧵👇
@megamor2 @JonathanBerant @OriYoran
Elad Segal retweeted
🇲🇽 Excited to share our work was accepted to #NAACL2024 main conference!! 🇲🇽
ICL has been hypothesized to perform GD implicitly in its parameters. But is there good evidence for that? 🧐
Depends what you mean exactly!!
Elad Segal retweeted
Can we leverage pre-existing coding abilities of LLMs to improve semantic parsing and compositional generalization?
🚨 Our new paper shows dramatic improvements when LLMs are prompted with Python rather than DSLs, along with helpful domain descriptions!
bit.ly/code-semparse
Elad Segal retweeted
Watch and Share with the world.
A special project by @N12News.
This video contains footage taken by the young partygoers at the Nova Music Festival prior to the 7.10 terror attack.
You’ll only see a handful of the 260 victims and dozens of those abducted or still missing doing what they came there to do; Party, dance, live. Hours later, the festival became a blood-filled scene of unspeakable crimes.
Elad Segal retweeted
Eyal Waldman is an Israeli billionaire, high-tech magnate (founder of Mellanox)
He built R&D centres in the West Bank & Gaza Strip to employ Palestinian developers in order to build better Israeli-Palestinian relations.
Hamas murdered his daughter Daniel at the music festival
Elad Segal retweeted
MUST WATCH: A British Author explains the truth about "proportionality". Well done!
Elad Segal retweeted
At least 1,300 Israelis were murdered in Hamas terror attack
bit.ly/3ZS8pJu
Elad Segal retweeted
Yonit Levy’s extremely accurate thoughts on the world’s hypocrisy regarding Israel!
@LeviYonit
Elad Segal retweeted
Hello colleagues and fellows. Over the past few days I was shocked to learn that people in our community don't share what I consider to be basic human values. Please help me restore faith in our community by signing this.
forms.gle/2yi1WP9RNSHPHnwH9






























