Super happy to share that my first first-author paper was accepted at the NeurIPS 2026 FLMSec workshop in Paris!
Depth-based early-exit methods let an LLM stop partway through its layers and generate an answer early to save compute. We asked whether any of those exits are any more robust to jailbreaks than the full model.
We used Balcony’s frozen-backbone design, which adds lightweight exit modules at intermediate layers while leaving the original model unchanged. Because every exit shares the same weights, we could attack each exit independently, optimizing a separate adversarial suffix for each one, and measure the effect of depth alone.
The two models we tested behaved very differently. For LLaMA3-8B, early exits were substantially more robust: attack success at the earliest exit we tested (layer 15) was only 4%, compared with 28% on the full model. For LLaMA2-7B the gap was much smaller. At the same depth it was already roughly as breakable as the full model (36% vs 44%). We also found that deeper exits were easier to optimize against, and that the adversarial suffixes didn’t systematically degrade utility at any depth. So exiting early helped on both models, but how much depends heavily on the backbone.
Huge thanks to Seyedhamidreza Mousavi for collaborating on this!
Paper: arxiv.org/abs/2610.15207
Code: github.com/LassNajmuldeen/ba…
#NeurIPS #LLMs #AISafety #Jailbreaking
Congratulations, slide your boy some compute pls
Today we're announcing that Modal has crossed $1B in annualized run rate, as well as raised a $750M Series D at a $15.75B valuation, led by @Accel.
Since our Series C, usage has tripled and we’ve grown more than 15x year-over-year.
We are deeply grateful to the developers and companies building on Modal. There's still so much more to build, and we can't think of a better time to be building software.
1 trillion params just to score 28% on terminal bench. $3.5 billion series D btw
Meet Mistral Large 4, aka Le Chonk.
• 1T parameters, natively multimodal. 49B active.
It is the best open weights model from US or Europe on aggregated benchmarks.
• State-of-the-art on critical workloads, including cyber defense, manufacturing and finance and it surpasses closed frontier models on visual grounding.
• Forged in Europe end-to-end and is deployable from Europe via our own Mistral Cloud infrastructure.
• Available to all via API today. Working with cybersecurity partners privately.
Open weights release end of October.
Lass Najmuldeen retweeted
Hemmingway-1 is an amazing 27B model you can run locally with a small amount of RAM that writes like a human
Just finished abliterating it with a refusal rate of 1.9% and -0.39pp loss on MMLU-14K
Enjoy!
huggingface.co/distributedco…





