Established 1993, the University of Sheffield's #NLProc Group is one of the UK's largest natural language processing research centres.

Sheffield, UK
Joined November 2009
Happy to announce that my paper with @chenghua_lin "Do as I Say, Not as You Do: Assessing Public Versus Practitioner Perspectives on the Development of Artificial Intelligence and Language Technologies" won Best Paper at @inlgmeeting! @sltcdt #NLP Paper: bit.ly/4iaeier
3
1
11
560
With #EMNLP2026 just around the corner, a reminder of the EMNLP papers from Sheffield NLP! If you're attending, do check out our papers and say hi to the authors! Looking forward to seeing everyone at EMNLP!
We’ve been locked out of this account for a while😅 but we’re back, with some good news! 🎉 We have a bunch of new Sheffield NLP papers at @emnlpmeeting @aaclmeeting CIKM and INLG 📚 Congrats to everyone involved! 👏 More details below 👇
4
2
11
2,002
We’ve been locked out of this account for a while😅 but we’re back, with some good news! 🎉 We have a bunch of new Sheffield NLP papers at @emnlpmeeting @aaclmeeting CIKM and INLG 📚 Congrats to everyone involved! 👏 More details below 👇
5
2
16
2,027
"An Empirical Study on Preference Tuning Generalization and Diversity Under Domain Shift" is accepted at EMNLP 2026! 🎉 See you in Budapest! 🇭🇺 Work with @Xingwei__Tan and @nikaletras (@SheffieldNLP ). Powered by @sltcdt!
1
5
2
17
2,739
Sheffield NLP retweeted
Very happy to be presenting this paper at #COLM2026! 🎉 We found that monitor models struggle to detect which modality the model was relying on just from the reasoning trace. Especially with longer reasoning. A small thread on some extra findings below 🧵
1/ 🎉 Excited to share that our paper "Reasoning Dynamics and the Limits of Monitoring Modality Reliance in Vision-Language Models" has been accepted to #COLM2026! 📄 Final version: arxiv.org/pdf/2604.14888 A thread 🧵👇
1
2
1
5
593
Sheffield NLP retweeted
Let your agents communicate via "hidden" states with StateBridge. Downstream performance 🚀 Coming to @COLM_conf 2026 👇
AI agents are getting a new communication channel – hidden states A method from @sheffielduni – StateBridge – lets them skip the text conversion and pass information in a continuous form This cuts out an entire step in the communication pipeline. Here is how StateBridge works: - It takes the final-layer hidden states corresponding to the last 64 tokens of an agent’s message - Aligns them with the receiving model’s embedding space - Calibrates their scale - And finally, inserts them as a continuous prefix. This method needs no training or model modification. So in the end, we go from "hidden states → text/tokens → embeddings → hidden states" to "hidden states → aligned states → receiver" The results show that: - StateBridge beat or tied baselines on 22/26 tests. - Qwen3-32B hit 64.1% on GPQA vs. 58.3% with text. - It also recovered details missing from the visible text. But there is one limitation. StateBridge was tested with identical model weights across agents, and it's unclear how good cross-model communication happens. Most interestingly, StateBridge arrives in the same week many researchers showed that hidden reasoning blobs can leak sensitive data across users and API sessions. Internal states may indeed preserve more information. But the more communication moves beyond text, the less of it we can actually observe, debug, and govern. So what's better to optimize for?
1
7
427
Sheffield NLP retweeted
Shedding more light on the reasoning faithfulness of language models, now on multimodal settings! Paper w/ @danaesavi @samlewislim @delliott to be presented at COLM 👇
1/ 🎉 Excited to share that our paper "Reasoning Dynamics and the Limits of Monitoring Modality Reliance in Vision-Language Models" has been accepted to #COLM2026! 📄 Final version: arxiv.org/pdf/2604.14888 A thread 🧵👇
2
6
578
Sheffield NLP retweeted
Here is MultiHashFormer, our new framework for vocabulary efficient language modelling. Work w/ @HuiyinXue and @_gucciiiii Inspired by chaotic dynamic memory systems with distributed state spaces, we replace the LM embedding matrix with a modular hashing interface 1/N
2
8
2
51
5,859
Brilliant seminar today from @amuuueller on using interpretability as an engineering tool for NLP. Can't wait for your paper to hit arXiv soon about using ambiguity representations to improve confidence estimation!
12
561
Sheffield NLP retweeted
Excited for my invited talk at Cambridge this Friday! Thanks to @suchirsalhan & @CambridgeLTL for having me. 📊 Slides will be available after the talk: gucci-j.github.io/talks/ 🗣️ ACL attendees: Join our oral session at Harbor H-I (July 5, 16:00-17:30)! #NLProc #ACL2026
5
1
17
2,638
Sheffield NLP retweeted
New #ICML2026 paper: "On Effectiveness and Efficiency of Agentic Tool-calling and RL Training". ⚠️The methodology for measuring and improving tool-calling capabilities is fragile. We break down our analysis along two critical axes: (1) effectiveness; and (2) efficiency. 👇
1
1
13
753
Thanks @suchirsalhan for your seminar today, we loved hearing about your work on BabyLM! xitter.cf/suchirsalhan/status/20…
I'm really excited to be delivering a seminar at @SheffieldNLP on Tuesday about my research on Small and Human-Scale Language Modeling! Thanks @_joestacey_, @_gucciiiii, Marco Valentino and @nikaletras for the invite!
1
1
11
1,058
Sheffield NLP retweeted
Today, in our @SheffieldNLP seminar series, we welcome Sean MacAvaney @macavaney from @TerrierTeam at University of Glasgow to give a talk entitled "Re-thinking Re-ranking".
1
8
389
Thrilled to see such a fantastic breakdown of our latest paper on output diversity collapse in post-training (with @Xingwei__Tan, @nikaletras, @SheffieldNLP)! 🚀 @neural_avb did a phenomenal job summarizing our work. Check it out below! 👇
I have been studying a lot of post-training paper to prepare for my next video. This morning I am studying a banger from this week: "Where does output diversity collapse in post-training?" One of the more educational papers I have read recently. Basically after post-training LLMs often produce less varied answers than their base versions. This paper runs experiments to figure out where exactly this diversity is lost, the effects of distillation vs instruction-tuning vs RLVR, etc. Their big hypothesis is that the diversity cannot be recovered at inference through sampling techniques or CoT. The collapse irreversibly happens during training.
3
2
5
922
Join us on 8 June in #Sheffield to hear about #PhD students’ #AI and #ML #speech and #NLProc research! #Keynotes from @egrefen (@GoogleDeepMind) & @wang_wenwu (@cvssp_research). Find out more and #register (by 31 May) at slt-cdt.sheffield.ac.uk/annu…
2
1
294
Sheffield NLP retweeted
When we adapt LLMs to other languages using unlabeled target language data, they tend to lose their core instruction-following and reasoning abilities. 🚨 New #ACL2026 paper w/ @_gucciiiii, T. Morishita & @AlineVillav on how to mitigate this catastrophic forgetting 👇
1
3
1
26
3,359
Sheffield NLP retweeted
Our heart @SheffieldNLP will always be with *ACL, but we've also started getting serious about IR. Great to see our group's efforts in bridging #NLProc & search reflected so clearly in #SIGIR2026. Special shout out to @wangxieric, @drmarkstevenson et al for leading this 👇
#SIGIR2026 accepted paper list has been released on sigir2026.org/en-AU/pages/pr… Vibe coded the analysis again based on csrankings.org (again, by no means accurate), found that this year, Renmin University continues to be the top-1 institute, and China and US are still the top-2 countries with most publications.
3
18
1,637
Sheffield NLP retweeted
LLMs are great at outputting step-by-step reasoning, but is that text actually driving their conclusions, or is it just post-hoc rationalisation? How can we improve the faithfulness of LLM reasoning? My talk at the #EACL2016 FEVER wrkshp aimed to probe a dialogue on this 🧵👇
1
1
14
1,309