Faculty at @UBC_CS and @CAIDA_UBC working on AI, LLMs, NLP he/him

Joined September 2019
Terrific work from my student @AmirAbaskohi across retrieval, agents, and more, going to EMNLP. Congratulations Amir! Also from my lab at EMNLP: a very thoughtful study from Alex Fortier and Hazel Chen, tracing output homogeneity back to the base model. arxiv.org/pdf/2608.11426 My first year as faculty has been a rollercoaster, but my students surprise and impress me at every turn. Feeling very lucky
Very excited to share that we have 4 papers accepted to #EMNLP2026! 🎉 See you at Budapest! 🇭🇺 Our work this year spans long-document RAG, retrieval, computer-use agents, and clinical NLP. 📄 CLARUS: Hierarchical Hypergraph Modeling for Unsupervised Discharge Summarization — EMNLP 2026 Main Conference We propose CLARUS, an unsupervised framework that models patient records as ontology-aware hierarchical hypergraphs and selects salient evidence via a variational bottleneck for LLM-based discharge summarization. 📄 MCompassRAG: Topic Metadata as a Semantic Compass for Paragraph-Level Retrieval — EMNLP 2026 Findings We use topic-level metadata as a semantic compass to guide more effective paragraph-level retrieval for RAG. 📄 SproutRAG: Attention-Guided Tree Search with Progressive Embeddings for Long-Document RAG — EMNLP 2026 Findings We introduce an attention-guided tree search with progressive embeddings for efficient and effective retrieval over long documents. 📄 ReVision: Scaling Computer-Use Agents via Temporal Visual Redundancy Reduction — EMNLP 2026 Findings We reduce temporal visual redundancy to make computer-use agents more efficient and scalable. This work was done during my internship at Microsoft Research Asia-Vancouver, in collaboration with Microsoft Research Redmond. A huge thank you to my supervisors @careninigiusepp, @PeterWestTM, @ILaradji, @HenryOxplore, @VibhavVineet, and @PranitChawla for their guidance and support, and to all my collaborators Gaetano Cimino, @RayatHoss, and @liraymond96 for the great work and discussions along the way. Looking forward to sharing more about these projects soon.
1
35
4,456
Check out this very creative work from Kunal, exploring the effects of post-training alignment through the lens of physical crystallization! There is a lot that AI research should take from the natural sciences, including more metaphors
We're good at measuring what alignment does to LLMs. We're much worse at describing how it happens over time. Our new paper argues alignment research should borrow predictive theories from physical sciences; using crystallization as a case study. 🧵
4
18
2,238
As deep research agents become increasingly capable, retrieval is emerging as one of the key system bottlenecks. These agents repeatedly search long documents, where every additional LLM call increases latency and token cost. Many recent approaches rely on iterative LLM-based chunking, summarization, or retrieval refinement, while fixed chunking strategies make early representation decisions that are difficult to recover from later. We’re excited to share two complementary papers from @UBC_CS and @UBC_NLP, in collaboration with @ServiceNowRSRCH, that tackle these challenges from different perspectives: We're excited to share two complementary papers that tackle these challenges from different perspectives: SproutRAG (Long-Document Retrieval)🌱 • Learns a hierarchical document structure directly from attention. • Enables retrieval at multiple semantic granularities. • No LLM-based chunking or summarization. • Avoids committing to a single irreversible document representation. 📄huggingface.co/papers/2606.1… MCompassRAG (Efficient Paragraph Retrieval)🧭 • Uses topic metadata as a semantic compass for retrieval. • Makes coarse chunks significantly more searchable. • Eliminates inference-time LLM calls for retrieval refinement, reducing latency and token usage. 📄huggingface.co/papers/2606.1… Together, these works explore complementary directions toward faster, more efficient, and more effective retrieval for long-document RAG and deep research systems. We'd love to hear your thoughts and feedback! In the end, a special thanks to all of my collaborator: @liraymond96 and Gaetano Cimino and my supervisors: @careninigiusepp, @PeterWestTM, and @ILaradji .
🤖 Made with AI
1
4
18
903
Really love our new paper, led by @AmirAbaskohi and @DabiriAghdam! I've been thinking a lot about settings where models need to be unpredictable but under meaningful constraints (creativity, social simulation, etc.) UnpredictaBench strips away everything but this core idea
🎲 Can LLMs stand in for real, unpredictable systems? We're increasingly dropping LLMs into simulations: humans in economic models 📈, agents in multi-agent settings 🤖, processes in epidemiology 🦠. But if a model always returns the single "most plausible" answer, it can't capture how messy and unpredictable the real world is. Please check out our recent work from @UBC_NLP and @UBC_CS, where we introduce the first benchmark for evaluating randomness in LLMs. 🧪 Introducing UnpredictaBench: 448 problems spanning shuffling 🔀, real-world randomness 🌍, and random number sampling across 40 distributions 📊, testing whether models can truly sample from a target distribution, not just vary their outputs. 🔬 We also put creativity under a numerical microscope for the first time, measuring it as distributional behavior instead of vibes. 🚨 The result: no model clears 40% at KS@100. Most collapse to one answer. Reasoning helps a little, but there's no quick fix. 📄 huggingface.co/papers/2606.0… Thanks for my awesome collaborators and supervisors: @DabiriAghdam, Liang Luo, Ellie Dingqiao Wen, Lele Wang, @careninigiusepp, and @PeterWestTM.
3
8
1,095
LLMs reveal secrets when they’re asked to write stories. We told LLMs not to reveal the secret words we gave them, then asked them to write stories. The secret x word never appears literally. But another model can identify it from the story up to 79% of the time.
2
16
2
74
9,574
We trained an LLM trained on an LLM trained on a…🌀🌀🌀 If the original model is sycophantic or just 'weird', will those traits begin to amplify? Yes! But amplification is rare and typically comes at the cost of coherence—except in the case of DPO where things get dicey 🧵
4
16
5
103
20,307
1/n Corporate communication is a minefield, where outcomes can depend on every word in an email. LLMs are rapidly entering this world, but can they actually navigate human norms? Our research suggests they'll change how corporate emails will be written and read!
1
15
27
2,469
Predictive Interpretability > Mechanistic Interpretability Prompting is the best method of scientific inquiry we have to study LLMs It's socially devalued because it doesn't include much d/dx,O(),etc. come to poster #3503 to talk about this or anything re: the science of LLMs
3
16
1
99
11,554
Considering a PhD/MSc in NLP? I’m hiring students this cycle! If you are passionate about making language models reliable and safe, eager about understanding and controlling language models, and would like to add to your research some multilingual flavor - apply to my group! 👇
15
98
4
723
72,812
The top places in all of our leaderboards have been cracked. The reign of AI is over.
For those who missed it, we just releaaed a little LLM-backed game called HR Simulator™ You play an intern ghostwriting emails for your boss. It’s like you’re stuck in corporate email hell…and you’re the devil 😈 link and an initial answer to “WHY WOULD YOU DO THIS?” below
1
2
6
1,122
UBC Computer Science invites applications for up to two full-time tenure-track positions with the following priority areas: visualization, robotics, reinforcement learning, data management, and data mining. Applications are due Wed Dec 10, 2025. cs.ubc.ca/our-department/emp…
11
4
16
5,891
𝑵𝒆𝒘 𝒃𝒍𝒐𝒈𝒑𝒐𝒔𝒕! In which I give some brief reflections on #COLM2025 and give a rundown of a few great papers I checked out!
5
23
1
145
20,584
🤖➡️📉 Post-training made LLMs better at chat and reasoning—but worse at distributional alignment, diversity, and sometimes even steering(!) We measure this with our new resource (Spectrum Suite) and introduce Spectrum Tuning (method) to bring them back into our models! 🌈 1/🧵
5
49
3
193
69,676
New paper: You can make ChatGPT 2x as creative with one sentence. Ever notice how LLMs all sound the same? They know 100+ jokes but only ever tell one. Every blog intro: "In today's digital landscape..." We figured out why – and how to unlock the rest 🔓 Copy-paste prompt: 🧵
58
155
52
1,306
330,862
Want to hear some hot takes about the future of language modeling, and share your takes too? Stop by the Visions of Language Modeling workshop at COLM on Friday, October 10 in room 519A! There will be over a dozen speakers working on all kinds of problems in modeling language and building language technologies! Come for a talk, a discussion, the panel, or all of the above. See our workshop schedule here: lmvisionscolm.com/
1
14
1
78
13,034
Check out @eunjeong_hwang’s paper—how do we give LLMs aspects of social intelligence that actually *help* in conversation?
Theory of Mind is key to human social intelligence, but does giving LLMs ToM make them better social reasoners?🤔 We find that ToM makes LLMs better at dialogue: more strategic, goal-oriented, enabling long-horizon adaptation! We introduce ToMA, a ToM-focused dialogue agent🧵👇
14
1,636
I considered myself a pretty effective email writer until we (led by the amazing @divingwithorcas!) started building this game. See if you fare any better than I did...
For those who missed it, we just releaaed a little LLM-backed game called HR Simulator™ You play an intern ghostwriting emails for your boss. It’s like you’re stuck in corporate email hell…and you’re the devil 😈 link and an initial answer to “WHY WOULD YOU DO THIS?” below
1
2
9
1,902
testing a game we're building where the mechanic is writing tricky HR emails, and noticing that LLMs have a built-in secret handshake with users to bypass safety guardrails. This seems both necessary to make LLMs actually useful and like they make guardrails essentially useless
1
7
1,002
🧵 Academic job market season is almost here! There's so much rarely discussed—nutrition, mental and physical health, uncertainty, and more. I'm sharing my statements, essential blogs, and personal lessons here, with more to come in the upcoming weeks! ⬇️ (1/N)
3
40
254
31,011
the economist published my little letter about the necessity of chaos for discovery
How can chaos create brilliance and breakthroughs? Ari Holtzman (@universeinanegg) Assistant Professor of Computer Science and Data Science, explores how embracing chaos has unlocked the capabilities of AI systems in a letter to @TheEconomist! economist.com/letters/2025/0…
1
17
1,406