*SHROOM Shared-Task Series on Hallucinations and Related Observable Overgeneration Mistakes.

Joined June 2026
Excited to share that our overview paper is accepted to #UncertaiNLP workshop! We will present it on October 29th @emnlpmeeting #EMNLP2026 #SHROOM #shared_task
🥳Our overview paper "Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models" is available on line! arxiv.org/abs/2608.25662 Participants, please check your team names and descriptions in case of mistakes. #UncertainNLP #EMNLP
1
4
52
🎉Paper notifications OUT! Congratulations on your system description paper! Please prepare and submit your camera-ready version by taking the reviewers’ suggestions into account. - Camera-ready due: Sep 11 - Page limite: 5 - Make sure to include our overview and dataset papers
1
4
56
🥳Our overview paper "Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models" is available on line! arxiv.org/abs/2608.25662 Participants, please check your team names and descriptions in case of mistakes. #UncertainNLP #EMNLP
2
1
3
119
Follow the instructions and register for EMNLP if you wish to attend SHROOM-V shared task!! Looking forward to seeing many of you 🤗🤗 #emnlp2026 #SHROOM_ST #NLProc
Registration for EMNLP 2026 is officially open! 🇭🇺 Authors, please note registration deadlines: Sept 11 (Main) and Sept 24 (Workshops). You can find all the details under the Accepted Paper Information on the registration page. 🔗 2026.emnlp.org/registration/ #EMNLP2026
2
4
131
Reminder: reciprocal review deadline is in one week, on August 31st. Please remember to keep your comments constructive and respectful, with a focus on how the authors could improve the readability of their paper. #review #NLProc #sharedtask
1
2
49
🥳Happy to share that SHROOM-Vision dataset paper, SHEEP, has been accepted to the @emnlpmeeting Main conference! Congrats to all the co-authors and big thank to the SHROOM organization team! Can't wait to read it? arxiv.org/abs/2608.01021 #NLProc #sharedtask #datasets
3
2
64
☑️Reviewing process starts! The nominated reciprocal reviewers will review 1-2 papers. The assignments have now been released on OpenReview. - Review deadline: **August 31** - Notification of acceptance: September 4 - Camera ready: September 11 #NLPreview #NLProc #shared_task
2
6
121
⌛️~28 hours left to submit your system paper! Kindly follow this template for your paper title: “Team X at SHROOM-Visions: ” - Ddl: Aug 10th, AoE - Submission: openreview.net/group?id=EMNL… - Please cite the dataset paper SHEEP: arxiv.org/abs/2608.01021 #NLProc #emnlp2026 #SHROOM_ST
1
5
478
3️⃣ days left to submit your system paper 💪 Please use this template for your paper title “Team X at SHROOM-Visions”. Looking forward to learn about your systems! #NLProc #emnlp2026 #SHROOM_ST
2
7
181
Join our SHROOM shared task at EMNLP 2026 @emnlpmeeting in Budapest, and pushing the limites of hallucination detection in LVLMs !!
🎉 We are incredibly excited to announce the Keynote Speakers for EMNLP 2026: @pascalefung , @gneubig, and @annalkorhonen ! See you in October in Budapest! 🔗 2026.emnlp.org/program/keyno… #EMNLP2026
1
2
276
⏳5 days left to submit your system description paper. Hope it goes well! Note: you can safely refer to your team's name and ranking in the paper, but please keep the author as "anonymous". Platform: openreview.net/group?id=EMNL… #NLProc #SHROOM_ST
2
5
176
Keep in mind that we are also open to “shared un-task” paper submissions from groups who either didn’t manage to submit to the official platform on time or used the dataset for different purposes! helsinki-nlp.github.io/shroo… Reach out to organizers directly for more info ;)
2
5
75
🌟Final leaderboard available: helsinki-nlp.github.io/shroo… 📰 SHEEP dataset paper available on arXiv: arxiv.org/abs/2608.01021 Deadline for system description paper: Aug. 10 AoE. Happy writing! #SHROOM_ST #NLProc #EMNLP26
3
4
136
🌟The rankings are now publicly available on the submission website: shroom.pythonanywhere.com/su… Congrats to all winners 👏 Next step: write a short system description paper and submit in by Aug 10! openreview.net/group?id=EMNL… Don't hesitate to ask if you have any questions!
1
1
7
414
📅 3 days left to submit your results! Show us how well your systems perform. You will have 10 more days to finish the description papers: - Evaluation phase ends: 7.31 - System description papers due: 8.10 openreview.net/group?id=EMNL…. #NLProc #EMNLP #sharedtask #SHROOM_ST
2
3
518
OpenReview website for system descriptions is open! openreview.net/group?id=EMNL…. - Accept submissions starts: July 24th - Deadline of submission: August 10th - Follow the ACL template Join our mailing list for updates! groups.google.com/g/shroom-v… #NLProc #sharedtask #emnlp
1
4
410
Second CFP: SHROOM-Visions Shared Task Identify and classify hallucination spans in image-grounded outputs across 4 languages (ZH, EN, FR, IT) ✨20K annotated examples 📍 Co-located with UncertaiNLP @emnlpmeeting ⏰ Evaluation ends July 31 helsinki-nlp.github.io/shroo… #NLProc #VLM
3
7
175
Apparently #ACL is absolutely loaded with mushrooms, and our SHROOM organizers seem way too enthusiastic about them 🙈 Can someone keep an eye on these guys, plz? We’ve got a shared task to finish for #EMNLP before they disappear into the forest. 😳🍄 #NLProc #sharedtask
Some of our organizers are at ACL this week: @educa_nlp, @linguistickus @amansinha09. Don’t be shy—ask them if you have any questions or simply catch up over a coffee☕️ #NlP #sharedtask @aclmeeting #multimodality #hallucination_detection #SHROOM_ST
2
172
Some of our organizers are at ACL this week: @educa_nlp, @linguistickus @amansinha09. Don’t be shy—ask them if you have any questions or simply catch up over a coffee☕️ #NlP #sharedtask @aclmeeting #multimodality #hallucination_detection #SHROOM_ST
⚙️ Hi SHROOMers! Participant kit is available : a3s.fi/mickusti-2007780-pub/… It contains a format checker, the scoring program, a constant-baseline, and a more involved setup. Our organizers @linguistickus @amansinha09 are ACL this week, don’t hesitate to reach out! #SHROOM_ST
3
1
5
428
⚙️ Hi SHROOMers! Participant kit is available : a3s.fi/mickusti-2007780-pub/… It contains a format checker, the scoring program, a constant-baseline, and a more involved setup. Our organizers @linguistickus @amansinha09 are ACL this week, don’t hesitate to reach out! #SHROOM_ST
3
1
2
374