@ColinCherry

NLP Researcher; Twitter lurker

 Montréal, Québec
sites.google.com/site/colinacherry/
Joined November 2009
  • Tweets136
  • Following187
  • Followers513
Colin Cherry retweeted
Bryan Li@bryanlics11 Mar 2025
Externally retrieving knowledge empowers LLMs for domain-adapted MT ⚖️🩺. But how is knowledge best represented, and how viable is generating it from an LLM itself? Our @GoogleAI paper investigates these questions through a careful experimental setup 📜. arxiv.org/abs/2503.05010
1
3
6
458
<<Call for BoF/Affinity Group meeting>> Applicants should fill out the application form before March 24 2025.naacl.org/calls/affinit… #NAACL2025
1
2
1,605
😼SMOL DATA ALERT! 😼Anouncing SMOL, a professionally-translated dataset for 115 very low-resource languages! Paper: arxiv.org/pdf/2502.12301 Huggingface: huggingface.co/datasets/goog…
3
12
3
35
4,246
The call for Diversity and Inclusion Subsidies is out: 2025.naacl.org/calls/dei_sub…

Call for NAACL 2025 Diversity and Inclusion Subsidies

Official website for the 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies

2025.naacl.org
7
9
2,191
LLMs are typically evaluated w/ automatic metrics on standard test sets, but metrics + test sets are developed independently. This raises a crucial question: Can we design automatic metrics specifically to excel on the test sets we prioritize? Answer: Yes! arxiv.org/abs/2411.15387
4
11
3
49
11,788
New application link! google.com/about/careers/app… I am at EMNLP/WMT this week. Please come find me if you want to learn more about this role!
Dan Deutsch@_danieldeutsch18 Oct 2024
Interested in doing research on Google Translate and Gemini? Good news! I’m hiring for full-time roles on the Google Translate Research Team! Apply here: google.com/about/careers/app…
10
35
5,549
📢Don't miss the NAACL Student Research Workshop! 🖇️ CFP & Important dates: naacl2025-srw.github.io/cfp #NLProc
2
1
4
3,086
Colin Cherry retweeted
NAACL@naacl24 Oct 2024
Thank you to those who participated in our recent all-member vote regarding our name change. The change is happening! We are: The Nations of the Americas Chapter of the Association for Computational Linguistics! Announcement 👉 naacl.org/posts/2024-10-24-N…
1
13
1
62
3,301
📢 NAACL needs Reviewers & Area Chairs! 📝 If you haven't received an invite for ARR Oct 2024 & want to contribute, sign up by Oct 22nd! ➡️AC form: forms.office.com/r/8j6jXLfAS… ➡️Reviewer form: forms.office.com/r/cjPNtL9gP… Please RT 🔁 and help spread the word! 🗣️ #NLProc @ReviewAcl
1
27
2
41
9,878
Interested in doing research on Google Translate and Gemini? Good news! I’m hiring for full-time roles on the Google Translate Research Team! Apply here: google.com/about/careers/app…
3
82
2
243
38,370
Colin Cherry retweeted
Slator
@slatornews17 Oct 2024
Researchers from @Google reveal that verbose #LLMs, 🤖 which offer multiple translations 🔄 or refuse to translate, 🚫 pose significant challenges ⚠️ to traditional #MT evaluation frameworks. #machinetranslation @ebriakou @ColinCherry @markuseful slator.com/google-finds-refu…

Google Finds ‘Refusal to Translate’ Most Common Form of LLM Verbosity

Google researchers reveal that verbose LLMs, which offer multiple translations or refuse to translate, challenge traditional MT evaluation.

slator.com
4
6
479
📢 Call for demos is out!! #NAACL2025 #NLProc Check the website for submission guidelines and a chance to win the Best Demo Award! 🏆 🖇️ 2025.naacl.org/calls/demo/
6
2
11
6,392
Colin Cherry retweeted
Paola Garcia@leibnyPaola7 Oct 2024
📢📢🌟@jhuclsp Have an Idea? Let’s Hear It! JSALT 2025 Call for proposal is out. Deadline: October 15th, 2024 For more information: clsp.jhu.edu/the-11th-freder…

The 11th Frederick Jelinek Memorial Summer Workshop on Speech and Language Technology - Center for...

Brno University of Technology JSALT2025 site June 9 — August 1, 2025 Each summer, the Center for Language and Speech Processing (CLSP) organizes and hosts multidisciplinary teams of more than 50...

clsp.jhu.edu
5
2
14
4,490
[1/5] Are verbose #LLM translations skewing evaluation results? TLDR: Yes! Our recent work dives into the prevalence and impact of LLM verbosity in automatic and human evaluations. 📎 Paper: arxiv.org/pdf/2410.00863
1
11
48
4,509
📢 Second call for papers is out!! #NAACL2025 #NLProc 🖇️ 2025.naacl.org/calls/papers/
1
10
1
45
9,566
Translation is a complex task involving pre-translation research and post-translation stages. Can #LLMs handle this process step-by-step, relying solely on their internal knowledge? ✨We show that decomposing the translation process significantly improves #Gemini translation quality of long-form texts across all #WMT24 languages! 📜arxiv.org/pdf/2409.06790
2
14
2
69
6,591
📢 Calling all #NLProc enthusiasts! Submit your tutorial and workshop proposals to 2025 *ACL conferences (NAACL, ACL, EMNLP) through one joint call! Tutorials: 2025.naacl.org/calls/tutoria… Workshops:2025.naacl.org/calls/worksho…
12
23
3,780
🥳 LLMs are changing the game, even for datasets! NewsPaLM, a publicly released LLM-generated dataset, outperforms larger web-crawled corpora for MT. It includes sentence & paragraph-level, MBR-decoded data. See paper for more, incl. LLM self-distillation. arxiv.org/abs/2408.06537

Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated...

Recent research in neural machine translation (NMT) has shown that training on high-quality machine-generated data can outperform training on human-generated data. This work accompanies the...

arxiv.org
1
8
1
36
3,525
First call for papers is out! #NAACL2025 🔴2025.naacl.org/calls/papers/
1
22
73
7,934
Colin Cherry retweeted
Rishabh Agarwal
@agarwl_17 Jul 2024
[New paper] If you are sampling multiple outputs from a teacher LLM (e.g., Gemini 1.5 GPT), ranking them, and fine-tuning the student on the best output, you can do better. Simple idea: Fine-tune / Distill on the top-k outputs instead. Consistent gains on machine translation.
4
26
3
184
20,756
Load more