Prompsit retweeted
Wrapping up our 3rd general meeting, hosted by @AISweden in sunny Stockholm ☀️
A full room makes the final decisions before training the first OpenEuroLLM model. Sharing updates, ideas, and future plans.
Two more days of tight collaboration.
Full speed mode. 🚀
#goOpenEuroLLM
Prompsit retweeted
Describing HPLT datasets in depth is an essential part of our commitment as data curators:
🆕HPLT 3.0: Very Large-Scale Multilingual Resources for LLM and MT. Mono- and Bi-lingual Data, Multilingual Evaluation, and Pre-Trained Models: arxiv.org/abs/2511.01066
We are on🔥at #HPLT
Prompsit retweeted
The #HPLT crowd is at #EMNLP2025!!!
If you are around, please visit our booth to discuss:
- multilingual datasets 🌏
- dataset insights and stats 📊
- dataset performance 🔝
- efficient MT models ⏱️
- and the future of multilingual LLMs 💡
We don't want to miss U!
Prompsit retweeted
We are happy to announce the second release of HPLT bilingual datasets:
- 50 English-centric language pairs = 380M parallel sentences (HPLT) 🤩
- 1,275 non-English-centric language pairs = 16.7B parallel sentences (MultiHPLT) 😮
Available at the HPLT dataset catalogue and OPUS.
Prompsit retweeted
By harnessing web crawls 🕸️ from Internet Archive and CommonCrawl, researchers 🔎 from @EdinburghUni, @helsinkiuni, @UniOslo, @UniTurku, and @Prompsit unveil new #language resources aimed at enhancing language modeling and #MT training.
slator.ch/MassiveMultilingua…
@OnadeGibert @graemenail @shaoxiongji @oepen @TiedemannJoerg @ltgoslo
Prompsit retweeted
Happy to share our latest MaCoCu paper, accepted at #LRECCOLING2024 @LrecColing #NLProc 🎉
We have linguists annotate the data *quality* of 4 well-known monolingual corpora (OSCAR, CC100, mC4 and MaCoCu) across 11 European low-resource languages.
Link: arxiv.org/pdf/2403.08693.pdf
Prompsit retweeted
➡️ La empresa del #ParqueCientífico de la @UniversidadMH, @Prompsit, colabora en un proyecto europeo sobre tecnologías del lenguaje de alto rendimiento con el objetivo de crear diferentes modelos de lenguaje y traducciones potentes.
Noticia completa 📌:
parquecientificoumh.es/notic…
Prompsit retweeted
First datasets, then models!
Initial HPLT models (LLMs and MT) are out: hplt-project.org/models, some still running 🏃
We explain what we are doing in the deliverables section: hplt-project.org/deliverable…
Meanwhile, we keep cooking IA peta-data-bytes 🥘, enriching, dashboarding 📊
Prompsit retweeted
We just published version 1.2 of HPLT datasets. What's new?
- we fixed a bug in monolingual dedup, please redownload! 🛠️
- we filtered out very ugly monolingual documents🤮
- we anonymised the bilingual datasets🕵️♀️
hplt-project.org/datasets/v1…
Prompsit retweeted
#MaCoCu crew is in Groningen these days! Walking towards great results of MaCoCu corpora evaluation and new MaCoCu language models for under-resourced languages 😁
Prompsit retweeted
Next June, 17th-25th, the #HPLT consortium will held a #hackathon around a set of topics related to corpora curation in Prague. Interested? Drop us a line and join!
hplt-project.org/hackathon20…
Prompsit retweeted
Interested in Open and Community-Driven MT initiatives? CrowdMT is for you!
🎙️Invited speakers from Wikimedia Foundation and Apertium announced.
📜Accepted papers and abstracts announced.
Time to register at events.tuni.fi/eamt23/regist…
Details: hplt-project.org/events
Prompsit retweeted
We've published new #MaCoCu web corpora for 11 under-resourced languages!
56 million documents, 17 BILLION words (monolingual corpora) and 580 million words (English-X parallel corpora) were just uploaded to the CLARIN.SI repository (clarin.si/repository/xmlui/d…) 🥳
Prompsit retweeted
¡Hoy celebramos el #15aniversarioPCUMH con nuestras empresas y emprendedores! 🥳
Prompsit retweeted
Big #HPLT news🥳:
GPT3 for Finnish is out by our colleagues from Turku!!
Special thanks to the National Library of Finland for contributing invaluable training and to CSC – IT Center for Science, Finland for generous computational resources: turkunlp.org/gpt3-finnish
@DataEcoEU
Prompsit retweeted
After a great 2nd physical meeting of the #hplt project in Oslo❄️ we have some highlights to share:
🤩 OPUS includes now ELRC and mtdata
🧐 1PB of new web data is ready to be processed
🦾 Ready to work on LUMI (AMD)
😻 LLM/MT models completed for fi/no and cs-uk
@DataEcoEU
Prompsit retweeted
A new ParaCrawl parallel corpus is available!
🌍 languages: Polish-Czech
🎒 size: 24 million sentences
🗒️ license: CC0
🎯 location: paracrawl.eu bonus section
🧐 more info: paracrawl.eu/moredata
Prompsit retweeted
😬 We are very proud to have #translation tools which you may combine with your own #translationengines!
🤓 After all, #machinetranslation learning does require getting used to such tools on your own!
👥 Well, not exactly on your own - we can help you!
youtube.com/watch?v=xzWVNWak…



















