@NTCIR

NTCIR organizes shared-tasks in IR, QA, MT, NLP, Summarization, Data/Opinion Mining.

research.nii.ac.jp/ntcir/
Joined May 2009
  • Tweets659
  • Following1K
  • Followers705
44Media
Registration deadlines have been extended for several #NTCIR19 tasks: AgenticInstruction: July 10, 2026 SciClaimEval: July 10, 2026 ToT: July 1, 2026 DAGRI: July 15, 2026 Check the task details and register here: research.nii.ac.jp/ntcir/ntc… We look forward to your participation!
5
2
535
📢 NTCIR-19 Registration Extensions are here! Several tasks have updated registration deadlines: 📅 AgenticInstruction → July 10 📅 SciClaimEval → July 10 📅 DAGRI → July 15 📅 ToT → July 1 Don't miss your chance to participate! 🚀 #NTCIR19 #NLP #IR #DeadlineExtension
1
1
1
235
🧵 "Show me a dress like this but in blue and shorter." Composed image retrieval is a hard, real-world problem. #NTCIR19 CAMEO benchmarks it using 369,000+ reviews from a real Vietnamese e-commerce platform. (1/4)
1
109
more replies
The ViEcomRec dataset is built from a real Vietnamese e-commerce platform, with product images, metadata, and 369K+ Vietnamese customer reviews. Retrieved images are pooled TREC-style across submissions and judged by human assessors. (3/4)
1
80
📅 Registration deadline: July 10, 2026 (AoE) 🔗 Task: cameo-task.com/ (moved from Google Sites) 📧 [email protected] 📝 Register: research.nii.ac.jp/ntcir/ntc… #NTCIR19 #MultimodalIR #Ecommerce (4/4)
32
🧵 What if you could search your own memories? That’s the vision behind #NTCIR19 Lifelog-7. The task features four subtasks, including the new CASTLE collection with audio, video, chat transcripts, and interaction logs supporting three retrieval challenges. (1/5)
1
1
1
509
more replies
The dry run is Feb 20 – May 1. Formal run: Apr 20 – Aug 1. Registration deadline July 10. This is the 7th edition of the NTCIR Lifelog series. (4/5)
1
27
📅 Registration deadline: July 10, 2026 (AoE) 🔗 Task: lifelog-ntcir-project-bd9eae… 📝 Register: research.nii.ac.jp/ntcir/ntc… #NTCIR19 #Lifelogging #PersonalIR (5/5)
27
🧵 "Table 1 shows our method outperforms all baselines." Does it? #NTCIR19 SciClaimEval is a benchmark for verifying scientific claims against the actual tables and figures in papers. (1/5)
1
110
more replies
Published baselines: o4-mini achieves 82.3% accuracy but only 68.2% pair accuracy on subtask 1 and 85.2% on subtask 2. Qwen3-VL-30B also tested. Dataset is live on HuggingFace now. (4/5) huggingface.co/datasets/alab…

alabnii/sciclaimeval-shared-task · Datasets at Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co
1
54
📅 Registration: June 1, 2026 | Formal run submission: July 19, 2026 🔗 Task: sciclaimeval.github.io/ 📦 Data: huggingface.co/datasets/alab… 📝 Register: research.nii.ac.jp/ntcir/ntc… sciclaimeval.github.io/#regi… #NTCIR19 #ScientificNLP #FactVerification (5/5)

SciClaimEval

SciClaimEval: Cross-modal Claim Verification in Scientific Papers

sciclaimeval.github.io
33
🧵 An AI radiologist writes "pneumonia." But what findings led there? AI usually skips that reasoning. #NTCIR19 HIDDEN-RAD2 challenges systems to make it explicit — and now to catch their own mistakes too. (1/5)
1
112
more replies
Two participation tasks: • Radiologist-annotated reports (+ optional imaging data) • Crowdsourced questionnaires — no licensing restrictions, broader access Evaluation: automatic metrics + domain embeddings + LLM rubric scoring + expert qualitative review. (4/5)
1
36
📅 Registration deadline: July 10, 2026 (AoE) 🔗 Task: sites.google.com/view/hidden… 📧 [email protected] 📝 Register: research.nii.ac.jp/ntcir/ntc… #NTCIR19 #MedicalAI #XAI (5/5)

NTCIR19: Hidden-Rad2

Introduction Welcome to the Hidden-RAD2 challenge, a Core Task of NTCIR-19! Building on the NTCIR-18 Hidden-RAD task, Hidden-RAD2 investigates whether AI systems can predict structured radiological...

sites.google.com
39
Load more