Be part of the conversation, build more trustworthy information ecosystems! #FIIR2025 #information_integrity

IMPORTANT Under Author -> click "make a new submission author" -> select "The Future of Information Integrity Research (FIIR) Workshop" to submit your paper. If you have any issues, please email [email protected] to submit

📰 FIIR Workshop Alert! Future of Information Integrity Research 🎯 Submit abstracts/papers (Tiny and Regular) in ACM PDF format → easychair.org/conferences?co… 📅 Deadline Extended: Feb. 19 EOD AOE

Be part of the conversation, build more trustworthy information ecosystems! #FIIR2025 #InfoIntegrity sites.google.com/view/fiirwo…

📰FIIR Workshop Alert! Future of Information Integrity Research 🎯Submit abstracts/papers (Tiny and Regular) in ACM PDF format → ⚠️Important: 1⃣Indicate your chosen track at the top of your PDF 2⃣Demo papers must include a link to the demo 📅Deadline: January 6th, 2026

The FIIR Workshop (sites.google.com/view/fiirwo…) submission deadline has been extended to September 12, 2025! 🔥 Submit here: lnkd.in/gN2EURDb

We provide some practical tools for this, included lightweight recommended practices for Evaluation Quality Assurance (EQA), a toolkit to evaluate dataset quality, and the largest collection of misinformation datasets. 📜Full paper: arxiv.org/abs/2411.05060

Categorical labels can underestimate the performance of generative systems by massive amounts, as much as half the errors or more; and error analysis and other simple steps could greatly improve the rigor and real-world impact of much of the research in the field.

In this work, we conducted the largest-scale survey to date of datasets in this domain, curating 75 and analyzing 45 in depth. We found that severe spurious correlations and ambiguities affect the majority of datasets in the literature.

🥈"A Guide to Misinformation Detection Data and Evaluation" received Best Paper Runner Up at KDD Datasets and Benchmarks Track! If you're at KDD, check out our presentation and poster! Monday 18:30 - 21:00, Poster 170 Wednesday 15:30 - 17:30, Room 604

⚠️ Important: 1️⃣ Indicate your chosen track at the top of your PDF 2️⃣ Demo papers must include a link to the demo 📅 Deadline: Aug 29, 2025 Be part of the conversation—build more trustworthy information ecosystems! #FIIR2025 #InfoIntegrity

📰 FIIR Workshop Alert! Future of Information Integrity Research 🔥 🎯 Submit abstracts/papers (Tiny, Regular, Demo) in IEEE 2‑column PDF format → sites.google.com/view/fiirwo…

🚀 Given these challenges, error analysis and other simple steps could greatly improve the robustness of research in the field. We propose a lightweight Evaluation Quality Assurance (EQA) framework to enable research results that translate more smoothly to real-world impact.

🛠️ We also provide practical tools: • CDL-DQA: a toolkit to assess misinformation datasets • CDL-MD: the largest misinformation dataset repo, now on Hugging Face 🤗

🔍 Categorical labels can underestimate the performance of generative systems by massive amounts: half the errors or more.

📊Severe spurious correlations and ambiguities affect the majority of datasets in the literature. For example, most datasets have many examples where one can’t conclusively assess veracity at all.

💡 Strong data and eval are essential for real-world progress. In "A Guide to Misinformation Detection Data and Evaluation"—to be presented at KDD 2025—we conduct the largest survey to date in this domain: 75 datasets curated, 45 accessible ones analyzed in depth. Key findings👇

Details on our Shared Task on Social-Media Based Personas will be released later this week.

We’re also actively recruiting members for the Program Committee. If you’re interested in reviewing or supporting the organization of the workshop, we welcome you to fill out this short interest form: 📷 forms.gle/tFgXBXH1dhKgy3FCA