A reminder that the topics Y4 are available Conversational Assistance Track (CAsT) : github.com/daltonj/treccastw…
New this year: (1) Different topic format, (2) Mixed-Initiative system responses (3) Complex discourse structures.
@JeffD @JTrippas @maliannejadi @leifos @ogbonokopaul
All the past judgments and topic files are in the website github repository (including the 2021 judgments).
github.com/daltonj/treccastw…
The guidelines information for CAsT Y4 are available: treccast.ai/. The collections are all available, including deduping for MS MARCO V2.
The mixed initiative deadline is August 15th. The main task deadline is August 31th.
Be sure to register!
#TREC2022
Get ready to participate in CAsT Y4. Be sure to register - ir.nist.gov/trecsubmit.open/…
#trec2022 #ConversationalAI
Last week we posted updates to treccast.ai/ with additional resources and tools (github.com/grill-lab/trec-ca…) for 2021, including automatic baseline runs and converted corpora.
See a summary and ask questions on the mailing list: groups.google.com/g/trec-cas…
#trec2021
We've been working on baselines and topic development. The #TREC2021 evaluation topics will be released very soon, hopefully in time for your July 4th BBQ. Stay tuned to social media of your choice.
A reminder that to participate in CAsT you MUST register. The registration form:
ir.nist.gov/trecsubmit.open/…
The official deadline for CAsT 2021 submission will be August 18th.
We'll be having an virtual open planning session for Y3 Thursday 18th of February. Please join us!
It will be held 5:00pm - 6:00pm GMT (London).
Zoom link:
uofglasgow.zoom.us/j/9181933…
Magic word for meeting is "trec".
We're exciting to be planning for the TREC Conversational Assistance Track in #trec2021. We would like your help and feedback to make next year more relevant for your research.
bit.ly/trec-cast-y2
#trec2020 #conversationalai
#SCAI_Workshop #EMNLP2020
Today is the TREC CAsT submission deadline for #TREC2020. We look forward to your submissions! Please contact us on the mailing list if you encounter any last minute issues. The exact deadline is today the 19th 'roughly' AOE - 'early morning' Eastern (NIST time) on the 20th.
TREC Conversational Assistance Track retweeted
Today at 10:05 PDT,19:05 CET @earissola will present our work on TREC CAsT at #CHIIR2020,with @Dull_Dude there to answer your questions.Don't miss the very first paper on @treccast 😉 where we study the evolution of its conversations and how it can be modeled.
#SIGIR2020 #NLProc
The preprint of our #CHIIR2020 paper "Harnessing Evolution of Multi-Turn Conversations for Effective
Answer Retrieval" is out: bit.ly/2rkluzg
We annotate and analyze the relevance of conversation turns in TREC CAsT. Data: bit.ly/CAsTUR
@ACM_CHIIR @treccast.
There's still time to participate in TREC CAsT 2020 - the deadline for submission is August 19th. Find us at #sigir2020 to discuss and also see a bunch of papers using CAsT-19 data.
Congratulations to the authors of the #sigir2020 best short paper on Conversational Query Rewriting with TREC CAsT:
Few-Shot Generative Conversational Query Rewriting
arxiv.org/abs/2006.05009
Code:
github.com/thunlp/Conversati…
This is the baseline rewriter used in CAsT Y2.
Come join us in two hours for information on the CAsT-19 dataset short paper discussion.
sigir-schedule.baai.ac.cn/po…
#sigir2020
TREC CAsT Year 2 is well under way. There are lots of updates on our website treccast.ai including the 2020 evaluation topics, baseline GPT-2 + BERT runs, and a web UI with BERT to explore. Reminder that the submission deadline is August 19th. #treccast #trec2020
There will be lots of research on #conversationalsearch at #sigir2020. We're happy to announce that this includes a short paper on the CAsT dataset construction - "CAsT-19: A Dataset for Research on Conversational Information Seeking" w/ @JeffD @JamieCallan and @XiongChenyan
In case you missed it, the TREC Conversational Track overview is available in the TREC proceedings and on arXiv. With @JeffD @JamieCallan and @XiongChenyan
arxiv.org/abs/2003.13624
Start preparing for TREC CAsT 2020!
#trec2019 #trec2020




