CLEF/NTCIR/TREC REproducibility = CENTRE (British spelling)

Joined September 2017
CENTRE at #clef2018 @clef_initiative - replicate and/or reproduce papers from CLEF Cross-lingual Ad-hoc, TREC Web Track, and NTCIR We Want Web. Register at: clef2018-labs-registration.d… More info at: centre-eval.org/clef2018/ind… Organizers: @frrncl M. Maistro @ian_soboroff @tetsuyasakai
5
2
We Want Web has joined forces with @_centre_ and will be back at #ntcir15 ! Mission: quantify progress, replicability, and reproducibility in web search! If you have been following @_centre_ please follow me from now on.
5
6
Slides: "Overview of the NTCIR-14 CENTRE Task" slideshare.net/TetsuyaSakai/… #ntcir14
3
2
CENTRE at #clef2019 poster will be presented today and tomorrow at #ecir2029 @ecir2019 Come to our boot and join us to put reproducibility into action! centre-eval.org @clef_initiative
3
2
Maria recruiting participants in @_centre_ during the @clef_initiative session at @ecir2019 #ecir2019 May the force be with her! centre-eval.org – at Cologne, Germany
3
3
Maria talking about @_centre_ reproducibility lab during the @clef_initiative session at @ecir2019 #ecir2019 centre-eval.org
6
1
11
Challenge yourself with replicability, reproducibility and generalizability of IR systems! Participate in CENTRE #clef2019 @clef_initiative. Guidelines out at: centre-eval.org/clef2019/ CENTRE has also teamed up with #OSIRRC2019 at @sigir2019: checkout the guidelines to know more
4
2
#ntcir14 @_centre_ task timeline: Feb 1, 2019 Results summary and draft overview released [DONE ALREADY!] Mar 15, 2019 Participant paper submissions due May 1, 2019 All camera‐ready papers due Jun 2019 NTCIR‐14 Conference@NII, Tokyo research.nii.ac.jp/ntcir/ntc…
1
5
#clef2018 @martinpotthast keynote at @_centre_ about the TIRA platform and reproducibility
3
8
#clef2018 Maria enrolling people for @_centre_ !!!!
#clef2018 Maria introducing @_centre_ at #clef2019 Check out more at centre-eval.org/clef2019/
2
5
Maria Maistro introducing CENTRE@CLEF2018 CENTRE @_centre_, a new lab on reproducibility of IR experimental outcomes centre-eval.org/clef2018/ind… @clef_initiative w/ @ian_soboroff @tetsuyasakai
1
4
2
Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff: CENTRE@CLEF2018: Overview of the Replicability Task (#clef2018 Working Notes) ceur-ws.org/Vol-2125/invited…
1
1
Or rather: "@_centre_ task participants are encouraged to participate additionally to the @ntcirwww task which also uses clueweb12-13B but with new WWW2 topics" ;-) xitter.cf/ntcirwww/status/100932…
The #ntcir14 thuir.cn/ntcirwww2/ offers new Sogou data for the Chinese subtask! The English subtask will continue to use clueweb12-13B, so participants are encouraged to participate additionally to the @_centre_ task which uses the same corpus with the WWW1 topics.
3
2
IR students are encouraged to participate in the @_centre_ AND @ntcirwww tasks at #ntcir14 to kill two birds with one stone! waseda.box.com/CENTREatNTCIR… Task registration open until end of Sep, but better to start early! xitter.cf/_centre_/status/988948…
Updates from CENTRE@NTCIR-14 (Apr 25)! waseda.box.com/CENTREatNTCIR… T1: Replicate RMIT's NTCIR-13 WWW runs! T2-TREC: Reproduce Delaware's TREC2013 web runs on NTCIR-13 WWW data! T2-OPEN: Reproduce any run pair on NTCIR-13 WWW data! You have May-Oct (0.5 years) to do the experiments!
Updates from CENTRE@NTCIR-14 (Apr 25)! waseda.box.com/CENTREatNTCIR… T1: Replicate RMIT's NTCIR-13 WWW runs! T2-TREC: Reproduce Delaware's TREC2013 web runs on NTCIR-13 WWW data! T2-OPEN: Reproduce any run pair on NTCIR-13 WWW data! You have May-Oct (0.5 years) to do the experiments!
Check out the CENTRE@CLEF tasks at centre-eval.org/clef2018/ind… - You are challenged to replicate and reproduce runs from CLEF Bilingual Ad-hoc Labs, TREC Web Tracks, and NTCIR We Want Web Tasks #CLEF2018 xitter.cf/clef_initiative/status…
There is still time to register for Labs at #CLEF2018. Registrations are open until April 27. Subscribe here: clef2018-labs-registration.d…
CENTRE among the joint initiatives for reproducibility #clef2019 and #ecir2019 ! Don’t wait and start training yourself already with this year edition centre-eval.org/clef2018/ind… xitter.cf/philipp_mayr/status/97…
.@ecir2019 ecir2019.org/ is productive now. Intro slides de.slideshare.net/Philipp_Ma… thanks to @ecir2018 #ecir2018 for a wonderful conference in Grenoble @lorrainegrt
Want to challenge the reproducibility of state-of-the-art IR systems? Check out CENTRE@CLEF2018 centre-eval.org/clef2018/ Registration closes: April 27; runs due: may 11 @clef_initiative #clef2018
5
4
Okay, some info on CENTRE at #ntcir14 is available here: sakailab.com/ntcir14centre/ We will be looking at the replicability/reproducibility of the effect size between an A-run (advanced) and a B-run (baseline). RMIT's #ntcir13 @ntcirwww runs are the targets from #ntcir.