Pinned Tweet
CENTRE at #clef2018 @clef_initiative - replicate and/or reproduce papers from CLEF Cross-lingual Ad-hoc, TREC Web Track, and NTCIR We Want Web.
Register at: clef2018-labs-registration.d…
More info at: centre-eval.org/clef2018/ind…
Organizers: @frrncl M. Maistro @ian_soboroff @tetsuyasakai
Slides:
"Overview of the NTCIR-14 CENTRE Task"
slideshare.net/TetsuyaSakai/…
#ntcir14
CENTRE at #clef2019 poster will be presented today and tomorrow at #ecir2029 @ecir2019 Come to our boot and join us to put reproducibility into action! centre-eval.org @clef_initiative
CENTRE retweeted
Maria recruiting participants in @_centre_ during the @clef_initiative session at @ecir2019 #ecir2019 May the force be with her! centre-eval.org – at Cologne, Germany
CENTRE retweeted
Maria talking about @_centre_ reproducibility lab during the @clef_initiative session at @ecir2019 #ecir2019 centre-eval.org
Challenge yourself with replicability, reproducibility and generalizability of IR systems! Participate in CENTRE #clef2019 @clef_initiative. Guidelines out at: centre-eval.org/clef2019/ CENTRE has also teamed up with #OSIRRC2019 at @sigir2019: checkout the guidelines to know more
#ntcir14 @_centre_ task timeline:
Feb 1, 2019 Results summary and draft overview released [DONE ALREADY!]
Mar 15, 2019 Participant paper submissions due
May 1, 2019 All camera‐ready papers due
Jun 2019 NTCIR‐14 Conference@NII, Tokyo research.nii.ac.jp/ntcir/ntc…
CENTRE retweeted
Maria Maistro introducing CENTRE@CLEF2018 CENTRE
@_centre_, a new lab on reproducibility of IR experimental outcomes centre-eval.org/clef2018/ind… @clef_initiative w/ @ian_soboroff @tetsuyasakai
Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff: CENTRE@CLEF2018: Overview of the Replicability Task
(#clef2018 Working Notes)
ceur-ws.org/Vol-2125/invited…
Or rather: "@_centre_ task participants are encouraged to participate additionally to the @ntcirwww task which also uses clueweb12-13B but with new WWW2 topics" ;-) xitter.cf/ntcirwww/status/100932…
The #ntcir14 thuir.cn/ntcirwww2/ offers new Sogou data for the Chinese subtask!
The English subtask will continue to use clueweb12-13B, so participants are encouraged to participate additionally to the @_centre_ task which uses the same corpus with the WWW1 topics.
CENTRE retweeted
IR students are encouraged to participate in the @_centre_ AND @ntcirwww tasks at #ntcir14 to kill two birds with one stone!
waseda.box.com/CENTREatNTCIR…
Task registration open until end of Sep, but better to start early! xitter.cf/_centre_/status/988948…
Updates from CENTRE@NTCIR-14 (Apr 25)!
waseda.box.com/CENTREatNTCIR…
T1: Replicate RMIT's NTCIR-13 WWW runs!
T2-TREC: Reproduce Delaware's TREC2013 web runs on NTCIR-13 WWW data!
T2-OPEN: Reproduce any run pair on NTCIR-13 WWW data!
You have May-Oct (0.5 years) to do the experiments!
Updates from CENTRE@NTCIR-14 (Apr 25)!
waseda.box.com/CENTREatNTCIR…
T1: Replicate RMIT's NTCIR-13 WWW runs!
T2-TREC: Reproduce Delaware's TREC2013 web runs on NTCIR-13 WWW data!
T2-OPEN: Reproduce any run pair on NTCIR-13 WWW data!
You have May-Oct (0.5 years) to do the experiments!
Check out the CENTRE@CLEF tasks at centre-eval.org/clef2018/ind… - You are challenged to replicate and reproduce runs from CLEF Bilingual Ad-hoc Labs, TREC Web Tracks, and NTCIR We Want Web Tasks #CLEF2018 xitter.cf/clef_initiative/status…
There is still time to register for Labs at #CLEF2018. Registrations are open until April 27. Subscribe here: clef2018-labs-registration.d…
CENTRE among the joint initiatives for reproducibility #clef2019 and #ecir2019 ! Don’t wait and start training yourself already with this year edition centre-eval.org/clef2018/ind… xitter.cf/philipp_mayr/status/97…
.@ecir2019 ecir2019.org/ is productive now. Intro slides de.slideshare.net/Philipp_Ma… thanks to @ecir2018 #ecir2018 for a wonderful conference in Grenoble @lorrainegrt
Want to challenge the reproducibility of state-of-the-art IR systems? Check out CENTRE@CLEF2018 centre-eval.org/clef2018/
Registration closes: April 27; runs due: may 11 @clef_initiative #clef2018
Okay, some info on CENTRE at #ntcir14 is available here:
sakailab.com/ntcir14centre/
We will be looking at the replicability/reproducibility of the effect size between an A-run (advanced) and a B-run (baseline).
RMIT's #ntcir13 @ntcirwww runs are the targets from #ntcir.






















