Evaluating state-of-the-art in AI

Atlanta, GA
Joined September 2013
Excited to share a look-back on the Ego4D challenges 2022! In spite of being a brand new dataset, we had strong uptake and healthy competition, leading to significant gains over our baselines (upto 300%!). Check out our analysis and join us in 2023 :) discuss.ego4d-data.org/t/ego…
2
13
3
51
17,570
New year, new user @AmazonScience and new challenge on @eval_ai 🎉. Can't be a better start for 2022!
The #AlexaPrize SimBot Challenge is a competition to advance the development of next-gen virtual assistants that will help humans complete real-world tasks. Learn more about the public benchmark phase on @eval_ai, which starts Jan 10, and ends April 30: amzn.to/evalai-simbot
4
13
We provide datasets in the Neurodata Without Borders @NeurodataWB format, accessible via @DANDIarchive. We host benchmarks and leaderboards on the @eval_ai platform, with private held-out data for standardized model evaluation.
1
4
16
We are happy to announce that our #sceneunderstanding challenge for #CVPR21 has been extended until May 31st. Submissions accepted on @eval_ai eval.ai/web/challenges/chall… @QUTRobotics
1
4
TextVQA (textvqa.org/challenge) and TextCaps (textvqa.org/textcaps/challen…) 2021 Challenges are live now! Deadline: May 14th, 2021 Winners to be announced at #CVPR21 VQA Workshop (visualqa.org/workshop). 1/n
1
8
18
It's that time of the year again :) The 2021 VQA Challenge is now live! It closes May 7th. Also note the TextVQA and TextCaps challenges that involve reading and reasoning about text in images.
VQA Challenge 2021 is live! Deadline: May 7. Link: visualqa.org/challenge. Winners to be announced at #CVPR21 VQA Workshop (visualqa.org/workshop). Other challenges @ workshop: TextVQA, TextCaps. (1/2)
5
1
29
It’s been a long journey. Thanks for the support GSOC @GoogleOSS!
We are happy to announce that @project_cloudcv has been selected as a mentoring organization for @gsoc 2021. This is the 7th consecutive year and we are excited for the summer with #EvalAI project 🎉
1
25
Leaderboards of Habitat Autonomous Navigation Challenge 2021 are live! Looking forward to your submission on PointNav w/o localization sensors (‘𝐺𝑜 5m 𝑛𝑜𝑟𝑡ℎ, 3m 𝑤𝑒𝑠𝑡’) and ObjectNav (‘𝑓𝑖𝑛𝑑 𝑎 𝑐ℎ𝑎𝑖𝑟’) tasks. eval.ai/web/challenges/chall…
2
11
13 challenges. 6 workshop organizers. 42 challenge organizers. 17 scientific advisors. 21 organizations. 1 workshop: embodied-ai.org/ #CVPR2021
We're excited to launch the third Habitat Challenge at the Embodied AI workshop with 15 research & academic institutions. The 2021 Habitat Challenge invites AI experts from around the world to teach machines to navigate real-world environments. #CVPR2021 ai.facebook.com/blog/2021-ha…
📈 Papers with Code now integrates with ongoing competitions! Our first partner is @Eval_AI - huge thanks to @rishabhjain2018! Learn more about how to integrate your competitions here: github.com/paperswithcode/pa…
5
35
7
179
EvalAI retweeted
Announcing @MITIBMLab ObjectNet Challenge on #EvalAI; The challenge calls for the computer vision community to develop robust models for object recognition on images with controls that aim to remove bias: ibm.com/blogs/research/2020/… Participate here: eval.ai/web/challenges/chall…
13
25
New home but same objective. Visit eval.ai for more details! :)
EvalAI has a new home: evalai.cloudcv.org --> eval.ai This transition marks a new phase for us. EvalAI was the star "child" or the most successful project in @project_cloudcv. We just hit 1k GitHub stars, 90 AI challenges, 9.5k users, and 100k submissions!
2
4
Solving challenge hosting for the AI community, now with a shiny new home.
EvalAI has a new home: evalai.cloudcv.org --> eval.ai This transition marks a new phase for us. EvalAI was the star "child" or the most successful project in @project_cloudcv. We just hit 1k GitHub stars, 90 AI challenges, 9.5k users, and 100k submissions!
1
4
24
#HealthIT | Introducing the Knowledge Intensive Language Tasks - #KILT #KILT is a Unified Benchmark for Knowledge Intensive Natural Language Processing - #NLP/#NLProc Tasks 🖥️ai.facebook.com/blog/introdu… @FacebookAI @eval_ai @HubBucket @ProsumerSoft @HubMedX
1
2
Though the PrOD challenge is over, our new Scene Understanding Challenge continues🙂. Think you can get an autonomous agent to map out the objects in its environment? Show us! Compete to win cash prizes and GPUs! evalai.cloudcv.org/web/chall… @RoboticVisionAU @NVIDIAEmbedded @eval_ai
2
7
Highly recommend @eval_ai We are also using it for our @NeurIPSConf competition later in the year: ibm.biz/nlc2cmd You guys rock 🙌
7
1
13
This is what scaling looks like! We built @eval_ai for ourselves — to host the VQA challenge in 2017. 3 years later, we’ve hosted nearly 80 challenges from the research community, with 75k submissions from 7k teams. 14 challenges at #CVPR2020 alone. 🚀
We are excited to share that we hosted 14 AI challenges for ongoing #CVPR2020. Here is the list: 1. Argoverse 3D Tracking Competition @argoai 2. Argoverse Motion Forecasting Competition @argoai 3. Habitat Challenge 2020 @ai_habitat 4. RoboTHOR Challenge 2020 @allen_ai 1/4
1
7
2
59
Interested in #semanticSLAM? Want to prove how good you are at autonomous exploration and #objectmapping? Introducing our newest challenge: The Robotic Vision Scene Understanding Challenge! Find out more: evalai.cloudcv.org/web/chall… @RoboticVisionAU @eval_ai @project_cloudcv
1
1
7