Pinned Tweet
Submissions now open on EvalAI for #AlexaPrize SimBot Challenge from @AmazonScience 🎉
Prizes worth $500K, $100K, and $50K for winners!
Today, the #AlexaPrize SimBot Public Benchmark Challenge starts! It's the first time Amazon has welcomed teams other than those sponsored by the company to take part in the challenge. Visit the @eval_ai website for more information, and how to participate: amzn.to/evalai-simbot
ALT Alexa Prize SimBot Public Benchmark Challenge
EvalAI retweeted
Excited to share a look-back on the Ego4D challenges 2022! In spite of being a brand new dataset, we had strong uptake and healthy competition, leading to significant gains over our baselines (upto 300%!). Check out our analysis and join us in 2023 :) discuss.ego4d-data.org/t/ego…
EvalAI retweeted
New year, new user @AmazonScience and new challenge on @eval_ai 🎉. Can't be a better start for 2022!
The #AlexaPrize SimBot Challenge is a competition to advance the development of next-gen virtual assistants that will help humans complete real-world tasks. Learn more about the public benchmark phase on @eval_ai, which starts Jan 10, and ends April 30: amzn.to/evalai-simbot
ALT Alexa Prize SimBot Public Benchmark Challenge
EvalAI retweeted
EvalAI: :cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
Lang: Python
⭐️ 1290
#MachineLearning
Author: @eval_ai
github.com/Cloud-CV/EvalAI
EvalAI retweeted
We provide datasets in the Neurodata Without Borders @NeurodataWB format, accessible via @DANDIarchive. We host benchmarks and leaderboards on the @eval_ai platform, with private held-out data for standardized model evaluation.
Excited to host BEHAVIOR Challenge 2021. Visit eval.ai/web/challenges/chall… to participate. 📈
Drum roll! We release BEHAVIOR, an embodied AI benchmark and challenge of 100 complex household activities that would pose significant difficulties to all of today’s state-of-the-art algorithms. Hope to see great participation to this challenge @ICCV_2021
EvalAI retweeted
We are happy to announce that our #sceneunderstanding challenge for #CVPR21 has been extended until May 31st.
Submissions accepted on @eval_ai
eval.ai/web/challenges/chall…
@QUTRobotics
EvalAI retweeted
TextVQA (textvqa.org/challenge) and TextCaps (textvqa.org/textcaps/challen…) 2021 Challenges are live now!
Deadline: May 14th, 2021
Winners to be announced at #CVPR21 VQA Workshop (visualqa.org/workshop).
1/n
EvalAI retweeted
It's that time of the year again :) The 2021 VQA Challenge is now live! It closes May 7th.
Also note the TextVQA and TextCaps challenges that involve reading and reasoning about text in images.
VQA Challenge 2021 is live! Deadline: May 7. Link: visualqa.org/challenge.
Winners to be announced at #CVPR21 VQA Workshop (visualqa.org/workshop).
Other challenges @ workshop: TextVQA, TextCaps.
(1/2)
EvalAI retweeted
It’s been a long journey. Thanks for the support GSOC @GoogleOSS!
We are happy to announce that @project_cloudcv has been selected as a mentoring organization for @gsoc 2021. This is the 7th consecutive year and we are excited for the summer with #EvalAI project 🎉
We are happy to announce that @project_cloudcv has been selected as a mentoring organization for @gsoc 2021. This is the 7th consecutive year and we are excited for the summer with #EvalAI project 🎉
🥁 We have an announcement to make! 🥁
We are pleased to welcome 202 open source projects as our Google Summer of Code 2021 mentoring organizations, including 31 first-time organizations.
Read and see how to get involved ↓ goo.gle/3rwkPEJ
Here are the project ideas (gsoc.cloudcv.org) for the summer and we are looking forward to student applications. We encourage students to engage with the community through our GitHub (github.com/Cloud-CV) and Gitter (gitter.im/Cloud-CV/EvalAI) channels.
We also have a few positions available for mentors who will help/mentor students during the summer. Please fill this form (forms.gle/KpFmAMMLbd5MvFTC6) if you are interested in mentoring students in the @gsoc program on #EvalAI and we will reach out to you.
EvalAI retweeted
Leaderboards of Habitat Autonomous Navigation Challenge 2021 are live!
Looking forward to your submission on PointNav w/o localization sensors (‘𝐺𝑜 5m 𝑛𝑜𝑟𝑡ℎ, 3m 𝑤𝑒𝑠𝑡’) and ObjectNav (‘𝑓𝑖𝑛𝑑 𝑎 𝑐ℎ𝑎𝑖𝑟’) tasks.
eval.ai/web/challenges/chall…
EvalAI retweeted
We've released a centralized evaluation server on @eval_ai to track community-wide progress on discovering electrocatalysts using ML.
eval.ai/web/challenges/chall…
opencatalystproject.org/lead…
(2/3)
EvalAI retweeted
13 challenges.
6 workshop organizers.
42 challenge organizers.
17 scientific advisors.
21 organizations.
1 workshop: embodied-ai.org/ #CVPR2021
We're excited to launch the third Habitat Challenge at the Embodied AI workshop with 15 research & academic institutions. The 2021 Habitat Challenge invites AI experts from around the world to teach machines to navigate real-world environments. #CVPR2021 ai.facebook.com/blog/2021-ha…
#EvalAI is the new home for Embodied AI challenges 🎉 This year we are hosting 5 challenges to be held at the Embodied AI workshop at CVPR 2021 from @facebookai, @StanfordSVL, @ai_habitat, @UTAustin, @IllinoisCS, @RoboticVisionAU, @robVisChallenge, @QUTRobotics
