evaluating llms and code. download now on VSCode! | maintained by @iamwaynechi @valeriechen_
Pittsburgh, PA
Joined September 2024
- Tweets102
- Following5
- Followers890
- Likes175
Copilot Arena retweeted
We are excited to launch the ⚔️PR Arena⚔️ leaderboard!
Full results will be revealed after a certain milestone of community votes.
Fix your GitHub issues for free and vote for better fix!
👉Leaderboard & Setup Guide: prarena.web.app
Copilot Arena retweeted
Here are some tips for using ⚔️PR Arena⚔️
1⃣ pr-arena🏷️ option is added automatically to Issue Labels for ease of use!
2⃣ You can use PR Arena in forked repositories.
3⃣ Don't like either fix? Select “neither” and no PR will be created.
👉Install here: github.com/apps/openhands-pr…
Introducing ⚔️PR Arena⚔️ - free AI coding agents to fix real GitHub issues.
Claude Sonnet 4 vs Gemini 2.5 Pro… Who writes better pull requests?
👉 Install here: github.com/apps/openhands-pr…
Powered by @allhands_ai
Copilot Arena retweeted
Who is winning the race to claim the LLMs for SWE market? We share our thoughts based on our @CopilotArena work. See article below for current sentiments and what lies ahead 👇
OpenAI is making a big push into one of the most popular AI domains: software engineering on.wsj.com/3SCvoW2
Copilot Arena retweeted
We are launching our API in open beta! Visit the Inception Platform to create your account and get started using the first commercial-scale diffusion large language models (dLLMs).
platform.inceptionlabs.ai/
Copilot Arena retweeted
With so many AI coding assistants out there, it can be hard to keep track of ones that perform well on real-world tasks. CMU researchers developed Copilot Arena to do just that by crowdsourcing user ratings of LLM-written code.
bit.ly/3YLeDvh
Copilot Arena retweeted
@CopilotArena was featured in @SCSatCMU news! Featuring quotes from me, @iamwaynechi, @atalwalkar and @chrisdonahuey 🥳
📖Check out the article here: cs.cmu.edu/news/2025/copilot…
What do developers 𝘳𝘦𝘢𝘭𝘭𝘺 think of AI coding assistants?
In October, we launched @CopilotArena to collect user preferences on real dev workflows. After months of live service, we’re here to share our findings in our recent preprint.
Here's what we have learned /🧵
Copilot Arena retweeted
Check out @CopilotArena’s new Code Edit Leaderboard!
New #1 Leaders of Code Edit Leaderboard:
Strong performance from both Claude 3.7 Sonnet and Gemini-2.0-Pro! Congratulations to @AnthropicAI and @GoogleDeepMind 🥇
We also release new live leaderboard interface✨. You can now easily toggle between code completion and code edit.
Copilot Arena retweeted
Interested in trying out Copilot Arena for yourself?
Download at lmarena.ai/copilot.
Follow us at @CopilotArena for upcoming updates!
Copilot Arena retweeted
Mercury Coder, the first large-scale diffusion LM. (LLaDA)
Instead of generating tokens sequentially, it "denoises" masked sequences—boosting speed 5-10x over current LLMs
ranks #2 on the Copilot Arena, ahead of GPT & Gemini
chat.inceptionlabs.ai/
Copilot Arena retweeted
Super excited to finally share what we've been building! 🛠️🚀
Go check out Mercury-Coder, the first industry-scale diffusion LLM that ranks #1 in speed and #2 in quality on the copilot arena, and is up to 10x faster than autoregressive models (1100+ tok/s on NVIDIA hardware!) ⚡
Copilot Arena retweeted
News from @CopilotArena: Code Editing Leaderboard is now LIVE!
We have collected over 3.7k votes on 6 models. Congrats @AnthropicAI Claude 3.5 Sonnet on a 1st place rank!🥇
Blog analysis below👇
New feature from @CopilotArena: Inline Edits🔥
1. Highlight your code, hit cmd+i, type your prompt.
2. Compare results with cmd+1 or cmd+2.
3. Pick the winner and see how model ranks!
Join us in building the Inline Edits leaderboard! @CopilotArena download link in the thread🧵
Copilot Arena retweeted
I'm glad to announce that we released an updated version of Codestral today! Codestral-2501 targets completion in IDEs.
• twice as fast as the previous version of Codestral 22B
• tied for first spot on copilot arena with Deepseek 2.5 (236B total params) and Claude 3.5 sonnet
Copilot Arena retweeted
Codestral 25.01 is not only on top of the Copilot Arena leaderboard, it's also 2x faster than the first Codestral -- that matters a lot for code completion
Exciting news from @CopilotArena!
The latest Codestral 25.01 release is now topping the Copilot Arena leaderboard (joint #1, +12 points over previous Codestral!). Congrats to @MistralAI🎆
Try out the new model today in the @CopilotArena VSCode extension.
Copilot Arena retweeted
#1 on @lmarena_ai LMSYS!
xitter.cf/lmarena_ai/status/1878…
Exciting news from @CopilotArena!
The latest Codestral 25.01 release is now topping the Copilot Arena leaderboard (joint #1, +12 points over previous Codestral!). Congrats to @MistralAI🎆
Try out the new model today in the @CopilotArena VSCode extension.
Copilot Arena retweeted
Exciting news from @CopilotArena!
The latest Codestral 25.01 release is now topping the Copilot Arena leaderboard (joint #1, +12 points over previous Codestral!). Congrats to @MistralAI🎆
Try out the new model today in the @CopilotArena VSCode extension.
Copilot Arena retweeted
📣 @CopilotArena leaderboard is now live on lmarena.ai/leaderboard!
We have collected over 15k votes on 11 models (2 new models since our last blogpost release). Congrats @deepseek_ai🥇and @AnthropicAI🥇!
Which model is best for coding? @CopilotArena leaderboard is out!
Our code completions leaderboard contains data collected over the last month, with >100K completions served and >10K votes!
Let’s discuss our findings so far🧵
Copilot Arena retweeted
recently found this cool youtube video walking through how to use @CopilotArena in your software development workflow. thanks @HossamEldinx!
Copilot Arena retweeted
RepoChat Arena: the Live AI coding battles!
Watch Claude, GPT-4o, and Gemini tackle your GitHub repos—fixing bugs and adding features.
Join us to decide who's the best AI engineer! Link below:
Who's the best AI software engineer?
Introducing RepoChat Arena: the live AI software engineering battle!🔥🤖
1. Input any public Github link (repo/issue/PR).
2. Ask the models to fix issues, add features or chat with a repo.
3. Vote for the better one and shape the leaderboard!
Watch AI solve your real-world coding tasks live at RepoChat! Exciting use cases in the thread below🧵