Applied Scientist @ Amazon Alexa AI

United States
Joined June 2016
Devamanyu Hazarika retweeted
1.4.8 made Muse Code a lot more token-efficient, so we wanted you to feel it right away. 🎉 Everyone's usage is reset, effective now. Have fun.
Muse Code 1.4.8 is out and is focused on token efficiency. - Auto-review and background agents now use a cheaper model when available, and long auto-reviews stop sooner instead of burning tokens. - We've fixed a bug that routed a small number of users who had enabled contributor mode to the full-priced models.
40
18
11
297
89,223
Devamanyu Hazarika retweeted
Muse Spark Open -- weights releasing today -- runs great on new Mac Studios thanks to work with @johnternus and Apple.
1,435
1,724
875
31,726
4,584,339
Devamanyu Hazarika retweeted
the most underrated part of muse is the model that powers it. thank you to the MSL research team—some of the most technically brilliant, hardworking scientists and engineers i’ve ever known. you brought original ideas to difficult problems, invented new methods, and battled through enormous technical complexity to build the jewel at the heart of muse. thank you to the teams working on agentic post-training, tool and computer use, memory, personalization, alignment, safety, and multimodal understanding. thank you to the people building data, evals, and infrastructure beneath it all. so much scientific ingenuity lives in those details: designing a better experiment, finding the flaw in an apparently good result, staying with a stubborn problem until a new way forward becomes clear. and now that jewel powers a beautiful product your grandma can use without knowing a thing about the extraordinary complexity underneath. it will just work for her. all those discoveries, all that patient work, becoming something simple and useful in another person’s hands. there is something magical about that. i’m grateful to be building with you.
74
98
29
1,558
205,939
Devamanyu Hazarika retweeted
Muse Code users: 1/ we had a recent issue with subscription usage metering that we debugged through the weekend. for every request, we were reserving a pool of tokens to complete the request. necessary retries weren't being processed correctly, leading to request failures as 429s and loss of unused tokens. 2/ contributor tier limits have now been raised significantly on every subscription tier to provide for more generous usage moving forward! would love to see how far you guys are able to get on a sub now. we have now reset everyone's usage for the metering fix + the new elevated limits 🥳
muse code subs update contributor tier limits are now way way larger we will reset usage today for all subs, everyone starts fresh
18
7
3
124
7,266
Devamanyu Hazarika retweeted
Here is a walkthrough of Muse! Excited to share more about the personal agent we’ve been working on. muse.ai
60
32
19
667
124,629
Devamanyu Hazarika retweeted
Meta Muse Spark 1.3 (Max) matches the performance of Fable 5 and GPT 5.6 Sol on the Vals Index, at 4x - 8x cheaper.
48
54
23
645
207,056
Devamanyu Hazarika retweeted
1/ today we’re releasing muse spark 1.3—available in muse code & the meta model api. this is our most capable model yet—frontier performance almost too cheap to meter. much stronger at agentic and coding with better usability. we think users will really notice the jump.
198
305
156
3,600
658,122
Devamanyu Hazarika retweeted
Muse Spark 1.3 is rolling out today with frontier performance almost too cheap to meter. This is the biggest jump we've made so far on coding and agentic work. Try it in Muse Code and our API. Next up 🍉 and Muse Spark open weights releases coming soon.
1,446
1,606
1,228
19,904
3,799,582
Devamanyu Hazarika retweeted
Muse Code is out of beta and now built to handle bigger, more complex engineering tasks. Developers can get started with one command today: curl -fsSL dev.meta.ai/install.sh | bash
580
609
246
7,973
1,095,267
Devamanyu Hazarika retweeted
Another release this week🔥 Muse Spark 1.1 is a considerable upgrade in capability, especially for agentic tasks. Plus… It’s available via API! We see this model as a workhorse: fast and very reasonable priced, with strong all-round capability.
1/ muse spark 1.1 is an industry-competitive agentic and coding model. across many agentic evals it rivals gpt-5.5 and opus-4.8. available now through the new meta model api and in meta ai. 🧵
4
13
110
10,937
Devamanyu Hazarika retweeted
JobBench from 17 to 54.7, Insane 😳
1/ muse spark 1.1 is an industry-competitive agentic and coding model. across many agentic evals it rivals gpt-5.5 and opus-4.8. available now through the new meta model api and in meta ai. 🧵
3
10
3,842
Devamanyu Hazarika retweeted
(1) Today we're releasing Muse Spark 1.1 -- a strong agentic and coding model at a very low price. It's available through our new Meta Model API and in Meta AI.
5,340
3,561
3,601
45,309
23,704,016
Devamanyu Hazarika retweeted
1/ muse spark 1.1 is an industry-competitive agentic and coding model. across many agentic evals it rivals gpt-5.5 and opus-4.8. available now through the new meta model api and in meta ai. 🧵
343
461
338
3,743
1,671,082
Devamanyu Hazarika retweeted
1/ releasing muse image today — the first image generation model from MSL. it's agentic: pairs with muse spark to reason through your prompt, search the web, and plan before it generates. people get what they meant on the first try. live now in the Meta AI app.
141
242
131
2,057
617,958
Devamanyu Hazarika retweeted
Excited to release PrefEval (ICLR '25 Oral), a benchmark for evaluating LLMs’ ability to infer, memorize, and adhere to user preferences in long-context conversations! ⚠️We find that cutting-edge LLMs struggle to follow user preferences—even in short contexts. This isn't just about long-context ability—but also a lack of proactiveness in following preferences. 💭 LLMs struggle with implicit preferences revealed through conversation, requiring more reasoning. 🚀 SFT on our benchmark greatly improves performance w/ enhanced attention to preference regions! 🧩 What's in PrefEval? - 3,000 user preference & query pairs - 3 Implicit & explicit preference forms - 20 conversational topics - Evaluated up to 100K context w/ various baselines - Flexible task forms: MCQ & generation - Extensive Error Type Analysis 🔗 Learn more: Website: prefeval.github.io/ Code & Data: github.com/amazon-science/Pr… Paper: arxiv.org/abs/2502.09597 Huge thanks to my mentors during my internship at Amazon @linkaixi @Mingyi552237, Yang Liu, @hdevamanyu!
3
27
2
132
13,277
Devamanyu Hazarika retweeted
Large Language Models for Agents @xinyun_chen_ · @XiangruTang · Di Jin · @hdevamanyu · Daniel Fried · @dawnsongtweets · Shafiq Joty · Meredith Morris
1
1
1
3
888
Devamanyu Hazarika retweeted
If you're interested in discussing how retrieval-augmented generation and in-context learning can be used to create safer chatbots in #NLProc, come see our poster at #EMNLP2023 tomorrow (Dec. 9) from 11:00 AM - 12:30 PM in the East Foyer!
Can retrieval-augmented generation reduce toxicity in #NLProc? We find retrieving even from a pool of 10 demonstrations can reduce toxicity by ~14% and when using a larger pool of demonstrations, we outperform BlenderBot3 in human evaluation! 📎: arxiv.org/abs/2302.00871 [1/7]
7
1
18
1,875
Devamanyu Hazarika retweeted
Dinner at #EMNLP2023 with superstars @emnlpmeeting
2
25
955
Devamanyu Hazarika retweeted
📣📣 #EMNLP2023 @Tahaksu1 presents his joint work with @AmazonScience today! They introduce a framework bridging the compositinal task gap between closed & open source language models. Find him at the venue in the poster session PS3, 16:00 today! #NLP #LanguageModels
1
1
5
1,765
Devamanyu Hazarika retweeted
Can retrieval-augmented generation reduce toxicity in #NLProc? We find retrieving even from a pool of 10 demonstrations can reduce toxicity by ~14% and when using a larger pool of demonstrations, we outperform BlenderBot3 in human evaluation! 📎: arxiv.org/abs/2302.00871 [1/7]
1
8
2
38
7,757