Wanderer of the realms of mind and man
San Francisco, CA
Joined June 2009
- Tweets1.5K
- Following180
- Followers334
- Likes1.4K
Mohammad Azar retweeted
XBridge came out a few weeks back and the mechanics are close to what we're doing at @mostik_ai
the sender runs a forward pass, its hidden states go through a trained bridge into a second model, and then the second model generates output (both models are also stay frozen, only the bridge trains)
the big difference is how far apart the two models sit: they pair models in the same size range, 7B and 8B in both directions, while we're running 753B into 4B
a continuous bridge on its own turns out to carry the context over and lose the entities that context is about, names and numbers especially
so they add a second input that maps the sender's tokens directly into the receiver's vocabulary, giving the receiver discrete anchors for the continuous signal to attach to
I'd expect that problem to get harder as the two models get further apart: at 753B into 4B there's a lot less shared structure between the two representation spaces than between two 7Bs -- it's a real failure mode and I think anyone building in this direction meets it
we found an elegant way of how to deal with it!
going to share the specifics soon, stay tuned ✨
arxiv.org/abs/2608.11676
meet @mostik_ai!
what happens when you put 12 PhDs in one room for four months? first place on the ARC-AGI leaderboard, which I can't say much about while the competition is still running. and this, which I can.
everyone's arguing about whether open models will catch up to frontier models. we think it's the wrong question. here's the one we pose: why does a frontier model have to generate your answer at all, when the only thing you need from it is the reasoning?
we do this by enabling models to communicate in latent space. through our protocol, hidden states pass straight from a frontier model into a small one running on your infrastructure -- no text between them, and neither model is fine-tuned. two models from different families, sharing reasoning, both left untouched.
how do we know it works? we tested it on a setup where a 753B model reads the problem, and a 4B edge-class model writes the answer. with this approach, we get results 80% as accurate as the frontier model, but at 20x faster performance.
we're committed to preventing frontier model lock-in and are already partnering with inference providers to accelerate open-weight adoption. we've done this between 15 of us, in four months, 12 PhDs and a Fields medalist, backed by @generalcatalyst
WIRED has the first external account of the company and the work: wired.com/story/russian-star…
full writeup, the setup, and all the numbers: mostik.ai/read-more
Mohammad Azar retweeted
we've made it to the 1st place on X News! so proud of everyone on our @mostik_ai team 🥹🫰
xitter.cf/i/trending/20952826118…
meet @mostik_ai!
what happens when you put 12 PhDs in one room for four months? first place on the ARC-AGI leaderboard, which I can't say much about while the competition is still running. and this, which I can.
everyone's arguing about whether open models will catch up to frontier models. we think it's the wrong question. here's the one we pose: why does a frontier model have to generate your answer at all, when the only thing you need from it is the reasoning?
we do this by enabling models to communicate in latent space. through our protocol, hidden states pass straight from a frontier model into a small one running on your infrastructure -- no text between them, and neither model is fine-tuned. two models from different families, sharing reasoning, both left untouched.
how do we know it works? we tested it on a setup where a 753B model reads the problem, and a 4B edge-class model writes the answer. with this approach, we get results 80% as accurate as the frontier model, but at 20x faster performance.
we're committed to preventing frontier model lock-in and are already partnering with inference providers to accelerate open-weight adoption. we've done this between 15 of us, in four months, 12 PhDs and a Fields medalist, backed by @generalcatalyst
WIRED has the first external account of the company and the work: wired.com/story/russian-star…
full writeup, the setup, and all the numbers: mostik.ai/read-more
Mohammad Azar retweeted
two years ago the plan for my thirties was tenure-track, and now it's diagrams-covered whiteboard, the best team I could ever imagined, and a city where the sauna conversations are better than most conferences 😄
no conclusion, just noticing it on a Sunday ✨
Mohammad Azar retweeted
رئیس‌جمهور ترامپ درباره اعتراضات مردم ایران:
«برای مردم بسیار دشوار است که دوباره به خیابان‌ها برگردند. ممکن است بسیار شجاع باشند، ممکن است از رژیم متنفر باشند، ممکن است هر کاری بکنند، اما وقتی می‌بینید آدم‌ها این طرف و آن طرف یکی‌یکی نقش زمین می‌شوند... بسیار ترسناک است.»
WATCH IN FULL: President Donald J. Trump's interview with @hughhewitt on @WatchSalemNews
Mohammad Azar retweeted
Really gonna watch out for Tara, we need more stories like this. hella bullish.
Tara Rezaei (@tararezaeikh), 23, Iranian, is one of the wildest new Silicon Valley talent stories.
IOAA medalist for Iran in 2021.
MIT in 2022.
OpenAI intern.
Now co-founder of @mirendil, a frontier AI company that just raised a $200M seed from @a16z, Kleiner Perkins, and NVIDIA.
All of this in 4 years.
Btw, this story probably wouldn’t have happened if a travel ban had existed in 2022.
Image: Tara on Iran’s IOAA team in 2021.
Mohammad Azar retweeted
چرا مردم ایران امروز می‌گویند رضا شاه روحت شاد؟ او فرد دموکراتی نبود ولی...
#KingRezaPahlavi
#FreeIran
#DigitalBlackOutIran
با احترام 🫡
👇👇👇👇👇
Mohammad Azar retweeted
خبرنگار: به نظرتون زدن زیرساخت‌ها یه جورایی تنبیه کردن مردم ایران بخاطر کارهای رژیم ایران نیست؟
ترامپ: بله زدن زیرساخت‌های برق و غیره، دردآور هست ولی مردم ایران حاضرند این درد را به جان بخرند به قیمت اینکه آزاد شوند. آن‌ها از ما خواهش می‌کنند بمب بزنیم تا آزاد شوند.
🔺جدی درک نمی‌کنم این ایده‌ی زدن زیرساخت دیگه از کجا اومد!… نتانیاهو که هیچ وقت از این مورد حرفی نزده بود و در جنگ ۱۲ روزه هم نشان داد قصد این کار را ندارد. پادکست‌های طرفدران ترامپ را هم که گوش می‌کنیم همه از زدن پُل‌ها و غیره انتقاد می‌کنند. خود ترامپ هم که گفته مردم ایران گیر کرده‌‌اند و می‌ترسند ما وسط جنگ رهایشان کنیم؛ مارکو روبیو هم که همیشه گفته مردم ایران با حکومتشان فرق دارند؛ تا امروز حتی یک سناتور آمریکایی هم از زدن زیرساخت به عنون راه حل حرفی نزده! این ایده‌ی احمقانه چطور به مغز ترامپ رسید که «سپاه» که خودش مادرِ «حماس» است، با خاک شدن کشور، تسلیم می‌شود!؟ واقعأ یک ایرانِ خرابه که اگر رژیمش عوض نشود به دست چین می‌اُفتد، چه فایده‌ای برای آینده‌ی آمریکا دارد؟
🔸مگر اینکه همه این‌ها بازی باشد برای امتحان کردن سپاه تا مطمئن شوند اگر زیرساخت‌ها برایشان مهم نیست، به عنوان راه حل آخر، با سرباز زمینی حمله کنند…
Mohammad Azar retweeted
ویدئوی جدیدی که از اعتراضات ۱۹ دی منتشر شده نشون میده که یه زوج تهرانی در مقابل نیروهای سرکوبگر مسلح ایستادگی کردن تا مانع حمله اونا به مردم شن ولی خودشون هدف شلیک گلوله سرکوبگرا قرار میگیرن.
Mohammad Azar retweeted
Another kotlet! 🎉 Secretary of the Supreme National Security Council of the Islamic regime, Ali Larijani, was eliminated by IDF this morning, according to IDF reports.
Mohammad Azar retweeted
Marit,
Since you and your party were silent when thousands of Iranians were murdered back in January, maybe it is better to keep the same silence now too, and instead educate yourself a bit. You can start from here:
xitter.cf/ArisenEmber/status/202…
🙋♀️Hello - Iranian here.
For those fixated on 'legality' to excuse the regime in Iran - F*ck You.
No, I will not let you be my voice. You don't get to narrate my story, you don't get to claim moral superiority. You don't get to tell me my feelings are wrong.
Is it legal to throw women in prison for strands of hair? Is it legal to mass execute people? Is it legal to turn a fertile land into a parched desert? Is it legal to rape? Is it legal to shoot innocent people? Is it legal to kill children? Is it legal to torture people to death? Is it legal to spread terrorism? Is it legal to deprive people of a livelihood? Is it legal to shoot people in the eye to blind them? Is it legal to silence people and take away all of their human rights? Is it legal to shoot down a passenger plane? Is it legal to drive millions to leave their country? Is it legal to jail women for singing and dancing? Is it legal to disappear people including children?
You will never experience anything like Iranians have experienced for the last 47 years.
Iranians have fought barehanded and they've paid a price. All up to 1,000,000 (one million) Iranians have been murdered since the regime came to power.
Your books on 'civil disobedience' and 'collective protest' are useless against an armed opposition that is ideologically driven and will kill all that stand in its way.
You want legality? The world has a duty to protect innocent lives. It's enshrined in R2P. Some people seem to think Iranians aren't humans. The murder, genocide and massacre of Iranians receives scant media attention - hence scant sympathy.
Those who proclaim to care about 'human rights' must think Iranians are animals and not worthy. Their hatred of Israel and US is so great they've lost all perspective.
Yes, Iranians are happy. They're happy someone took out Ali Khamenei and many others directly responsible for so much pain and agony.
And you know what? We're unashamedly hopeful that with the help of the world's superpower, we can reclaim our country and build a better tomorrow.
We know there's a long way to go, but give us this brief moment of reprieve, because daily we sit and try to tell the story of the lives lost, those at risk of execution, those under torture. We've seen the pictures and videos of massacres taking place.
Our dance and happiness comes with a heavy weight. We do so, in knowledge of the many who never lived to see this day.
The day of freedom will come to Iran, it's glorious - and we're not sorry if some outside help contributed to making that happen.
So don't speak on my behalf and stop excusing this regime on grounds of 'anti-colonialism'. and 'anti-Zionism'.
#Iran
Mohammad Azar retweeted
بانه چهارشنبه ۱۳ اسفند ۱۴۰۴
«ساعت ۲ بعد از ظهر:
الان باز پادگان رو زدن.
چندین جای سپاه داخل شهر رو هم زدن...
این بار صداش کل شهر رو گرفت، سه ستون دود سیاه و خاکستری بلند شد
ساعت ۱۱ صبح:
سه چهار بار سپاه بانه رو زدن
پادگان ارتش رو هم شب اول و هم الان چندبار زدن
به فاصله ده پونزده دقیقه باز کماکان می‌زنن
با این شد نزدیک ۱۰ تا انفجار
جلوی پادگان غوغاست
پر آمبولانسه
مردم با یه عده دارن دعوا میکنن
کماکان از ساعت ۱۱ صبح به مدت نیم ساعته صدای انفجار مداوم میاد...
به سرباز های اونجا هم گفتن اگه ترک خدمت کنید اعدامتون می‌کنیم :///
کادری ها خودشون فرار کردن فقط چند تا سرباز نزدیک ۱۸ سال اونجا موندن، دور تا دور سیم خاردار و مین گذاری شده خیلی گناه دارن...»
Mohammad Azar retweeted
🚨 JUST IN: President Trump announces Iran has LOST air detection and detection facilities, they're screwed
"They're gonna be in for a LOT OF HURT!" 🔥
"The leader of the pack is gone."
"There was another hit TODAY on the NEW leadership!"
