@ManUtd Interpolating words and vectors Ad veritatem. Ad astra. Ad curiositatem maximam.

Joined February 2024
Tomorrow morning, I’ll release a blog that outlines a detailed roadmap for setting up evals on subjective / open-ended tasks. The blog also covers a variety of stats / ML tricks for reducing noise and increasing confidence in your evals. Here is a list of blogs, papers, and other resources (written both by me and by others) I often return to when thinking about this topic: - High-quality human data: lilianweng.github.io/posts/2… - Human evaluation guidelines: eugeneyan.com/writing/labeli… - LLM-as-a-Judge core concepts: cameronrwolfe.substack.com/p… - LLM-as-a-Judge practical guide: hamel.dev/blog/posts/llm-jud… - LLM-as-a-Judge best practices: eugeneyan.com/writing/llm-ev… - Rubric-based judges (RL focus): cameronrwolfe.substack.com/p… - Rubric-based judges (eval focus): arxiv.org/abs/2603.00077 - Stats for LLM evals: cameronrwolfe.substack.com/p… - Adding error bars to evals: arxiv.org/abs/2411.00640 - Anatomy of a benchmark: cameronrwolfe.substack.com/p… - Agent evals: cameronrwolfe.substack.com/p… - Full ecosystem for agent evals: anthropic.com/engineering/de… Would highly recommend reading all of these if you're interested in building better evals. Each of these blogs also link to further papers / resources on each topic that are incredibly useful.
23
50
1
472
14,935
Bytes and United retweeted
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/DeepI… 1/4
1,370
4,184
2,084
36,679
4,950,711
Bytes and United retweeted
The Paradoxical Commandments
105
239
19
1,328
78,867
Bytes and United retweeted
Starlink has an Indian license, 20 ground stations on Indian soil, and a promise to keep Indian user data in India. What it doesn't have is permission to switch on. Thousands of Indian villages still have no 4G. In the Northeast alone, more than 1,800 had no mobile signal of any kind as of February, most of them in Arunachal Pradesh. These are the places satellite internet is built for: mountain villages, islands, flood zones, anywhere a tower or a fiber line takes years and a lot of money to arrive. Starlink has done what India asked. It got its telecom license in June 2025 and space regulator approval a month later. It built India-specific security controls, agreed to keep data local, and has been reporting the names, addresses and coordinates of its test terminals to the government every two weeks. It operates in more than 150 countries. In India it still can't sell a single subscription, and the company is now talking about early 2027. New Delhi says nobody is being singled out, since Eutelsat OneWeb and Jio's satellite venture are stuck at the same stage. I believe that, and I don't think it helps. When three licensed operators, two of them backed by India's biggest telecom groups, can't clear security review after more than a year of trials, that tells you the process has no deadline. It doesn't tell you it's thorough. The security concerns are real. Indian agencies have been rattled by smuggled terminals turning up in border areas, and India is entitled to lawful interception, local data storage and an emergency shutoff. Starlink has already signed up for all of it. The answer to a misused terminal is enforcement, not keeping the service dark for everyone who would use it legally. Elon Musk has been blunt, calling the delay "a crime against the people of India" and asking, "Is Ambani the real boss of India?" You don't need to buy the whole oligarch theory to see his point. Reliance spent months lobbying for spectrum auctions that would have favored deep-pocketed incumbents. The government sided with Starlink on that one, which is to its credit. Now it needs to finish the job. India can keep every security power it wants and still let a kid in Arunachal get online. Right now it's choosing not to.
1,084
315
106
2,127
757,281
Bytes and United retweeted
“Somebody – we don’t know who – decided that a Special Intensive Revision (SIR) of voters had to be conducted. The Election Commission of India (ECI) told RTI activist Anjali Bharadwaj that it did not have minutes of any meeting that decided upon the SIR.  “Somebody – we are now piecing this together – decided that Form 6 would be given to new voters to register during SIR but it would be altered so that they cannot do so without proving that their grandfather was also on the voter list decades ago.  “Somebody – and we don’t know who – invented a tool called ‘logical discrepancy’ and wrote algorithms to eliminate voters for 11 different reasons. More than 13 crore names were deleted from India’s electoral rolls thus. “But we do know who built the digital system which helped that somebody do all this. It’s not a government department or company. It is a private company – Tata Consultancy Services (TCS) – whose parent group had, in the very years that it was building that system, become the single largest identifiable funder of the party running the government the system serves. “None of that, by itself, proves wrongdoing. Companies build government software everywhere. In fact, TCS itself has done a tremendous job of building and running India’s passport system. “Companies donate to ruling parties everywhere the law permits it. What is unusual is the scale of the overlap, the choices made by TCS – or thrust upon it – in building the system, and how little of it has been publicly examined.” Truly outstanding piece by S Raghotham connecting the dots…
36
732
28
1,657
45,517
Bytes and United retweeted
This semester I am teaching a new course on Agentic Systems, which explores the full stack of AI systems: from building and optimizing agent harnesses to serving and optimizing LLM serving infrastructure. Students learn by building, measuring, and optimizing real agents and systems, balancing capability, latency, and cost. Our goal is not just to teach today's AI technologies, but to prepare students to build tomorrow's. All lectures, readings, and assignments are publicly available at cs2680.seas.harvard.edu
66
430
13
3,819
143,502
Bytes and United retweeted
Dear Prime Minister Ambani, Please accept my humble apologies for not realizing that you are the real boss of India. Naturally, you would prefer to maintain your monopolistic exploitation of the great people of India, but would you nonetheless consider allowing Starlink to compete? There are many areas of India, as there are in all countries, with no Internet access, which denies children the opportunity for education and for small businesses the opportunity to sell their goods to a global market. Starlink would change their lives for the better. Thank you 🙏
102,500
72,362
28,065
551,184
118,289,380
I don't get this India's entire data is hosted on Cloud Technology owned by the US and it's allies India's entire data is run by software owned by US and Israel India's entire Communication Platform is built on technology owned by the US and it's allies India's entire Digital Infrastructure is built on technology platforms owned by US and it's allies So how exactly will Starlink make anything any worse or less secure than it already is? Pls enlighten me
523
554
91
3,522
291,132
Bytes and United retweeted
Elon is right to demand answers. India once had more than a dozen telecom operators competing for customers. Today, Jio and Airtel account for nearly 77% of India’s wireless subscriptions. What is the harm in adding another competitor? Healthy competition encourages providers to offer better prices and service, giving consumers more choice and better value. Starlink could offer Indian households, businesses and communities another broadband option, especially in remote villages, mountains and islands where expanding existing networks is difficult. Indians deserve greater transparency, better connectivity and the freedom to choose. Let Starlink compete and let consumers decide.
Starlink is licensed in over 165 countries and has spent five years complying with every single law and requirement of the government of India, so why still no license? Is Ambani the real boss of India?
2,204
741
365
4,319
643,544
Bytes and United retweeted
Welcome to India, Elon. Wait till you discover the other guy.
Starlink is licensed in over 165 countries and has spent five years complying with every single law and requirement of the government of India, so why still no license? Is Ambani the real boss of India?
21,358
22,502
8,116
125,650
21,060,996
Bytes and United retweeted
While I agree that no company, including Starlink, should be stopped from doing business in India, I also think people are overestimating how disruptive it will be here. India is an extremely price-conscious market. JioFiber starts around ₹399/month and Airtel broadband around ₹499/month. Starlink’s India pricing isn’t official yet, but satellite internet is unlikely to compete with terrestrial broadband purely on price. Where Starlink can genuinely change things is rural India, remote areas, highways, mountains and places where laying fibre simply doesn’t make economic sense. So yes, let Starlink come. More competition is always good. But I don’t see millions of Jio/Airtel users suddenly switching to Starlink just because Elon Musk launches it. Its real opportunity in India is probably where Jio and Airtel don’t reach well, not where they already dominate. And interestingly, Airtel itself has partnered with SpaceX around Starlink distribution, which makes this less of a simple “Starlink vs Indian telcos” story :)
Unfortunately, we are being blocked by certain oligarchs in order to maintain their monopolistic chokehold on the Indian people. You can guess who they are … This is a crime against the people of India!
82
19
4
387
40,559
Bytes and United retweeted
In this era of the global telecommunications revolution, we want India to keep pace with the rest of the world. We want people living in the country's most remote areas to have access to better internet connectivity, and this is possible only through Starlink because private internet service providers in India are unable to offer such high quality connectivity. That is why we all want @Starlink, the company owned by global business leader Elon Musk, to launch its internet services in India as soon as possible. 🇮🇳
Starlink is licensed in over 165 countries and has spent five years complying with every single law and requirement of the government of India, so why still no license? Is Ambani the real boss of India?
230
209
21
1,039
84,786
Bytes and United retweeted
Starlink is licensed in over 165 countries and has spent five years complying with every single law and requirement of the government of India, so why still no license? Is Ambani the real boss of India?
The government is more interested in protecting the interests of crony capitalists than of citizens
29,240
21,385
9,641
141,667
56,728,152
Bytes and United retweeted
In reality, these are the very few people who do not want our country, India, to move forward in step with the rest of the world. We all welcome starlink to India. 🇮🇳
Unfortunately, we are being blocked by certain oligarchs in order to maintain their monopolistic chokehold on the Indian people. You can guess who they are … This is a crime against the people of India!
161
290
25
1,838
322,770
Bytes and United retweeted
For nearly FIVE YEARS, Elon and the Starlink team have been trying to bring high-speed internet to India, especially to rural and remote areas where reliable connectivity is still difficult and expensive to reach Starlink has spent years working through India’s requirements It has secured its telecom licences, received IN-SPACe approval, built 20+ gateway sites and designed its operations specifically around India’s security requirements including keeping Indian user data inside India And yet Starlink still cannot serve a single commercial customer The final clearances and spectrum assignment are still pending India is still about 64% rural…..roughly 941 million people live in rural areas Starlink is ready The ground infrastructure is already built That years-long delay is hard to justify and incredibly frustrating Starlink will give many more people another way to access high-speed internet, especially in places where fibre and mobile networks struggle to reach And that makes the situation even harder to understand when Digital India itself is built around broadband access and closing connectivity gaps If the goal is really to bring more Indians online, Starlink should not still be sitting on the sidelines after nearly five years
453
237
52
1,714
337,526
Bytes and United retweeted
Samsung open-sourced a method that shrinks 13B parameter LLM into less than 1 GB. It's called "LittleBit" Instead of storing AI weights as standard numbers, they used latent factorization to crush them down to extreme sub-1-bit levels. In some configurations, they hit 0.1 bits per weight. But here is where the architecture gets crazy. When you compress an AI this much, you can stop doing math. Instead of forcing the hardware to do heavy floating-point multiplication, LittleBit replaces the core computation with a bitwise XOR operation. It swaps complex matrix math for basic sign flips. The results rewrite the rules of model deployment: • Unlocks a massive 11.6x inference speedup relative to standard FP16 models. • Radically reduces memory footprint and loading bandwidth. • Maintains robustness in extreme sub-0.5 bit regimes where previous compression methods catastrophically fail. This is not a clever optimization. It is the blueprint for running massive, state-of-the-art AI locally on cheap, resource-constrained devices.
159
608
132
4,667
230,867
Bytes and United retweeted
Starlink will be of great help to areas of India that have bad or no Internet and even no mobile coverage. No country has perfect coverage, including America, but Starlink can fill in the coverage gaps for those who most need it.
In my village, there has been no mobile network coverage since Independence. Once, when I went home, a friend from the Supreme Court, who is now a Senior, sent me birthday wishes. I never received the message because there was no network. After I returned, the friend got angry with me for not even replying to the message. I explained that I had no network, but the friend thought I was lying.
6,201
3,719
1,313
31,435
20,150,814
Bytes and United retweeted
“As long as the earth remains, there will be planting and harvest, cold and heat, summer and winter, day and night.” Genesis 8:22
57
40
6
1,224
51,285
Bytes and United retweeted
Suppose that once a week, ten men go out for beer and the bill for all ten comes to £100. If they paid their bill the way we pay our taxes, it would go something like this: The first four men (the poorest) would pay nothing. The fifth would pay £1. The sixth would pay £3. The seventh would pay £7. The eighth would pay £12. The ninth would pay £18. And the tenth man (the richest) would pay £59.  So, that’s what they decided to do. The ten men drank in the bar every week and seemed quite happy with the arrangement until, one day, the owner caused them a little problem. “Since you are all such good customers,” he said, “I’m going to reduce the cost of your weekly beer by £20.” Drinks for the ten men would now cost just £80. The group still wanted to pay their bill the way we pay our taxes. So the first four men were unaffected. They would still drink for free but what about the other six men? The paying customers? How could they divide the £20 windfall so that everyone would get his fair share? They realized that £20 divided by six is £3.33, but if they subtracted that from everybody’s share then not only would the first four men still be drinking for free but the fifth and sixth man would each end up being paid to drink his beer.  So, the bar owner suggested that it would be fairer to reduce each man’s bill by a higher percentage. They decided to follow the principle of the tax system they had been using and he proceeded to work out the amounts he suggested that each should now pay. And so, the fifth man, like the first four, now paid nothing (a 100% saving). The sixth man now paid £2 instead of £3 (a 33% saving). The seventh man now paid £5 instead of £7 (a 28% saving). The eighth man now paid £9 instead of £12 (a 25% saving). The ninth man now paid £14 instead of £18 (a 22% saving). And the tenth man now paid £49 instead of £59 (a 16% saving).  Each of the last six was better off than before with the first four continuing to drink for free.  But, once outside the bar, the men began to compare their savings. “I only got £1 out of the £20 saving,” declared the sixth man. He pointed to the tenth man, “but he got £10!“  “Yeah, that’s right,” exclaimed the fifth man. “I only saved a £1 too. It’s unfair that he got ten times more benefit than me!”  “That’s true!” shouted the seventh man. “Why should he get £10 back, when I only got £2? The wealthy get all the breaks!”  “Wait a minute,” yelled the first four men in unison, “we didn’t get anything at all. This new tax system exploits the poor!” The nine men surrounded the tenth and beat him up.  The next week the tenth man didn’t show up for drinks, so the nine sat down and had their beers without him. But when it came time to pay the bill, they discovered something important – they didn’t have enough money between all of them to pay for even half of the bill!  And that’s how it works. Tax them too much, attack them for being wealthy and they just might not show up anymore. In fact, they might start drinking overseas, where the atmosphere is somewhat friendlier.  For those who understand, no explanation is needed. For those who do not understand, no explanation is possible.
179
1,086
127
4,681
228,479
Bytes and United retweeted
Ser marxista a los 17 años es la rebeldía esperable. Ser marxista a los 20 es divertirte haciendo activismo mientras tus padres te mantienen. Ser marxista a los 25 es porque ya tienes el cerebro completamente lavado. Ser marxista a los 30 es porque estás mendigando una plaza del Estado. Ser marxista a los 35 es porque ya conseguiste tu plaza. Ser marxista a los 40 es porque ya te acostumbraste a ser un parásito del Estado. Ser marxista a los 50 significa que ya no tienes esperanza de cambiar, te gustó la vida de parásito. Ser marxista a los 60 es aceptar que tu ideología nunca se hará realidad pero ya es tarde para cambiar. Ser marxista a los 70 es preparar a tus nietos para que continúen la tradición familiar de parasitar del Estado. 🧐 Y así hasta el final, una vida desperdiciada ideológicamente, pero al menos con el consuelo de haber sacado una buena tajada de dinero ajeno.
110
587
38
2,008
61,890