The progress that's been made in local AI this year isn't comprehensible until you visualize it. Hopefully this helps!
Shoutout to @liquidai @Alibaba_Qwen @GoogleDeepMind for driving many of these gains.
Loci retweeted
this launch is WAY bigger than "AI privacy"...
for the last three years, every AI assistant has worked the same way
you type a message, it travels to a data center, a giant model answers, and a copy of the conversation stays on someone else's server (incredibly dangerous if someone gets access)
that one design choice shaped everything about how we use AI:
- privacy became a setting you have to go find, instead of something built in
- your chats can end up stored, reviewed or used to train the next model
- every answer costs the company server time, so you pay a subscription and still hit message caps
- it stops working the second you lose signal
we accepted all of that because the good models were too big to run anywhere else
that's the part that just changed
a free model running on a Mac through Loci now outscores Claude Opus 4.6 on the Artificial Analysis Intelligence Index
for everyday writing, summaries, files and planning, the laptop you already own is enough
once the AI runs on your own hardware, the rest of the trade-offs fall away with it
your chats stay on your device, so there's nothing to train on and deleting a chat deletes it
there are no servers to pay for, so it can be free with no cap. and it keeps answering on a plane or in a dead zone
local AI has existed for a while, but it lived in apps built for tinkerers
what Loci is doing now is the piece that makes it mainstream: putting it inside iMessage, WhatsApp, Telegram, Discord and Slack, the places people already talk all day
the honest truth though... the hardest reasoning problems still need the biggest cloud models, and a phone runs a smaller model than a high-end Mac
so I don't think the cloud goes away
i think the default flips
your personal, everyday AI runs on your own machine, and the data center becomes the thing you call for the heavy lifting
that's a very different industry from the one we've been building toward, and I'm curious how fast the big players respond
The greatest trick OpenAI ever pulled was convincing the world that sacrificing your privacy is the price of using AI.
We think that's insane.
Introducing Loci: your own private AI, inside the apps you already use.
→ text it from iMessage, WhatsApp, Telegram, Discord and Slack
→ runs 100% on your own computer
→ chats never leave your machine
Try it free: askloci.ai/chat
Best arbitrage play ever by Hark
if you're curious what your $30 pizza "cost you", this is what @hark_labs had on me after less than 48hrs:
-934 gmail messages
-415 calendar events, including 1 yr into the future
-177 contacts it scraped from gmail and calendar events
-33 refreshes of the "home card"
I'm not against giving these personal assistant tools the keys to some of my accounts, but we all need reminders of what the "cost" of these are
you can see this for yourself in the Hark app by:
taping your initials icon on the top right
then System Preferences
then Data Management
then Export your data
then Request
we're entering a very dangerous era for AI subscriptions, where a free assistant running on your own laptop can match the models you're paying for, and there is NOTHING they can do about it
Loci runs entirely on your device, works offline, and your chats never leave it. soon you'll be able to message it from iMessage, WhatsApp and Slack
🤝 Paid partnership
The greatest trick OpenAI ever pulled was convincing the world that sacrificing your privacy is the price of using AI.
We think that's insane.
Introducing Loci: your own private AI, inside the apps you already use.
→ text it from iMessage, WhatsApp, Telegram, Discord and Slack
→ runs 100% on your own computer
→ chats never leave your machine
Try it free: askloci.ai/chat
Of course cloud assistants whose business is acquiring as much of your data as possible will give you $30 of pizza for your entire email history. That’s the deal of a lifetime for them.
This app is insanely farming your entire life when you order this pizza.
I connected my Gmail to order a pizza, and afterward the AI casually admitted it had collected information about my family, closest friends, businesses, travel habits, loyalty programs, favorite restaurants, and even Citi Bike usage.
How fucked up is it that an AI agent tasked with ordering a pizza is digging through your entire personal life?
This is a massive privacy problem with AI agents.
Loci retweeted
people don’t consider the amount of data big tech labs are harvesting right now. Very glad to see solutions like this popping up as alternatives. Long Loci!!!
The greatest trick OpenAI ever pulled was convincing the world that sacrificing your privacy is the price of using AI.
We think that's insane.
Introducing Loci: your own private AI, inside the apps you already use.
→ text it from iMessage, WhatsApp, Telegram, Discord and Slack
→ runs 100% on your own computer
→ chats never leave your machine
Try it free: askloci.ai/chat
This kind of quality content is only free on X... thanks @Lihong062 for the kind words.
if your thesis around chips / neoclouds is something like "long chips not because AGI/ASI but because of widespread inference adoption" then you REALLY should pay attention to local AI
a year ago, local AI was about as non-consensus as it got and that was when @mwaldman130 started building; it's quietly turning consensus now among top SV VCs and most people still haven’t noticed
The reason it’s so slept on is that almost nobody outside AI research realizes the implications of the fact that that MOST of a frontier model is EMPTY
look inside a trained model and most of the weights are tiny numbers sitting near zero and only a small minority does the heavy lifting
you can see this in the open-weight Chinese labs (we suspect this is the case for Anth / OAI models but can't confirm for obvious reasons): DeepSeek V3 has 671B parameters but uses only 37B (~5%) for each token it writes while the rest sits idle
so you can shrink a model a lot before it gets meaningfully dumber: there are three main ways
1) Distillation (teacher → student)
you train a small model on a big model’s answers
if you own the teacher, the student doesn’t just learn “the answer is cat” but also sees the teacher’s full guess: 90% cat, 8% dog, 2% fox
that’s far more signal per example, so the student picks up the teacher’s judgment, not just its outputs
2) Pruning
you cut the useless weights, i.e. both individual neurons and even whole layers that barely matter, then retrain briefly so the model "heals"
researchers have removed half the weights from 175B-parameter models in one shot with almost no measurable loss
3. Quantization
each weight is trained as a 16-bit number but you can round it to 4 bits and the model will need a QUARTER of the memory with almost no loss in performance
a 27B model goes from ~54GB (may need data center) to ~14GB (need just your laptop), and a 3B model at 4-bit is ~1.5GB, which fits on a phone
stack all three (plus a few other technical tricks) and you get a 27B model that runs on a laptop, beating Opus 4.6 on agentic coding, at well under 1/100th of Opus’s rumored size.
WHY THIS MATTERS
!!Consumer AI doesn’t need to live in a data center!!
MOST of what people actually use AI for (emails, summaries, search, docs, basic coding) is well within reach of a model on your device
there’s also no good reason to keep sending your medical questions, finances and DMs to someone else’s server to get it
I’m personally still long AI, but I DO NOT think everyday consumer or business demand is a reason to be long data centers
I’m almost certain ~95% of daily usage ends up running locally (try @askloci for a week and you’ll see how close it already is to frontier models)
the ONLY reason I’d personally stay long chips and data centers is recursive self-improvement into artificial superintelligence i.e. fast takeoff and building the machine god
if you believe that happens in 2027, or within the next few years, then the capex trade is still the bargain of the century
if you don’t, you really should sell your AI infra because without the machine god, most of that buildout is worth only a fraction of what you’re paying
There's a new version of this post
Ever needed a medical term explained different ways before it made sense?
Loci's on-device chat has no message quota.
askloci.ai/










