Pinned Tweet
The sole legitimate purpose of an economy is to improve lives. It is not the purpose of a life to improve the economy.
👀
I did tell @tylercowen that if forced to pick a market price as indicator of the singularity, it would be sovereign debt yields. If the “gradual disempowerment” future is real, its way will likely be paved by very high interest rates.
Jace Kohlmeier retweeted
old dogs new tricks olddogs.ai
Jace Kohlmeier retweeted
Replying to @jessesingal
LLM that’s trained solely on Modest Mouse, Death Cab for Cutie, and The National and becomes too withdrawn and awkward to take over the world
While I'd quibble with a few details of this presentation-- better to use Joules per completed task--batching and speed noramalizations are still enormous updates to my mental model. I've been reading these power comparisons for a long time. Kinda embarassed that I missed this.
This number is way off. You’re comparing one human brain to an entire data center capable of training new models. The actual answer is:
IQ points per watt:
Humans: 5
AI: 7 - 40 (!!)
By my rough calculations the current AI is already served more efficiently than humans for equivalently intelligent work performed!
A single gpu can produce outputs and parse inputs way faster than a human and can do many of such requests in parallel. A larger model generally mostly means you need more gpus to serve it, but that often also increases how many requests you can serve in parallel, so I’m reporting on the share of the serving system, and also normalizing for speed.
Really a better way to measure and report it is joules per equally good completed task, as your formulation suggests we can likely add more watts to get more iq, which isn’t correct.
I did some back of the napkin calculations based on the latest serving hardware and the most powerful open source models. But even given pretty generous assumptions it turns outout computers come ahead. For example the request is allocated approximately 60 W while running, but finishes a task in about one-seventh of the human time.
It's worth pointing out that practically speaking, the alternative to a sane regulatory regime isn't "no regulation." We are experiencing rapid improvements in capabilities, have multiple providers with differing levels of safe guards, and are at the point now where small things are starting to go wrong. The scope of AI capabilities are growing rapidly, and the scope of possible damage is going to grow with them.
Think for a second about what happens when the first actually bad and "politically gripping" incident occurs? Not Hugging Face, but something that makes the average person really scared. This isn't about extinction, think a human initiated, AI-orchestrated cyberattack that sabotages one piece of infrastructure that results in at least one person dying. The reaction will be violent.
Our political system doesn't work well at proactively handling purely theoretical problems, but reacts very fiercely and sometimes irrationally when something bad actually happens.
The August 2001 CIA memo "Bin Laden Determined to Strike in US" got little response, but buildings falling down changed the course of history.
An industry whose wealth and power is widely resented, that resists even the most innocuous and common sense safeguards, and then causes a significant incident, will see a violent reaction. This will result in a regulatory regime designed in a moment of populist outrage by people with little understanding of what will help, whose primary goal will be crushing AI progress as an end in its own right.
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: darioamodei.com/post/we-must…
Jace Kohlmeier retweeted
Todd Beamer was the passenger on United Airlines Flight 93 who rallied fellow passengers to fight back against the 9/11 hijackers with the phrase "Let's roll" and stopped it from reaching Washington, DC.
This is his daughter, Morgan, who was born 4 months after his death and went on to play women's soccer at his alma mater, Wheaton College.
Imagine how proud he would be. 🇺🇸 #neverforget
Jace Kohlmeier retweeted
This strategy won't pan out for hard tech. Investors need to care just as much as founders that more water actually falls out of clouds, electrons flow out of a power plant, lithium comes out of the brine, energy is stored in the battery, etc. The industrial tourists who would be just as fulfilled bidding up cartoon monkey JPEGs will not have the stomach for the ups and downs of building real-world companies, and founders building civilizationally important technology are going to get left stranded.
Jace Kohlmeier retweeted
Replying to @bgurley
Yes! But also we should do "five how's" in response to any talk of pacing and alignment.
Jace Kohlmeier retweeted
Replying to @MollyJongFast
The facts no longer broadly support anti-datacenter arguments.
Working class America was devastated by the outsourcing of manufacturing to China. You are now implicitly supporting the outsourcing of intelligence to China. This would be so much worse.
No impact on people with fancy degrees and lots of money, but would be terrible for ordinary Americans.
Working class Americans deserves a bipartisan consensus on this.
Proud of the partners that have trusted us, proud of the work we’ve done, and we’re having a blast. AI done right is fun.
What I’ve been up to with @derandomized: olddogs.ai
Jace Kohlmeier retweeted
What I’ve been up to with @derandomized: olddogs.ai
Jace Kohlmeier retweeted
Cloudflare, Vercel, Uber, LaunchDarkly, and others are building software factories.
I looked at how they work, the results so far, and what's next: will agents be prompting us?
igoro.com/archive/software-f…
Trading and investing reveal all of your qualities, good or bad.
Impatience, impulsiveness, fear, greed, ego, overconfidence, insecurity, indecision, stubbornness, discipline, humility, patience, self control, adaptability.
Markets have a way of exposing all of it.
Jace Kohlmeier retweeted
Of course Rep. Ro Khanna bought Moderna $MRNA on 6/30
Jace Kohlmeier retweeted
Yes, this. Instead of pacing/pausing, we should figure out what gates ought to be cleared, and take as much time as we need to clear them—and no more.
By analogy, we don't “pace” drug development, we do RCTs. You market your drug when it passes clinical trials, no sooner/later.
Really good to see this. IMO this ⬇️ is by far the best way to think about "pacing the frontier"—not as some fixed amount of time (e.g. "six month pause" or "go 10% slower"), but simply making sure that enough time is taken to meet a reasonable safety/assurance bar.
If all parties do that—whether by choice or because they have to—then there you have it, the frontier has been paced.



























