Aligned superintelligence.
San Francisco
Joined April 2022
- Tweets36
- Following0
- Followers17.9K
- Likes98
Magic retweeted
Working at Magic feels very different from what I hear from people who reached out to us at other labs. We all sit in the same room. We're a tiny team. Everyone just does whatever is important.
Imagine running RL runs for days without compaction. Imagine agents learned from you, across all sessions (and imagine not repeating yourself a million times like a maniac).
Man, I'm so excited for the day we get to share the product experiences we are working on.
Magic retweeted
Very excited to welcome @karpathy as Magic's latest investor!
Magic retweeted
The era of long context is upon us. The question is whether you want to be 1 of 1000 co-authors on the Gemini paper or 1 of <20 building at Magic.dev
Needle in a Haystack tests
The tech report also details a number of microbenchmark “needle in a haystack” tests (modeled after @GregKamradt’s github.com/gkamradt/LLMTest_…) that probe the model’s ability to retrieve specific information from its context.
For text, Gemini 1.5 Pro achieves 100% recall up to 530k tokens, 99.7% up to 1M tokens, and 99.2% accuracy up to 10M tokens.
Magic retweeted
I have been continuously in awe of the brilliance, tenacity, and kindness of @EricSteinb and the small but mighty team at Magic.dev. So much so that we've decided to invest $100m!
If you're interested in building the future, please do reach out to me or the team!
Magic.dev has trained a groundbreaking model with many millions of tokens of context that performed far better in our evals than anything we've tried before.
They're using it to build an advanced AI programmer that can reason over your entire codebase and the transitive closure of your dependency tree. If this sounds like magic... well, you get it.
Daniel and I were so impressed, we are investing $100M in the company today. The team is intensely smart and hard-working. Building an AI programmer is both self-evidently valuable and intrinsically self-improving.
If this sounds interesting to you, consider joining them!
Magic retweeted
I love my team a lot and sometimes it’s stressful but life has never been so fulfilling. If you want to build AGI on a small team of people who care a lot with thousands of GPUs, please apply :) Magic.dev
We've raised $117M from @natfriedman and others to build an AI software engineer.
Code generation is both a product and a path to AGI, requiring new algorithms, lots of CUDA, frontier-scale training, RL, and a new UI.
We are hiring!
Magic retweeted
5M tokens of context. Let that sink in.
Yes, there's caveats. But consider what's to come:
- Entire codebases in prompts
- Novel-length spec docs as instructions
- k-shots where k = 10K
- Few-shots where each "shot" is 50K LoC → diff
Those who declared the imminent death of prompt engineering before long-context models existed have betrayed a lack of imagination. We have not yet begun to prompt.
Magic retweeted
👀 Magic.dev showing a sneak peak of their 5M token context code model.
Magic retweeted
AI with long-term memory!
*A lot* of work left to do but happy to share a little more about what we've been up to.
It's been incredibly fulfilling to work with a wonderful team and the trust of our backers towards this milestone. Thank you for the opportunity <3
Magic retweeted
Incredibly excited about what @EricSteinb is doing. Most excited I’ve been for a while about something. Honored to have been the first yes
Magic retweeted
Magic is a company worth paying attention to. Our bar for investing in something competitive to CoPilot was really high. This is a special team that impressed us and many other discerning eyes.
Announcing Magic's $23 million Series A to build an AI software engineer: magic.dev/blog/series-a
@CapitalG (Alphabet), @natfriedman (fmr CEO GitHub), @eladgil, @Amplify, many others.
We're hiring! magic.dev/join
