Product, Design, Health @StanfordHCI @ycombi @UofMaryland @CMUhcii Founder, Spire Health (acq by Wellinks) Founder, Stanford Calming Tech Lab
San Francisco, CA
Joined March 2008
- Tweets3.4K
- Following409
- Followers1.7K
- Likes195
Excited to see agents tackling mechinterp..
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
already-clean.goodfire.com/
Neema Moraveji retweeted
Working on a little site for beautiful UI, specifically crafted for AI native products.
beautiful-ui-five.vercel.app
Neema Moraveji retweeted
Form: docs.google.com/forms/d/e/1F…
If you'd like to donate or match so more people can attend, reply or DM me.
Neema Moraveji retweeted
Take a look into what TreeHacks was like this year! Dagsen + team captured the essence perfectly
We went to America's top hackathon (@hackwithtrees) to see if @dagsen could predict the grand prize winner before the judges made up their minds.
Was he successful? Find out in our latest video!
00:00 Introducing Treehacks
00:38 AI-powered chemistry
01:06 Remote surgery hardware
01:41 A prediction market for the hackathon
02:30 Dagsen’s strategy
03:10 Rescue robot
03:27 Semi-autonomous diving robot
03:44 AI-powered dancing game
03:49 Packing optimizer powered by AI
04:00 Control a computer with your mind
04:17 Turn any vehicle into a self-driving car
04:57 AR help for Alzheimer’s patients
05:15 Tool to block addictive social media features
05:50 Checking back in with the robot surgery team
06:26 Putting Claude Code agents into AR
06:50 And the winner is…
Neema Moraveji retweeted
Wow! Unexpected results from Anthropic's experiments in exposing the inner thoughts of Claude. They call its unconscious a J-space. The short video they made is good place to start. anthropic.com/research/globa…
My Y’s FSD is not just a great driver, it’s a great evaluator of the driving of others:
When it swerves a bit to avoid another driver, I know that (statistically speaking) they likely screwed up.
“Success” is a double-edged sword.
Brian talks about considering what you want to *do* - not who you want to *be*. The work, not the title. The impact, not the compensation.
It took me a roundabout way to get there - but I’m glad to be home.
Brian Chesky shares why the saddest day of his life happened the day after Airbnb went public at $100B:
"We go public, we have a hundred billion dollar valuation. It's one of the best days of my life. The next day, I go on a Zoom meeting, and it was like it never happened."
"It became like the saddest day of my life. Because I realized, I got all this adulation, and I don't feel any different."
"Adulation is like a cup with a hole at the bottom. You keep filling it in, thinking it's love, except it just keeps coming out the bottom."
"That made me reevaluate what I'm doing this for. I want to do things for pure intrinsic reasons. Do the work like you used to do, like when you were a kid. It was light. Just make stuff. Make it for yourself."
"So many entrepreneurs focus on what they want to be. "I want to be a giant tech founder. I want to run a billion-dollar company." Instead of focusing on, "What do I want to make."
There's no way to fail if you're making what you love."
Neema Moraveji retweeted
Today we’re announcing our new Mentava Basics curriculum, aimed at kids who are still a bit too young for the standard Mentava curriculum.
Here’s what people don’t understand about teaching a 2 or 3 year old to read:
The necessary skills for reading don’t all develop at the same time.
The ability to associate letters with sounds happens first, and at a pretty early age. If you think about it, learning “this funny shaped animal says moo” is pretty similar to learning “this funny shaped line says aaa.”
However, the second necessary skill for reading is blending those letter sounds together, and kids often aren’t developmentally capable of doing that until at least 6-12 months later.
Until today, our recommendation has been to wait until the child is developmentally ready to blend sounds. and then we just go full speed and teach them everything all at once, as fast as possible.
But sometimes we have students who start a little younger. And then their parents are confused, because they see that their kids are having a ton of fun learning letter sounds super fast, but then are being gatekept from additional learning because they aren't yet developmentally ready to blend those sounds.
That’s why we created the new Mentava Basics curriculum. Mentava Basics lets our youngest students focus on letter/sound pairings until they're developmentally ready to begin blending them.
Mentava Basics takes the fun and delight of the core Mentava experience, but applies it to a curriculum that’s developmentally appropriate for even younger children. Mentava’s standard curriculum is still the fastest way to go from zero to reading, but with Mentava Basics now we can give kids a head start by helping them learn their letter sounds in advance.
If your child is struggling with blending and you think it may just be a developmental readiness issue, you can use the grownup menu to switch into the Mentava Basics curriculum. We save your progress on both pathways, so you can switch back to our standard curriculum whenever you want.
#NeurIPS2024 is happening this week in Vancouver! This amazing visualization lets you explore the hundreds of conference posters.
Suggestion: Hovering is slow—when zoomed, displaying keywords (e.g., PCA clusters) could make browsing easier. Check it out: neurips2024.vizhub.ai/
Just got the Bay Area tsunami warning but, based on the map, this kind of tsunami seems more likely where we are.
Neema Moraveji retweeted
LLMs still can't plan.
Llama-3.1-405b and Claude can plan a bit on Blocksworld.
GPT4 and Gemini not so much.
Performance is abysmal for everyone on Mystery Blocksworld.
The latest LLM performance on PlanBench (arxiv.org/abs/2206.10498) via @karthikv792. While they all bite the dust on Mystery BW, it is notable that the 400bn free open source model LLaMA3.1 does quite well compared to the costly closed models marketed as masters of reasoning..
Neema Moraveji retweeted
Join Aashish Mody at #ViVE24 as he highlights @SpireHealth 's groundbreaking approach to patient monitoring. With a device that requires no charging and can be worn continuously, Spire Health is transforming patient care, reducing hospitalizations, and improving outcomes for both patients and providers. #HealthcareInnovation #PatientMonitoring
Neema Moraveji retweeted
When thinking of #COPD, older men who were chronic smokers often come to mind. However, what might be surprising is more women are being diagnosed with the condition.
This #COPDMonth, stay up to date on lung health & certain conditions that affect women: nhlbi.nih.gov/BreatheBetter/…
I'll be doing a COVID-themed guided meditation for UX professionals tomorrow.
This week's webinar is: A Guided Reflection for UX Professionals. This 30 minute special webinar may be just what you need. uxpa.org/upcoming-webinars/ #ux #meditation #calm #quarantine #uxchat
First-known study to uncover the #breathing of #COPD patients at an unparalleled level of precision and timescale.
Made possible via Health Tags from Spire Health and a collaboration with researchers at ResMed. lnkd.in/gNWFtPG
Have you heard of COPD?
You know, the *3rd leading cause of death* in the US (and set to grow quickly)?
Beyond exercise, take the time to get to know the force that moves your lungs, brain, and heart – your breath. cdc.gov/copd/basics-about.ht…