Measuring the Invisible

Joined July 2013
mikhail samonov retweeted
Stanford professor Judy Fan went on stage at MIT and broke down why humans are so good at making the invisible visible... And why AI hasn't actually learned to "see" the way we do. It completely changes how you think about Human Intelligence v/s Artificial Intelligence: 1. Nature never gave us straight lines or sharp corners. The number line, the coordinate plane, even basic geometry are all human inventions. We created tools that do not exist in nature simply because we needed a way to think more clearly. 2. The coordinate system Descartes invented solved a problem that had stumped mathematicians for centuries, doubling the volume of a cube. Once invented, this tool became so indispensable that virtually every math curriculum on Earth still depends on it. 3. Humans have been doing this for at least 30,000 to 80,000 years. The story of human progress is inseparable from the story of marking up our environment, from cave walls to Galileo's telescope to Feynman diagrams of particles we will never see with our own eyes. 4. Every major scientific breakthrough relied on a visual tool that made something invisible visible. Darwin needed side-by-side illustrations of finches to see variation that was otherwise too subtle to notice. Cajal needed detailed drawings of neurons under a microscope to map how the nervous system was wired. 5. Fan's research group studies something deceptively simple: how people decide what to put into a drawing and what to leave out. When two people played a drawing game, sketchers used far more detail when the target object had close competitors than when it stood alone, all the way down to using fewer strokes and less time when more detail was not necessary. 6. People are not just copying what they see. They are making constant judgment calls about what level of detail actually serves the goal of communication, and they do this naturally without ever being taught the theory behind it. 7. There is a real difference between drawing something so someone can identify it and drawing something so someone can understand how it works. In one study, participants drew explanatory diagrams that emphasized moving, causal parts of a machine while depictive drawings emphasized background and overall appearance, even though both were drawing the exact same object. 8. Explanatory drawings were genuinely better at helping someone figure out how to operate a machine, but worse at helping someone identify which machine it actually was. You cannot optimize a single drawing for both goals at once. Communication always involves tradeoffs. 9. AI vision models trained on photographs generalize surprisingly well to simple, sparse sketches, suggesting that resemblance based recognition is not just a story we tell ourselves. It is something modern neural networks can replicate with real accuracy. 10. But there remains a large, measurable gap between how confidently AI models recognize sketches and how confidently humans do, even when both groups answer the same questions about the same images. Humans are simply far more reliable and far more consistent in their judgments. 11. When researchers compared human-made sketches to AI-generated sketches under tight stroke budgets, both were similarly recognizable at higher budgets, but diverged sharply as the budget shrank. Humans and AI systems simplify drawings in fundamentally different ways once resources get scarce. 12. Reading a graph is not one single skill. It involves perception, knowing where to look, mapping that visual information onto the actual question being asked, and then translating that mapping into an answer. Each of these steps can independently break down, and people fail for very different underlying reasons even when they land on the same wrong answer. 13. When tested directly against humans on graph reading tasks, leading multimodal AI models, including GPT-4V, showed a meaningful performance gap. Even when a model's overall accuracy approached human levels, its pattern of mistakes looked nothing like how humans actually get things wrong. 14. People choose entirely different types of charts depending on what specific question they are trying to answer, not out of a generic preference for bar charts or scatter plots. Their chart choices closely tracked which visualization would genuinely help someone answer that specific question correctly. 15. Two of the most widely used graph literacy tests in education research turned out to correlate strongly with each other, suggesting they measure overlapping skills. But when researchers dug into the actual error patterns, the standard categories used in textbooks, like "find the maximum" or "identify a cluster," failed to explain why people got things wrong nearly as well as a more basic, underlying four-factor model did. 16. The deepest goal behind all of this research is not just academic curiosity. It is to eventually help students and everyday people develop genuine literacy with the visual tools that science and modern decision-making increasingly depend on, because every generation should be able to see further than the last by standing on the visual tools the previous generation built. Follow @yasminekho for more ideas on thinking better, becoming clearer & building a more intentional life.
73
1,176
68
7,245
895,275
good use for my ai assistant -
72
"only 3.2% of high-AI papers are ultimately accepted compared to 12% of low-AI papers" - calnewport.com/easy-is-overr…
1
5
840
Check out my latest post on this year’s Nobel Prize in Economics, my “out-of-the-box” college hypothesis on what might cause the next leap in human life expectancy, and whether AI—without a human body—can truly innovate. twocenturies.com/blog/2025/1…
1
2
212
mikhail samonov retweeted
S&P 500 price targets at the start of the year
150
220
68
1,694
418,533
Russian stocks have been on a tear vs US since election.
1
200
the next biggest FOMO for people is going to be longevity biohacking - thoughts?
2
143
This chart just says it all...
2
1
1
8
810
mikhail samonov retweeted
There are many ways to invest well, here’s how to choose the right one for you. @msamonov #mebfaber #mebfabershow #investing #stocks #stockmarket
1
1
928
mikhail samonov retweeted
A lot of people hold a massive bear bias because that is what is “comfortable”. @msamonov #mebfaber #mebfabershow #investing #stocks #stockmarket
1
1
880
mikhail samonov retweeted
If you’re going to apply momentum, watch out for the beta exposure of your portfolio because it’s going to sneak up on you! @msamonov #mebfaber #mebfabershow #investing #stocks #stockmarket #momentum #quant #quantitativeinvesting
1
2
950
Value's long-run crash chart updated for @RobinWigg latest piece on Quant Winter ft.com/content/e0f98278-432e…
1
9
2
42
35,289
Breaking news: The OpenAI drama is real. We checked our data and last night, SF saw a spike in low-quality sleep. There was a 27% increase in people getting under 5 hours of sleep. We need to fix this. Source: @eightsleep data
369
428
583
6,954
4,232,549
mikhail samonov retweeted
Sam Altman has been fired as CEO of OpenAI theverge.com/2023/11/17/2396…
36
75
63
551
163,814
That’s beyond a zoo, it’s chaos - “Analyzing 563 trillion possible models, we find that the majority of tradable factors designed to price bond markets are unlikely sources of priced risk” - The Corporate Bond Factor Zoo papers.ssrn.com/sol3/papers.…
1
4
613