Massimiliano Petrucci (@makxs) profile picture

Don't do much talking here, but plenty of listening.

Manhattan, NY
Joined August 2008
Photo by Massimiliano Petrucci (@makxs)Photo by Massimiliano Petrucci (@makxs)Photo by Massimiliano Petrucci (@makxs)Photo by Massimiliano Petrucci (@makxs)Photo by Massimiliano Petrucci (@makxs)Photo by Massimiliano Petrucci (@makxs)Photo by Massimiliano Petrucci (@makxs)
Massimiliano Petrucci retweeted
Saying that LLMs using the chain of thoughts and an harness to execute tools is a symbolic systems (in the sense they claimed was needed VS LLMs), to avoid saying to be wrong, is *the worst* mystification that ever happened in the history of science. Never forget.
14
37
2
529
41,802
Massimiliano Petrucci retweeted
Imagine if you talked by picking the next word to be the one people most often say after your previous words.
142
74
53
765
254,650
Massimiliano Petrucci retweeted
Yes, I've made this point many times. The beginning of a sigmoid looks like an exponential. Not only can we "never be fully certain that what we are observing isn't in fact following a logistic trend before the inflection point", we can always be fully certain that *every* *single* *exponential* *trend* eventually passes an inflection point and saturates into a sigmoid. Continuing an exponential trend beyond that inflection point requires a paradigm shift. No physical process can grow indefinitely. There are always friction terms in the dynamics equation that eventually become dominant (energy consumption, heat dissipation, quantum effects, thermal fluctuations, communication bandwidth, mass/energy density....). Even processes that *appear* exponential on a long time scale are actually a succession of sigmoids, in which each new sigmoid is caused by a paradigm shift. A good example is Moore's Law. It is saturating right now. But the exponential progress of the last 7 decades is due to a succession of technological paradigm shifts that weren't pre-ordained. Each paradigm behaved like a sigmoid. Each new sigmoid overtook the previous one. The envelope turned out to be exponential. We haven't seen similar paradigm shifts in, say, airplane speed or space travel. Technological paradigm shifts require scientific breakthroughs.
Like everyone else I am extremely excited and optimistic about AI progress. But since there seems to be the misconception that it is really easy to make predictions about the future for exponential trends (let's just draw lines on a log scale), this is a reminder that while observing an exponential trend (e.g. compute or neural network parameter increases), we can never be fully certain that what we are observing isn't in fact following a logistic trend before the inflection point. Before the inflection point, both trends look the same.
166
436
82
3,284
679,921
Massimiliano Petrucci retweeted
Did you know that it’s actually possible for you to say, “I don’t know enough about this to have an opinion”
173
4,658
399
24,213
Massimiliano Petrucci retweeted
For those few of you still using Sun equipment, remember not to look directly at it during today's eclipse.
7
3
20
Massimiliano Petrucci retweeted
Best lab at #WWDC17
9
94
11
432
Massimiliano Petrucci retweeted
So much great Sample Code at this year's WWDC. Download it all with this script: github.com/jfahrenkrug/WWDC-… RT for fellow attendees #WWDC17
3
82
1
194
Heading to #WWDC!!! 🛫🛫🛫✈️✈️✈️ #WWDC17
Massimiliano Petrucci retweeted
We are never right, we can only be sure we are wrong.
6
309
21
493
Massimiliano Petrucci retweeted
La propaganda politica stia alla larga dalle mie canzoni. vascorossi.net/it/news/la-pr…
54
208
17
710
Massimiliano Petrucci retweeted
Want to watch WWDC videos a little bit faster? Open Web Inspector and evaluate this JS: document.querySelector("video").playbackRate = 1.4;
4
40
2
100
Heading to WWDC!!! ✈️✈️✈️ #wwdc #wwdc16 #WWDC2016 – at New York, NY
1
Massimiliano Petrucci retweeted
The last programming book you'll ever need
116
10,242
69
9,340