Saying that LLMs using the chain of thoughts and an harness to execute tools is a symbolic systems (in the sense they claimed was needed VS LLMs), to avoid saying to be wrong, is *the worst* mystification that ever happened in the history of science. Never forget.
Massimiliano Petrucci retweeted
Imagine if you talked by picking the next word to be the one people most often say after your previous words.
Massimiliano Petrucci retweeted
Yes, I've made this point many times.
The beginning of a sigmoid looks like an exponential.
Not only can we "never be fully certain that what we are observing isn't in fact following a logistic trend before the inflection point", we can always be fully certain that *every* *single* *exponential* *trend* eventually passes an inflection point and saturates into a sigmoid.
Continuing an exponential trend beyond that inflection point requires a paradigm shift.
No physical process can grow indefinitely.
There are always friction terms in the dynamics equation that eventually become dominant (energy consumption, heat dissipation, quantum effects, thermal fluctuations, communication bandwidth, mass/energy density....).
Even processes that *appear* exponential on a long time scale are actually a succession of sigmoids, in which each new sigmoid is caused by a paradigm shift.
A good example is Moore's Law. It is saturating right now. But the exponential progress of the last 7 decades is due to a succession of technological paradigm shifts that weren't pre-ordained.
Each paradigm behaved like a sigmoid. Each new sigmoid overtook the previous one. The envelope turned out to be exponential.
We haven't seen similar paradigm shifts in, say, airplane speed or space travel.
Technological paradigm shifts require scientific breakthroughs.
Like everyone else I am extremely excited and optimistic about AI progress. But since there seems to be the misconception that it is really easy to make predictions about the future for exponential trends (let's just draw lines on a log scale), this is a reminder that while observing an exponential trend (e.g. compute or neural network parameter increases), we can never be fully certain that what we are observing isn't in fact following a logistic trend before the inflection point. Before the inflection point, both trends look the same.
Apple’s Worldwide Developers Conference is back in its all-online format - Apple apple.com/newsroom/2021/03/a…
Massimiliano Petrucci retweeted
Did you know that it’s actually possible for you to say, “I don’t know enough about this to have an opinion”
Massimiliano Petrucci retweeted
For those few of you still using Sun equipment, remember not to look directly at it during today's eclipse.
Massimiliano Petrucci retweeted
So much great Sample Code at this year's WWDC. Download it all with this script: github.com/jfahrenkrug/WWDC-… RT for fellow attendees #WWDC17
Massimiliano Petrucci retweeted
La propaganda politica stia alla larga dalle mie canzoni.
vascorossi.net/it/news/la-pr…
Massimiliano Petrucci retweeted
Want to watch WWDC videos a little bit faster? Open Web Inspector and evaluate this JS:
document.querySelector("video").playbackRate = 1.4;
I'm at Facebook NYC in New York, NY swarmapp.com/c/19ELg1qOBu7 – at Manhattan, NY
2




















