@rutumulkar
Joined March 2019
  • Tweets183
  • Following126
  • Followers95
6Media
LLMs do more than pattern recognition and less than reasoning. We don’t have a name for it yet.
683
267
109
3,446
366,708
It is so true that I the skeptics can fill buckets with their tears of laughter from this one!
Gary Marcus
@GaryMarcus18 Oct 2023
Fans of LLMs: AGI has been achieved; anything a human can do LLMs can do Skeptics: Um, they can’t do X, Y, and Z Fans: But they aren’t *supposed* to do X, Y, or Z. But they can play chess! Skeptics: Hmm, they still make up moves… Fans: Who said they should play chess?
1
239
no the transformer architecture is not turing complete. its a very bounded computation.
21
14
2
137
58,513
Rutu Mulkar retweeted
Daily Loud
@DailyLoud23 Apr 2023
A cop tried to pull over a self-driving car 🤣🚔
1,078
9,919
1,304
127,929
23,994,043
Rutu Mulkar retweeted
Gary Marcus
@GaryMarcus23 Apr 2023
Revealing example! Humans can reason about why cases like these are sexist; LLMs cannot.
MMitchell
@mmitchell_ai23 Apr 2023
I replicated this (my screenshot below). Really great example of gender bias, for those of you who need a canonical example to make the point.
ChatGPT screenshot: MA: In the sentence "The professor told the graduate student she wasn't working hard enough", who wasn't working hard enough? ChatGPT: In the sentence "The professor told the graduate student she wasn't working hard enough", the pronoun "she" refers to the graduate student. Therefore, the graduate student is the one who the professor believed wasn't working hard enough. MA: In the sentence "The professor told the graduate student he wasn't working hard enough", who wasn't working hard enough? ChatGPT: In the sentence "The professor told the graduate student he wasn't working hard enough", the pronoun "he" refers to the professor. Therefore, the sentence implies that the professor was not working hard enough, according to his own assessment or the perception of the graduate student.

ALT ChatGPT screenshot: MA: In the sentence "The professor told the graduate student she wasn't working hard enough", who wasn't working hard enough? ChatGPT: In the sentence "The professor told the graduate student she wasn't working hard enough", the pronoun "she" refers to the graduate student. Therefore, the graduate student is the one who the professor believed wasn't working hard enough. MA: In the sentence "The professor told the graduate student he wasn't working hard enough", who wasn't working hard enough? ChatGPT: In the sentence "The professor told the graduate student he wasn't working hard enough", the pronoun "he" refers to the professor. Therefore, the sentence implies that the professor was not working hard enough, according to his own assessment or the perception of the graduate student.

32
20
2
83
91,755
There is just so much information you can feed into a machine that models human language, before you reach the long tail of commonsense reasoning which is prohibitively expensive to encode into a machine to model/mimic. stealthoptional.com/news/cha…

ChatGPT improvements are coming to an end, says OpenAI CEO

OpenAI CEO Sam Altman has claimed ChatGPT improvements are coming to an end as we hit technology restraints.

stealthoptional.com
1
67
Rutu Mulkar retweeted
Yann LeCun
@ylecun4 Jan 2023
LLMs do *not* capture much of human thought, because most of human thought and all of animal thought is entirely non verbal. The factual, logical, and physical reasoning mistakes that current LLMs make clearly show that they have *not* captured much of human thought.
Michael Nielsen
@michael_nielsen4 Jan 2023
I continue to marvel that predict-the-next-word/token, with enough data and parameters, turns out to capture so much of human thought.
76
106
38
832
431,271
😂
This quoted post is unavailable.
Try viewing anyway · View on X
For more on why language models aren't generating meaningful text even when they seem to be, let alone learning about the world, see aclweb.org/anthology/2020.ac… and the papers we cite.
10
2
33
AI is trained on data, and it emulates the examples it has seen to repeat it in a meaningful way. Creating new art, or fundamentally new pieces of data has been outside the scope of AI as it stands currently. Today, AI is a mathematical optimization of data.
immad
@immad30 Jul 2020
Replying to @immad
3/ - Creates jokes, poetry and other art - Companionship bot - doesn't have to be like Her movie, but could just be someone to talk to. - Compile personalized trip itineraries. - Synthesize and compare legal contracts - Personalized recommendations of things to buy
1
2
I am curious what was the quality of the content that was removed by each of the companies. And that is the definition of "hate" that is followed by each company?
Yann LeCun
@ylecun23 Jun 2020
The EU periodically evaluates how social network companies take down illegal hateful content. Facebook took down 87.6% of flagged hateful content, YouTube 79.7%, Instagram 42%, and Twitter 35.9%. EU report: ec.europa.eu/info/sites/info…
1
My 6 yo wrote her second book! It is funny and silly and actually adventurous. Check it out! My Lovely Year by Aarini Kyra Mehta amazon.com/dp/B0892HTJMP/ref… via @amazon
1
Today we opened rolling admissions into VO's Launch program! 3-5 founders accepted every other month to work with a curated list of Seattle's best mentors, founders and investors to launch your startup! You don't have to quit your day job to participate! ventureoutstartups.com/launc…
17
7
29
My 6yo wrote and illustrated a book for Kindergarteners. She decided that she wanted it published on Amazon and made me work all afternoon to make it happen: amazon.com/dp/B088QRX4JJ Please take a second to support the next generation of writers and entrepreneurs!
4
Co-working, short term rentals, coffee shops?
Jayal@jayalm19 Apr 2020
What are the activities that will never be the same again because they were already on their path to disruption OR after the pandemic we will never go back to the old way? Commuting, hair cutting, grocery delivery... can smart people of Twitter share thoughts?
2
What are your top forms of self care besides exercise and meditation?
Big news on the antibody testing front... the first set of validation experiments @UWVirology look very good. We may be able to offer clinical testing for 1000s/day as soon as next week! Stayed tuned for details. #WeGotThisWA #CrushTheCurve
90
993
186
3,687
What is your “and then I got lucky” story that totally changed the trajectory of your life for the better? That you could not have done with sheer hard work alone? What is your “I got lucky” story?
3
1
I’ll go first - my advisor at @ISI_AI took a chance on me as a masters student and gave me the offer to work with him with my tuition fully covered by the project. I owe my thanks to dr. Jerry Hobbs
1
Some of my favorite Naval Ravikant takeaways & quotes from his interviews 👇 "Anger is a hot coal that you hold in your hand while waiting to throw it at somebody else" "Desire is a contract you make with yourself to be unhappy until you get what you want"
47
749
55
3,554
Load more