
I mostly use different apps now 🦋 @jackbandy.com
Chicago, Illinois
Joined June 2009
- Tweets37
- Following55
- Followers892
- Likes6K
BookCorpus, a key source of training text for early GPT models, over-represented books in the fantasy and "vampires" genres.
We’re talking about Goblins.
openai.com/index/where-the-g…
I don't know the extent to which BookCorpus still influences GPT - it's possible that BookCorpus has not been used to train more recent models.
Then again, maybe the goblins were embedded deep within GPT's weights, and awakened by the "nerdy" personality feature. Who knows?
Either way, wouldn't it be great if we knew a little more about the training data for these models?
Here is the BookCorpus paper I wrote with @nickmvincent back in 2021
arxiv.org/abs/2105.05241
"shopping mode"
Replying to @alexandr_wang
5/ meta ai now handles quick answers and deep reasoning with instant and thinking modes. shopping mode is new too—it picks up on the creators, brands, and styling content across our apps and turns that into recommendations.
I'm stuck on the assumption that we all have phones with 16 GB of RAM
gpt-oss is a big deal; it is a state-of-the-art open-weights reasoning model, with strong real-world performance comparable to o4-mini, that you can run locally on your own computer (or phone with the smaller size). We believe this is the best and most usable open model in the world.
We're excited to make this model, the result of billions of dollars of research, available to the world to get AI into the hands of the most people possible. We believe far more good than bad will come from it; for example, gpt-oss-120b performs about as well as o3 on challenging health issues. We have worked hard to mitigate the most serious safety issues, especially around biosecurity. gpt-oss models perform comparably to our frontier models on internal safety benchmarks.
We believe in individual empowerment. Although we believe most people will want to use a convenient service like ChatGPT, people should be able to directly control and modify their own AI when they need to, and the privacy benefits are obvious.
As part of this, we are quite hopeful that this release will enable new kinds of research and the creation of new kinds of products. We expect a meaningful uptick in the rate of innovation in our field, and for many more people to do important work than were able to before.
OpenAI’s mission is to ensure AGI that benefits all of humanity. To that end, we are excited for the world to be building on an open AI stack created in the United States, based on democratic values, available for free to all and for wide benefit.
We got a whole three sentences about the training data used for these "open" models.
Our open models are here.
Both of them.
openai.com/open-models
Hey by the way I'm on another app 🦋 bsky.app/profile/jackbandy.c…
Jack Bandy, Ph.D. retweeted
JUST IN: LEX 18 is reporting that Amendment 2 in KY is projected to fail.
ARC Prize Daily Puzzle
Task: 22233c11
⏱️🟩⬜️⬜️⬜️⬜️ 0:28 sec
🤔🟩⬜️⬜️⬜️⬜️ 1 attempt
Can you solve it?
arcprize.org/play
I saw a post recently about an AI policy where students caught using ChatGPT had to run a 100m dash against the professor in front of the class.
Was that on here or in my dreams?
Has anyone traced when and why people started referring to ChatGPT generating misinformation as "hallucinating?"
If we're going to go the anthropomorphic route we could have at least tried "bamboozling"
Jack Bandy, Ph.D. retweeted
We talked to more than two dozen Twitter employees about how Elon Musk’s takeover at the company upended their lives and the culture they knew. This is their story:
Twitter’s staff spent years trying to protect the platform against impulsive billionaires who wanted to use it for their own ends — then one made himself the CEO. @ZoeSchiffer , @CaseyNewton , and @alexeheath report, in collaboration with @verge trib.al/FezDnWP











