Data Scientist @PennMedicine working to improve medicine by predicting the future! https://xitter.cf/t.co/x7INgZwhhN. Also I started DataPhilly https://xitter.cf/t.co/JzMnoRgIIg. Amateur #AIArtist
Black Sun
Joined February 2013
- Tweets4.4K
- Following789
- Followers821
- Likes5.6K
Michael Becker retweeted
I’m a psychiatrist.
In 2025, I’ve seen 12 people hospitalized after losing touch with reality because of AI. Online, I’m seeing the same pattern.
Here’s what “AI psychosis” looks like, and why it’s spreading fast: 🧵
1/5 The recent LMSYS study on chatbot rankings shows why we shouldn't rely too heavily on any single metric for language models. They found significant shifts in rankings when controlling for "style" vs "substance" in responses.
Does style matter over substance in Arena? Can models "game" human preference through lengthy and well-formatted responses?
Today, we're launching style control in our regression model for Chatbot Arena — our first step in separating the impact of style from substance in rankings.
Highlights:
- GPT-4o-mini, Grok-2-mini drop below most frontier models when style is controlled
- Claude 3.5 Sonnet, Opus, and Llama-3.1-405B rise significantly
- In Hard Prompts, Claude 3.5 Sonnet ties for #1 with ChatGPT-4o-latest. Llama-405B climbs to joint #3.
More analysis in the thread below👇
4/5 The takeaway? Don't choose an LM based solely on leaderboards or benchmarks. What matters is how well it performs on YOUR specific tasks and use cases.
Michael Becker retweeted
What can you do with Llama quality and Groq speed? You can do Instant. That's what. Try Llama 3.1 8B for instant intelligence on groq.com.
Michael Becker retweeted
Epic talk on RAG Basics by
@jobergum
from the LLM conf (links to YT, slides, etc in next tweet)
Michael Becker retweeted
We re-ran SEAL evals on the new @AnthropicAI Claude 3.5 Sonnet model.
It is now:
- 🥇 #1 on Instruction Following
- 🥇 #1 on Coding
Congratulations to Anthropic on a great new model!
P.S. we’re adding new evals to SEAL, so if you have an idea for an eval, let us know below 👇
1. Claude 3.5 Sonnet is now #1 in Instruction Following on the SEAL leaderboards (scale.com/leaderboard) 🏆
Michael Becker retweeted
pretty cool approach
1. use LLMs to extract a knowledge graph from your sources
2. cluster this graph into communities of related entities at diff levels of detail
3. for RAG, map over all communities to create "community answers" and reduce to create a final answer
GraphRAG, a graph-based approach to retrieval-augmented generation (RAG) that significantly improves question-answering over private or previously unseen datasets, is now available on GitHub. Learn more. msft.it/6010l8lew
ALT Hexagonal structure with interconnected circles and lines on (left to right) blue, purple, pink gradient background.
Michael Becker retweeted
I've done a deep dive into SB 1047 over the last few weeks, and here's what you need to know:
*Nobody* should be supporting this bill in its current state. It will *not* actually cover the largest models, nor will it actually protect open source.
But it can be easily fixed!🧵
Michael Becker retweeted
Cognitive Computations presents: Dolphin-2.9.3-qwen2-0.5b and Dolphin-2.9.3-qwen2-1.5b
Two tiny Dolphins that still pack a punch! Run it on your wristwatch or your raspberry pi! We removed the coding, function calling, and multilingual, to let it focus on instruct and conversation. Thanks to the team @TheEricHartford, @latkins, @FernandoNetoAi, and compute sponsor @CrusoeAI and our inference sponsor @OnDemandai! Thanks to @Alibaba_Qwen for the excellent base model! Uncensored models say mean things, if instructed to. You are responsible for content you create using it.
Michael Becker retweeted
Mixture of Agents—a framework that leverages the collective strengths of multiple LLMs. Each layer contains multiple agents that refine responses using outputs from the preceding layer.
Together MoA achieves a score of 65.1% on AlpacaEval 2.0.
together.ai/blog/together-mo…
Michael Becker retweeted
Introducing RAGApp 💫
A no-code interface to configure a RAG chatbot, as dead-simple as GPTs by @OpenAI.
It’s a docker container that’s easily deployable in any cloud infrastructure. Best of all, it’s fully open-source 🔥
1️⃣ Setup the LLM: Configure the model provider (OpenAI, Gemini)
2️⃣ Setup the data: Define the system prompt and upload your knowledge base.
3️⃣ Launch the chatbot both via the UI or API
4️⃣ If via the UI, stream intermediate events and also sources!
This is fantastic work by @MarcusSchiesser and is built upon the same DNA as our create-llama project.
Check out RAGApp today: github.com/ragapp/ragapp
9/ SB 1047's stringent regulations and potential impact on AI innovation may drive research and development to other states or countries with more favorable regulatory environments, such as Texas or the United Arab Emirates, threatening California's position as an AI hub.
7/ Developers face severe penalties under SB 1047, including injunctions, damages up to 30% of revenue, and model shutdowns. The bill also expands criminal perjury for knowingly lying in safety reports, creating significant legal risks for AI companies.
1/ California's SB 1047, the "Safe and Secure Innovation for Frontier Artificial Intelligence Models Act," passes Senate, raising concerns over innovation, competition, and free speech. The bill categorizes AI models, imposes requirements, and sets penalties...
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
5/ "SB 1047 similarly enforces restrictions that effectively preclude the development and dissemination of new AI models, it arguably introduces a form of unconstitutional prior restraint on the creation of speech — in this case, code."