🛠️ Building data infra for AI/ML. Ex-Data Scientist @Microsoft. Created DVC, now DataChain. PhD in CS. Serious about data. Less serious about everything else.

San Francisco, CA
Joined October 2011
Dmitry Petrov retweeted
Mitchell Hashimoto
@mitchellh10 Apr 2025
2.5 years into the AI craze, and I continue to firmly believe that if your company wasn’t already interesting/succeeding without AI, then doing “whatever plus AI” isn’t going to save you. For the few that seem this way (eg Cursor), I think their moat is a lot weaker than it seems. You have to play the game and the game is AI, but I don’t think it’s a defensible foundational capability. Might play out as an excellent land and grab strategy to buy you time to fill out the meat though.
30
73
7
975
98,637
Dmitry Petrov retweeted
DataChain enables reproducibility. It versions and tracks dependencies, code. A quick demo from @FullStackML :
1
1
5
1,100
Dmitry Petrov retweeted
gm
3
27
1,450
Thank you to everyone who joined us for the OSPO #InnovateWeek panel on Open Source and AI last week! Special thanks to our panelists: Paige Bailey @DynamicWebPaige, Will Falcon @williamfalcon, Dmitry Petrov @FullStackML, and moderator Nhi Le @ngocnhile.
3
1
10
5,913
Dmitry Petrov retweeted
📰 New article from @FullStackML on @thenewstack The AI hype is cooling, but that's good news. We're shifting from excitement to engineering, focusing on data quality & scalability. This maturation will lead to more reliable, valuable AI across industries. The real AI revolution is just beginning. See the full article: thenewstack.io/prioritize-ro… What do you think? What will it take to get AI to maturity? Let us know! 👇🏽 #AIEngineering #TechTrends
1
5
309
Dmitry Petrov retweeted
🦉 @FullStackML is looking forward to contributing to the panel discussion on how Open Source fosters innovation at Innovate Week @datascience_uw on Thursday with @DynamicWebPaige, @williamfalcon, and @ngocnhile! Find out more: innovate.wisc.edu/uw-madison…
#UWInnovateWeek is here! Join OSPO and DSI for a panel discussion on open source and AI this Thursday, 5-7pm. And check out the @UWInnovate events happening all week: innovate.wisc.edu/uw-madison…
1
7
15
4,429
12
120
11
2,380
239,538
Dmitry Petrov retweeted
1
3
1
23
3,220
🔄 DataChain: Iterative's open-source tool for managing unstructured data. @DVCorg 🛡️ Lakera: AI application firewall to secure traffic in and out of generative AI apps. @LakeraAI 🎮Minecraft: Odyssey framework equips AI agents with advanced exploration skills. @VipaZju
1
4
8
537
Dmitry Petrov retweeted
Who does this 🤔
671
656
153
11,175
758,079
Ok this is pretty slick. The api looks pretty intuitive, and everything gets transparently backed into SQLite for reproducibility. Easy control over (local) parallelism, etc. And Pydantic!
🔗 DataChain open-source release 🤖 AI-Driven Data Curation: Local models, LLM APIs 🚀 GenAI Dataset scale: Millions and billions of files 🐍 Python-friendly: Python objects instead of JSON Try it out github.com/iterative/datacha… 👇1/7
1
2
10
1,095
Dmitry Petrov retweeted
🤝 Nebius AI and DVC.ai announce technological partnership We are thrilled to collaborate with a company that develops such a widely used and significant open-source tool as DVC @dvcorg. Learn more on our blog: eu1.hubs.ly/H09S_v50
3
2
9
1,246
Dmitry Petrov retweeted
2
2
2
6
2,753
Dmitry Petrov retweeted
Want to learn more on deploying RAG (Retrieval Augmented Generation) in Production with: - @langchain for a quick start - @qdrant_engine - @ApacheAirflow And for iterations: - @streamlit - @DVCorg Replay of my talk at GenAI London: aleios.com/talks/great-pract… cc @mattzcarey
3
14
2
60
13,919
Dmitry Petrov retweeted
My greatest fear for the future of AI is if overhyped risks (such as human extinction) lets tech lobbyists get enacted stifling regulations that suppress open-source and crush innovation. Read more in our Halloween special issue of the Batch: deeplearning.ai/the-batch/is…
116
721
127
3,655
989,531
Dmitry Petrov retweeted
Andrej Karpathy
@karpathy28 Sep 2023
With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates: - Input & Output across modalities (text, audio, vision) - Code interpreter, ability to write & run programs - Browser / internet access - Embeddings database for files and internal memory storage & retrieval A lot of computing concepts carry over. Currently we have single-threaded execution running at ~10Hz (tok/s) and enjoy looking at the assembly-level execution traces stream by. Concepts from computer security carry over, with attacks, defenses and emerging vulnerabilities. I also like the nearest neighbor analogy of "Operating System" because the industry is starting to shape up similar: Windows, OS X, and Linux <-> GPT, PaLM, Claude, and Llama/Mistral(?:)). An OS comes with default apps but has an app store. Most apps can be adapted to multiple platforms. TLDR looking at LLMs as chatbots is the same as looking at early computers as calculators. We're seeing an emergence of a whole new computing paradigm, and it is very early.
290
1,830
404
9,087
2,139,637
When you take home all brilliant ideas from @ICCVConference 😅 #ICCV2023
3
14
2,538
Dmitry Petrov retweeted
I got the opportunity to meet Dmitry Petrov @FullStackML at @CVPR. He is the creator of @DVCorg, one of the main tools for our research projects at @CVINSIDE Lab. I'm really glad to have met him, and I'm looking forward to keeping track of his work and collaborating soon.
5
15
940
Dmitry Petrov retweeted
A Good way to start the week. 🎉🚀 Exciting news! The DVC VS Code Extension has just crossed 20,000+ installs! A huge thank you to our amazing community for embracing this powerful and inevitable tool for seamless workflows. 💪🥳
1
5
1
14
5,056