The Tweeted Times retweeted
Physical AI data breaks the usual agent loop.
Tomorrow: Claude Code over raw video, metadata, and expensive compute in S3.
Live demo: 8am San Francisco / 4pm London / 5pm CET
Join us: luma.com/3jjb56bx
The Tweeted Times retweeted
"Metadata marts could play a key role in making video data more accessible and structured for model training and analysis" - Simon Thelin (@synthesiaIO, creator of the DataPains blog) reviewed DataChain 👇
The Tweeted Times retweeted
DataChain organizes and makes your AI data queryable! What does it mean? Why? 👇
The Tweeted Times retweeted
We just can't make tools without lineage, DAGs and versioning apparently 😆
(jokes aside, an important one for team sanity and regulated environments).
DataChain enables reproducibility. It versions and tracks dependencies, code. A quick demo from @FullStackML :
The Tweeted Times retweeted
A small DataChain video on processing audio data from @huggingface with 🤗 models. We need more tools to do ETLs, analytics, governance, preparation for unstructured data at scale!
- stream files from tar or wds archives! 🤯
- enrich, prepare, version, publish datasets 🚀
- bonus! 🤗 is natively integrated like a storage provider!
The Tweeted Times retweeted
What is the trick to make progress bars look decent on Colab? Anyone, from the top of your head? :)
The Tweeted Times retweeted
1/N DataChain hit 2000 stars ⭐ on GitHub a week ago. Thanks for your interest and support 🤗 It was built to address those needs and pain points we saw in the DVC community when people have to deal with millions of files (e.g. images, pdfs, audio, etc).
The Tweeted Times retweeted
DataChain is a modern Pythonic data-frame library to efficiently organize unstructured data.
I haven't tested but it looks really interesting especially because it supports multimodal data and cares about efficiency.
The Tweeted Times retweeted
After trending in Hacker News, our open-source is now trending in GitHub.
What’s next - Netflix special?
github.com/iterative/datacha…
The Tweeted Times retweeted
Datasets + LLMs + Pydantic = DataChain
...now with @huggingface !💛
DataChain by @DVCorg just added @huggingface support ! Create, Load, Transform HF Datasets with LLMs easily.
- Pydantic for dataset schema
- Use your own or public HF Datasets
- Run your own or public HF Models
The Tweeted Times retweeted
DataChain is trending on Hacker News!
news.ycombinator.com
Join the discussion!
The Tweeted Times retweeted
Boom! 🚀Come, join the discussion 🤗
We have been working really hard to rethink how AI changes data space - a lot of cool decisions and tech inside.
DataChain is trending on Hacker News!
news.ycombinator.com
Join the discussion!
The Tweeted Times retweeted
🔬 LLM Project: Process PDFs at scale w/ DataChain & @UnstructuredIO
✂ Extract & parse text
⚙️Create vector embeddings
🚀Scale processing
🔄Version datasets
All in <70 lines of code! 🤯
Perfect if you're working w/ docs.
🎥 hubs.ly/Q02RxKsb0
The Tweeted Times retweeted
🦉Today we launch the DVC Extension for @code in @ProductHunt!
Join us in the celebration of a year's worth of improvements since the original release that turns your IDE into your own personal ML experimentation platform!
producthunt.com/posts/dvc-ex…
🧵1/5
The Tweeted Times retweeted
DVC 3.0 goes beyond the command line!
Introducing the DVC Stack! This release improves DVC's core versioning and experiments functionality and enables new workflows like model registry and cloud experiments, improving the end-to-end model development journey!
🧵1/7
The Tweeted Times retweeted
hey, Twitter disabled their API (made it a paid feature and expensive), since the service was free we are not able to maintain and run it anymore, unfortunately
The Tweeted Times retweeted
Woah! Been here? Is deep learning model training going horribly wrong? 🙋🏽♂️
Iterative Studio makes this easy to see so you don't waste time and resources!
🧵 1/7
The Tweeted Times retweeted
#nanoGPT generating Valentines 💌 t.me/LoveLettersGPTBot
The Tweeted Times retweeted
I love how all these new tools and technologies come nicely together. @flydotio @streamlit and @modal_labs (and our open source MLEM to package a model and deploy) ...
... all of them being extremely easy to use + serverless, even GPUs.
The future is here 🚀🚀🚀
Another example why open source software is great! You can train your own little #ChatGPT model in a couple of minutes using @modal_labs and then deploy it as a @streamlit app to @flydotio via MLEM.ai. More in this blogpost by yours truly iterative.ai/blog/mlem-nanog…
The Tweeted Times retweeted
Who let the dogs fly ... or how to magically Dockerize with MLEM and deploy ML models to @flydotio:
iterative.ai/blog/mlem-cv-mo…

















