XetHub enables ML teams to collaborate effectively on massive datasets. Now part of @HuggingFace 🤗!
Joined March 2022
- Tweets62
- Following13
- Followers408
- Likes15
Pinned Tweet
Big news: We’ve closed a $7.5 seed round led by @MadronaVentures! We talked to @fredericl of @TechCrunch about our fundraise and how XetHub gives developers a faster and easier way to work with data via a Git-enabled way: techcrunch.com/2023/01/09/xe…
XetHub retweeted
We're turning @huggingface Hub's files into content-defined chunks to speed up your workflows!⚡️
This means:
- 🧠We store your file as deduplicated chunks
- ⏩ You only upload changed chunks when iterating!
- 🚀 Pulling changes? Only download changed chunks!
XetHub retweeted
Sweet visualization of S3 PUT requests to @HuggingFace Hub over a 24-hour period, showing upload density across the globe. 🌏
XetHub retweeted
Did you know that @Huggingface Hub holds over 29 PB of Git LFS files across datasets, models, and spaces? 📈
That's the equivalent of 64 @CommonCrawl downloads - and it's growing every day. So what's inside? 🧵
XetHub retweeted
Welcome, Gradio 5 👋
We’ve been hard at work over the past few months, and we are excited to announce today the stable release of Gradio 5!
With more than 2 million users every month (and >470,000 apps on Hugging Face Spaces), Gradio has become the default way to build, share, and use machine learning applications.
Our goal with Gradio 5 was to address the most common pain points that we’ve heard from Gradio developers about taking these apps to production. Here are 5 new things in Gradio 5 (including a new way to build Gradio apps without writing any code!)
XetHub retweeted
Deduplicating evolving datasets is a no-brainer - store differences instead of full versions of each one. But format matters!
Here's how appends, modifications, and deletes on @ApacheParquet files (~20% of what's stored on @huggingface Hub) deduplicate. 🧵
XetHub retweeted
It's the end of an era. We just shut down our @xetdata servers after 658 days in production. 🪦 What did we learn?
xethub.com/blog/shutting-dow…
XetHub retweeted
First demo of a @xetdata-backed roundtrip to/from @huggingface servers = first steps to a faster, more scalable HF Hub! ⚡️🤗
Almost three weeks into our @huggingface experience and loving it! Digging into a POC of replacing Git LFS and exploring developer experiences = our happy place 🤗
🧞♂️ Ever wished you could share an interactive view of your work with a collaborator, instead of static screenshots and long descriptions? 🤓 Wouldn't it be nice to quickly review differences on binary files in the browser like you do with code?
✨ Now you can, with XetHub custom views. Custom views lets you create interactive views that live alongside the files in your repository, bringing instant context to opaque binary files whether you're browsing or comparing files.
🤔 How does your versioning tool stack up to the competition? We benchmarked the iterative development experience of three real-world modern workflows (🎮 game development, 🧬 biotech, and 🧑🔬 research) on S3, DVC, Git LFS, and XetHub. The results?
- 50% savings in average upload times vs nearest competitor
- Better average download times vs competitors
- 50% savings in final storage used vs nearest competitor