I work for Eventual (https://xitter.cf/t.co/RleQl75XNe). Building Scenario Mining & Curation for Robot Fleets. Opinions are my own.
San Francisco, CA
Joined March 2009
- Tweets1.2K
- Following366
- Followers159
- Likes440
This integration is extremely valuable; I look forward to it being used by everyone working with multimodal data and models. ❤️
Wow the team at @daftengine cooked!
You can now read/write to 🤗Hugging Face with Daft!
> DataFrame engine in 🦀 runs distributed and supports multimodal datasets to train/eval models
Best part: it's optimized for Xet, the dedupe-based HF storage that makes uploads crazy fast!
Varun Madan retweeted
🚨 Announcing Open Engines™, a quick + reliable way to deploy @trinodb, @raydistributed, and @ApacheFlink making it easy to choose the right engine for analytics, streaming, or ML/DS.
Read the details👉
onehouse.ai/blog/announcing-…
Varun Madan retweeted
Even Iceberg is faster with Delta Lake... 🤣
#ApacheIceberg #DeltaLake
Delta UniForm is extremely easy to set up, and once it's enabled it works fast, seamlessly, and automatically!
Delta UniForm has negligible performance and resource overhead, ensuring optimal utilization of computational resources.
🔗Learn more: hubs.la/Q02f_W6p0
#oss
Varun Madan retweeted
📢 NEW RELEASE
Hudi 1.0.0-beta1 is out 📢! This release brings database-like qualities to the data lake!
🔐 Non-blocking concurrency control for high streaming writes
🎾 Filegroup reader & Page Skips
🗂️Functional indexes
🌲 LSM-tree-based timeline
Varun Madan retweeted
This @AWSOpen blog w/ Onehouse makes it easy to leverage open source on #AWSCloud! Onehouse accelerates build of a Universal Data Lakehouse with MSK, RDS, S3, EMR, Athena, Glue, Redshift. Powered by #apachehudi #apacheiceberg, #deltalake and @OnetableOSS
aws.amazon.com/blogs/opensou…
Great blog by @andywalner on how a managed data lakehouse gets you to your goals much faster than a DIY approach.
Are you building a data lakehouse? Check out this guide to help you consider tradeoffs between a DIY approach vs. a managed solution. Learn how you can get your lakehouse off the ground faster 🚀
onehouse.ai/blog/building-a-…
#datalakehouse #apachehudi #apacheiceberg #deltalake
Live demo the day after launch is the way to do it! Super excited and proud of the Stream Designer launch! #Current22
Varun Madan retweeted
There's that saying that if you "wrote the book on something" you know your stuff. It's not true. You know your stuff when you wrote the thing that someone else wrote the book on.
Below is how Kafka actually works by the guy who (more than anyone) actually wrote Kafka!
Ready to advance your @apachekafka knowledge to the next level? Take @junrao's free Kafka internals course—newly available on Confluent Developer—to learn about Kafka's architecture, design mechanics, producers, consumers, partitions, and more: cnfl.io/free-apache-kafka-in…
ALT apache-kafka-internals-course-by-jun-rao
I am extremely fortunate to be working with such inspirational women across Confluent and working together to #BreakTheBias and built an equitable workplace! Happy International Women's Day!
#BreaktheBias #WIN-erg #IWD #WHM #Confluent
Varun Madan retweeted
SOMEONE LEFT A FULL PLATE OF COOKIES. AND A GLASS OF MILK. RIGHT BY THE FIREPLACE FOR ME. I AM NOT KIDDING. WHAT A NIGHT
Varun Madan retweeted
Great to see #StreamingAudio featuring our SIGMOD paper!
Is it possible to achieve correctness guarantees for stream processing? On the latest episode of #StreamingAudio, @guozhangwang and @tlberglund discuss @apachekafka’s core design for reimagining #streamprocessing. Take a listen 🎧 cnfl.io/rethink-stream-proce…
Varun Madan retweeted
Six years ago we built an entirely new data infrastructure to set #datainmotion. Our journey is built on the passion, energy, and dedication of our team, community, customers, and partners. We’re here because of you, THANK YOU! ow.ly/sLKb50FhPiY #ConfluentIPO
Let's go team!
🔔 Ringing the bell at @Nasdaq!
We’re incredibly proud of our team, and thankful for our customers, partners, #ApacheKafka community, and everyone who made this day possible. This is only the beginning of our journey to set the world’s #datainmotion. #ConfluentIPO
