The query engine for agents. Unified query language, built-in context management, sub-second responses, zero infrastructure
San Francisco, CA
Joined August 2025
- Tweets14
- Following27
- Followers13
- Likes12
Released v0.9.0 — 2026-10-07
Focus: Performance and correctness hardening.
• Materialized statistics CTE, hoisted casts, and partition pre-filtering cut file listing ~400×: 2,703 → 6.8 ms.
• UPDATE pushes predicates into Parquet; keyed DELETE reads only predicate columns (~10 KB vs. 14 MB). Catalog-based counts with delete files; one read per cold footer.
• Added DuckLake comments/tags, more object-store URL schemes, batch file registration, and snapshot metadata.
github.com/datafusion-contri…
Hotdata.dev retweeted
The benefits of ASF Stewardship of open source projects such as @apachedatafu are perhaps are more relevant than ever
Here is the playlist of San Francisco DataFusion meetup.
Thanks to all the presenters from:
@LangChain @LakeSail @columnar_tech @datadoghq @hotdata_dev
youtube.com/playlist?list=PL…
cc: @andrewlamb1111 @ApacheDataFusio
New features in the CLI: fork your database like a Git branch.
We’ve also added a dialect option to the query command, so you can run queries using DuckDB, Postgres, or Snowflake syntax.
We've released major updates to datafusion-ducklake.
• Time travel by snapshot or timestamp
• Partition-aware writes and updates
• Atomic multi-file commits
• Improved CDC support for renamed and nested columns
• SORTED BY for writes, updates, and compaction
Check it out at:
github.com/datafusion-contri…
Hotdata.dev retweeted
⏳ Just 2 days until the next @ApacheDataFusio Meetup in San Francisco!
Hear how engineers from @datadoghq, @lakesail, @LangChainAI, @hotdata_dev, @columnar_tech, and more are building with Apache DataFusion. Join @andrewlamb1111 and the community for an evening of technical talks and networking.
Register: bit.ly/4xcudyI #InfluxDB
Hotdata.dev retweeted
@ApacheDataFusio meetup in San Francisco next week Aug 13. I won't be there but the speaker line up is amazing.
luma.com/gk3s2vib
See you there!
📍 San Francisco: the next @ApacheDataFusio Meetup is coming up on August 13!
Join InfluxData's @andrewlamb1111 for an evening of technical talks spotlighting real-world applications, performance innovations, and evolving integrations, featuring speakers from @datadoghq, @lakesail, @LangChainAI, @hotdata_dev, @columnar_tech, and more. #influxdb
Register to reserve your spot: bit.ly/4xcudyI
Hotdata.dev retweeted
We're really excited to be teaming up with our friends at Hotdata and hosting an @ApacheDataFusio meetup at our new SF office on Aug 13th!
The LangChain team will be giving a talk on how we built SmithDB.
We'll also have some great speakers: Divya Ranganathan, Alexander Bianchi, Shehab Amin, and Emil Sadek
If you're interested in modern data systems, you won't want to miss this. Register here: luma.com/gk3s2vib
Hotdata.dev retweeted
We’re back and this time with @LangChain!
After a packed Apache DataFusion meetup in Feb and May, we’re making this a quarterly series in San Francisco.
August 13 @LangChain office, SOMA
Featuring Talks from @columnar_tech, @hotdata_dev, @LangChain, @datadoghq, @LakeSail covering observability, APIs, distributed execution + more.
RSVP: luma.com/gk3s2vib
See you there!
@eddietejeda @andrewlamb1111 @ankush_gola11 @amadaecheverria
We're really excited to be teaming up with our friends at Hotdata and hosting an @ApacheDataFusio meetup at our new SF office on Aug 13th!
The LangChain team will be giving a talk on how we built SmithDB.
We'll also have some great speakers: Divya Ranganathan, Alexander Bianchi, Shehab Amin, and Emil Sadek
If you're interested in modern data systems, you won't want to miss this. Register here: luma.com/gk3s2vib
Hotdata.dev retweeted
The @ApacheDataFusio 54.0.0 release (2 months of development had 139 distinct contributors. 🤯 github.com/apache/datafusion…
Hotdata.dev retweeted
Here is a new blog about Parquet Variant, including use case, and shredding examples
parquet.apache.org/blog/2026…
Hotdata.dev retweeted
Simply applying basic linting rules (like don't compress pages where it doesn't help) reduces parquet files sizes by 5% and decreases decode time by 20%.
@MOVNTDQ shows how in his latest blog
blog.xiangpeng.systems/posts…
🔥
DuckLake + DataFusion, an intriguing combination github.com/hotdata-dev/dataf…
