@DeltaLakeOSS

Delta Lake is an open-source storage framework that enables building a Lakehouse architecture for Spark, Flink, Trino, Hive, Scala, Java, Rust, Python, & more!

San Francisco, CA
Joined April 2019
Hi all! Thanks for tuning in. Have questions? Let us know 👇 👇
1
132
Join us next Tuesday for the Delta Lake Community Meetup! 🎉 Stephen Carman (@databricks) will cover Deletion Vector support in Change Data Feed using Kernel, Tyler Croy (Buoyant Data) will share key features and enhancements in delta-rs 1.0. Bring your questions for a live Q&A with the maintainers. 🗓️ Tuesday, Sept 8 🕒 9:00 AM PT Register 👉 luma.com/delta-7kbm #DeltaLake #OpenSource #OpenLakehouse
2
8
1,198
3 weeks out: Open Lakehouse + AI Meetup is coming to Paris! 🇫🇷 Agenda: 🔹 @unitycatalog_io (You Can Go Your Own Way....Go Your Own Way) 🔹 @omnigent_ai — A Meta Harness for AI Agents 🔹 AI Agents at Every Scale: Personal, Team, and Data Workflows Then networking, light bites & swag. 📅 Wed, Sept 23 | 6:00–9:30 PM CEST 📍 La Fondation | Paris, FR 🎟️Register: usergroups.databricks.com/ev… #OpenLakehouse #AI
1
4
7
809
Delta Lake 4.4.0 is out! 🙌 It simplifies engine integrations for catalog-managed tables via Delta Kernel and the UC Delta APIs. Delta Spark now defaults to Spark 4.2. Identity columns in CREATE TABLE. Flink primary-key upserts. 🔗 Learn more: delta.io/blog/2026-08-20-sim… #DeltaLake #ApacheSpark #OpenSource
3
19
1,590
Mark your calendars! 🗓 The Delta Lake Community Meetup is back on Tuesday, September 8 at 9:00 AM PT. Here’s what we’re covering: 🔹Delection Vectors Support in CDF using Kernel – Stephen Carman (@Databricks) breaks down technical updates & key challenge fixes 🔹delta-rs 1.0 – Tyler Croy (Buoyant Data) highlights the latest features and major updates RSVP 👇 luma.com/delta-7kbm #deltalake #opensource #oss
1
10
616
delta-explain: Making Delta Lake File Pruning Visible, and Testable in CI nitter.cf/i/broadcasts/1jGXgBjOv…
1
4
486
Hey all! Thanks for being here - what questions do you have? Drop them in the comments below. 👇
236
1 week away ⏳ delta-explain: Making Delta Lake File Pruning Visible, and Testable in CI See how Delta Lake file pruning is attributed to partition pruning and data skipping from transaction-log metadata, then turn that analysis into a CI contract before regressions hit production. 📅 Aug 18 | 9AM PT (virtual) 🎟️ Register: luma.com/delta-odhl #DeltaLake #OpenSource
1
1
4
772
Open Lakehouse + AI is coming to Paris! 🇫🇷 Join the open source and data engineering community for an evening on open lakehouse and AI architectures. A great fit if you care about how open table formats, catalogs, and AI systems fit together. 📅 Wednesday, Sept 23 | 6:00–9:30 PM CEST 📍 La Fondation, Paris 🎟️ Register now → usergroups.databricks.com/e/… #DeltaLake #Omnigent #OpenLakehouse #UnityCatalog
1
2
6
508
📣 Join us for the next Open Lakehouse + AI Meetup! On the agenda: 🔹 Modern Analytics at GPU Speed: Accelerating Spark, Delta Lake, Iceberg, and Spark Connect 🔹 A Unified Future for Delta Lake and Apache Iceberg 🔹 Panel: Connecting the Open Lakehouse and AI Ecosystem 🔹 Networking with light bites 🗓️ Wed, October 7 📍 Bellevue | @databricks office 🎟️ Register: luma.com/open-qljr #OpenLakehouse #DeltaLake #ApacheIceberg #ApacheSpark
1
2
1
8
962
Join us August 18 for delta-explain: Making Delta Lake File Pruning Visible, and Testable in CI! 📣 We’ll cover a small open-source CLI on delta-kernel-rs that makes pruning visible, measurable, and assertable: 🔹 Partition pruning and data skipping, explained per file 🔹 Analysis from transaction-log metadata, with no query execution 🔹 A live demo and CI gate with a threshold and exit code 🔗Register: luma.com/delta-odhl #DeltaLake #OpenSource #DataEngineering
431
Introducing the UC Delta API in Unity Catalog 0.5 👇 🔹 Versioned, discoverable, atomic REST surface. 🔹 Native Delta wire format and intent-based commits. 🔹 Run it locally with Spark or DuckDB. Read the full post: unitycatalog.io/blogs/unity-… #UnityCatalog #DeltaLake
1
3
295
Join us for the next Delta Lake Community Meetup, where we'll discuss the latest in the Delta ecosystem! 👇 🔹 Delta Kernel Logical Plans and new logical-plan-based APIs 🔹 UC Managed Tables and new UC Delta APIs 💬 Live speaker Q&A 📅 August 11 🕘 9 AM PT 🔗 RSVP: luma.com/event/evt-WoZ2NBOIf… #DeltaLake #OpenSource #UnityCatalog
1
6
468
Catalog-managed Delta 4.3: Spark streaming + CDF + catalog-driven batch CDC 👇 🔹 All standard streaming read options 🔹 Replay via CHANGES FROM VERSION/TIMESTAMP 🔹 Delta Sharing CDF for shared tables 🔗 Learn more: delta.io/blog/2026-06-22-del… #DeltaLake
2
8
700
File pruning in Delta Lake is usually invisible until the bill shows up. 👇 Join us for our next webinar (Aug 18) where we'll cover: 🔹 delta-explain CLI on delta-kernel-rs (metadata only, no query run) 🔹 Demo: two layouts, one query. CI gate before prod regressions RSVP: luma.com/delta-odhl #DeltaLake
4
495
The single canonical stack is giving way to composable, interoperable lakehouses. In this clip, @lisancao and @newfront cover format choice, glue code, and what comes next. 👀 Full video: youtu.be/dEFAkS7vYV0 #DeltaLake #OpenLakehouse
3
5
730
Delta Lake: The Definitive Guide book signing at Data + AI Summit 2026 was a big success! 📚 @dennylee, @newfront, Tristen Wentling, and Tyler Croy were busy signing copies and meeting community members, with a line stretching across the expo floor. Thank you to the 300+ people who waited in line for a physical book and connected with the authors. 🙌 Here's to everyone building with Delta Lake. #opensource #deltalake #oss #dataaisummit
1
4
667
Delta 4.3 extends catalog-managed tables with Unity Catalog REST APIs. 👇 🔌 Intent-based catalog commits 🔄 Atomic incremental UniForm 📡 CDC streaming + Row Tracking Apache Spark, DuckDB, Apache Flink + Delta-Kernel on one catalog. 🔗 Read more: delta.io/blog/2026-06-22-del… #DeltaLake #ApacheSpark #OpenSource
1
5
1
19
4,836