Weekly Data Engineering Newsletter. Subscribe to https://xitter.cf/t.co/trebyY8UGX | Wanna talk about Data engineering? Book Me here https://xitter.cf/t.co/OXj3VJheDH

Joined November 2020
Quick SQL quiz. A user signs up, comes back on day 6, then on day 8. Day-7 retained: yes or no? Answer in the replies. Try it first, free: leetdata.ai/problems/day-n-r… #dataengineering #sql
1
2
377
Answer: no. Exactly day 7 means exactly, so day 6 and day 8 count for nothing. Join on activity_day = signup_date + 7, not a range, and the equality enforces "exactly" for free.
46
Affirm processes billions in credit risk and checkout workflows every day. How do they handle real-time ML inference without crashing checkout latency? They built an isolated "Intelligence Layer." 🧵👇
1
1
401
• Agentic & Multi-Model Scoring: Dynamically routing risk, fraud, and credit logic.
1
83
Want daily data engineering breakdowns, system architectures, and paper teardowns sent directly to your phone? Join our new Data Engineering Weekly WhatsApp Channel! 🚀 👇 Join here: [whatsapp.com/channel/0029Va9…]
52
🚀 Apache DataFusion can now leverage Apple Silicon GPUs for massive query speedups! By registering a single optimizer rule via ArrowMetal, full SQL sorts run 6.9x to 28.8x faster on Apple Silicon—without changing a single line of SQL. 🧵👇 dataengineeringweekly.com/i/…
1
274
🛡️ Smart Guardrails: The rule evaluates warm/idle GPU costs and hand-back cases (e.g., complex float NaNs or streaming Top-K queries where CPU is better). If conditions aren't optimal or memory limits trigger, it seamlessly falls back to standard CPU execution.
1
35
💡 Key Takeaway: GPU-accelerated analytics on Mac hardware is becoming plug-and-play. Registering physical optimizer rules allows high-performance Rust data frameworks like DataFusion to unlock massive speed gains effortlessly.
39
🚨 Stop preparing for Data Engineering interviews like a Software Engineer. Data engineering is different. That’s why we built LeetData (leetdata.ai)—an interview program made just for DEs. 💻🔥
🤖 Made with AI
1
3
473
✅ AI Mock Interviews with real-time feedback ✅ Question banks from top-tier companies (Google, Amazon, Databricks, Snowflake, Uber) Quit just reading theory. Start coding, building, and modeling your way to your next big offer.
1
74
How do you migrate Europe’s largest data lake without turning the lights off? 💡🛢️ We unpacked Booking.com's massive migration strategy in our latest feature. Read how they pulled it off in Data Engineering Weekly #291! 👇
1
2
245