@MikeDoesData

I’m engineering data in warehouses you’ve never heard of.

 Kansas to Colorado
Joined January 2011
  • Tweets16K
  • Following1.8K
  • Followers2.3K
1.8KMedia
Car dealerships love to send service coupon mailers like “Spend $1000 and we’ll give you $20 off” How about I come beat you to death with hammers
3
107
“Oh shucks, I wish I could pick a value for my random_seed()”
2
166
Michael Gagliano retweeted
Josh Rosen
@JoshARosenOct 5
We should be stealing a lot more from data engineering when we build AI systems. DAGs - does this really need to be one giant agent loop? Lineage - which sources, artifacts, prompts, and model versions produced this? Change detection - if a source changes, which generated artifacts are now outdated? Incremental processing - what can we keep instead of rerunning the whole agent? ETL - what context do we pull in, what does the model do with it, and where do we save the result? Data engineers have been solving these problems for decades.
30
11
9
198
20,529
I love my Garmin Fenix watches, I’ve owned several, their hardware is wonderful. They make the biggest heaps of steaming shit software like you could never believe. Bluetooth and WiFi issues like no tomorrow. Having to reset and re-pair the devices all the time.
3
205
“Postgres doesn’t scale well” Where is your love of the game. The unbridled optimism to figure it out, learn how it works, and hyperoptimize a system. Get pgstats and pgbouncer rolling, and start digging in the query plan. Only then you may pivot to DuckDB and DynamoDB
2
9
303
Kafka with some tombstone events + DLQ and call it a day.
Ananth Packkildurai@ananthduraiSep 1
Saga pattern increasingly becoming the choice of architecture as I’m working through agentic workflow. Now every api should support revoke function.
4
341
Kroger, Walgreens, and CVS. These powerhouse retailers dare ask the question, “What if we just hated all of our customers and made the worst possible experience known to man” Well, folks, let me tell you about Salesforce…
1
3
264
Pockets drenched. Pockets healthy.
1
247
If you are branding yourself as a “UGC” type of account you’re a dork and if you cannot understand why you’re a double dork. Antithesis of authenticity for what, a couple of MLM-esque coins. Boooooooo
1
233
Hey did you know Colorado is the 3rd most expensive state for car registration costs? I lived it!
1
179
The type of shit you find in a Resident Evil game on a desk at the beginning
The New York Times
@nytimesAug 6
Breaking News: Scientists have used A.I. to create new viruses for the first time, raising hopes for medical advances while also raising the possibility that the technology could someday be used to invent dangerous pathogens. nyti.ms/4bxx7Wy

This A.I. Just Created Viruses Not Found in Nature

Scientists trained artificial intelligence on libraries of DNA and then asked the model to create recipes for viral genomes. Sixteen of them were viable, yielding new viruses.

nytimes.com
3
5
518
PlanetScale keeps me excited about data engineering. It always feels like their team, products, and resources show a deep love of the game. That’s it, send tweet.
1
4
280
It’s crazy the energy Chicago has right now. I guess this sort of just happens when people like Lorde, Charli XCX, me, and The Smashing Pumpkins all get together.
6
369
Bug knucks
1
12
351
This is a classic system design question. Here’s a hint folks: It’s at least 3. Like and subscribe
Ben Dicken
@BenjDickenJul 29
How many servers do you think it takes to power Meta? That's BILLIONS of daily active users across Facebook, Instagram, WhatsApp, etc. Hint: helps to think it terms of the human:computer ratio to really fathom the scale.
2
5
2,132
I'm officially moving (back) into MLE (same company!) -- however my team is looking for some backfills now. collectorsuniverse.wd1.mywor… collectorsuniverse.wd1.mywor…
1
2
216
I have it on good authority from Michael Gagliano that it’s Michael Gagliano’s birthday today and that he doesn’t look a day over [REDACTED]
2
16
503
How it feels to have back to back meetings all day long at the long meeting factory
5
324
Any of my fellow peers on here looking for Senior/Staff level Analytics Engineering or Data Engineering roles? My team will soon have the JD’s posted, and I’m happy to connect and be a direct white glove referral for you!
5
2
12
1,069
We are so back
1
160
Load more