General Folders is an identity- and policy-aware transport layer for B2B data, replacing hacky SFTP, email, and ad-hoc pipelines. Backed by top innovators 📈

🗄
Joined October 2021
🆕 New podcast episode is out today, covering some of the frequently asked questions about General Folders. Thank you @JakeSearch and @MatchRelevant for having @djpardis on your podcast, we loved the episode! :) youtu.be/UEofjLSMKrQ
3
7
4,174
General Folders retweeted
it’s incredible to me that downloading csv files and globbing them together into a pretty Google Sheet is still the preferred way to share data for so many people
4
1
1
11
468
General Folders retweeted
A few years ago I needed to transfer data between hospitals both using Epic via hand carried CD ROM.
2
2
1
61
2,595
Who's in a reading mood this Friday? @djpardis wrote about the evolution of software engineering from FORTRAN to LLMs to better understand the AI coding milestones underway. It includes an in-depth look at major AI coding milestones. djpardis.com/blog/2026/02/20…
1
6
469
General Folders retweeted
Replying to @matsonj @kellabyte
But also a great idea
1
2
175
General Folders retweeted
Replying to @kellabyte
Totally agreed. Very good idea.
1
5
495
General Folders retweeted
Now that ELT is so popular instead of ETL, the industry could use a standard protocol to define how raw replication of data is defined. CDC is too fractured. We need a way to replicate to down stream systems that connects as easily and reliably as replication typically does.
6
4
37
4,135
General Folders retweeted
when I found out bank transactions are cleared by ftp-ing files
207
240
98
7,954
560,849
What an honor to rep @TechstarsSDSU alongside Misti Cain, Cathy Pucher, and the founders of StoryTap and Sigen AI! 💚
220
General Folders retweeted
I uploaded 25+ new data engineering notes in preparation for my next book chapter #DataAssetReusabilityPattern. The notes go from Apache Arrow Flight Protocol to Slowly Changing Dimensions Type 2. Here are some highlights: ↠ Apache Arrow Flight for efficient data transfer ↠ Apache Iceberg and ACID transactions for reliable data lakes ↠ Data locality and parametric pipelines for optimized processing ↠ WASM and the Declarative Data Stack for modern architectures ↠ Microservices, Protobuf, and schema registries for robust data systems ↠ Time travel capabilities and SCD Type 2 implementations And much more. If you like these things, have a look at the «Data Engineering Vault»—links to dedicated notes below (including 8+ notes related to the Finding Flow article). Stay tuned for the next book chapter coming out soon.
1
6
49
2,604
General Folders retweeted
Replying to @GeneralFolders
"its literally a filing cabinet, inc"
1
1
109
General Folders retweeted
Building a Google Drive clone and it's pushing my disdain towards file systems to an all time high. "Folders" are an arbitrary way to organize files. There are so many weird behaviors we just take for granted. Why can't a file be in another file? Why can't a folder have two parents? Why can't I filter for files that exist in two different folders?
345
42
56
2,491
436,407
General Folders retweeted
Replying to @jovan______
If folders worked as tags and not as hard filters, the “abstraction” would make way more sense. When you put something in a folder, it can no longer be in any other folder. There’s a failure in specificity and in locality. The “single location” nature makes them nearly entirely useless outside of software dev architecture and URLs. If you get too specific with how you break down your folders, everything becomes impossible to find outside of multi-directory search If you don’t get specific enough, you are basically just reinventing file extensions WinFS should have been completed and it breaks my heart it never was released
40
7
13
331
154,735
Thank you for supporting us this past year! ♥️ Wishing you all an excellent 2025! 🎇🥳
1
91
This excellent post discusses data platform options when working with your customers and vendors. Thank you for the shoutout @criccomini! And we're loving the preview image! 😍🗂
1
393
General Folders retweeted
they won't tell you this in DE school but the easiest way to fix missing data is to drop and do a nightly backfill...
they won't tell you this in SRE school but the easiest way to fix a memory leak is to restart your pods on a schedule
1
1
7
807
General Folders retweeted
Founders underestimate the power of truly listening to users Users are the ones who will determine your success
6
3
37
1,505
This excellent post discusses data platform options when working with your customers and vendors. Thank you for the shoutout @criccomini! And we're loving the preview image! 😍🗂
1
393
General Folders retweeted
Replying to @rahulj51
Excuse me? We are using sftp nowadays!!!
1
1
8
416