Tinybird is a managed ClickHouse® service for AI-native software teams. Get ClickHouse performance without ClickHouse complexity.
Joined April 2019
- Tweets4.7K
- Following310
- Followers8.5K
- Likes3.3K
Paginating large ClickHouse tables with LIMIT and OFFSET is a latency trap.
To fetch page 500 at OFFSET 50000, ClickHouse must scan and discard 50,000 rows. As offsets grow, queries slow down and consume unnecessary memory.
ALT Tinybird endpoint pipe implementing keyset pagination with cursor tuple comparison over MergeTree sorting key columns
Unpredictable event payloads usually force a bad tradeoff: rigid upfront migrations, or raw string columns that waste CPU parsing JSON on every single query.
Tinybird's native JSON data type is now on by default across all workspaces.
ALT Tinybird pipe node extracting typed fields from a native JSON column using dot notation and type casts
Scheduled Copy Pipes can now run on temporary dedicated compute. Add `ON_DEMAND_COMPUTE true` to keep recurring batch work separate from primary workspace compute.
How it works and when provisioning is worth it:
tinybird.co/blog/on-demand-c…
ALT Tinybird Copy Pipe configured to run on a schedule using on-demand compute
Building microservices just to expose ClickHouse queries to your app creates unnecessary plumbing.
In Tinybird, write parameterized SQL with template variables like {{ Int32(hours, 24) }}. Tinybird publishes an authenticated, production REST API instantly.
ALT Tinybird SQL pipe endpoint with dynamic query parameters and quantile latency calculation
Scanning raw events for every dashboard view wastes compute and adds latency.
Tinybird Materialized Views aggregate streaming data on insert. Define a Pipe with countState() or uniqState(), and rows roll up into AggregatingMergeTree tables continuously.
ALT Tinybird Materialized Pipe aggregating streaming events into an AggregatingMergeTree data source
We’re at Rows & Columns Summit today 👋
Visit our booth to talk real-time data with us and get an early look at @rawtreedb, what we’re building next.
Scan the QR code and leave your details to enter our iPad raffle.
📍 Contemporary Jewish Museum
Streaming data into ClickHouse often starts with standing up Kafka, connectors, and consumer fleets.
With Tinybird's Events API, you POST JSON directly over HTTP at 1K+ events/sec. Data lands in MergeTree tables and is queryable in seconds.
ALT cURL request sending a JSON page view event to the Tinybird Events API
With Jev with realize that when people get something that's faster (even with some limitations) they find new ways and new use cases.
I saw this with data, when people started to use ClickHouse instead of Spark (or even Snowflake) they naturally used it for new use cases and solve problems they didn't even consider before.
A good lesson to learn, speed is more than a feature.
