Rill Data retweeted
Excited to speak at the @ClickHouseDB Gurugram meetup this saturday.
My talk: What Do Agents Need from Databases? Speed, Scale, and Semantics.
I’ll share how fast analytics, governed metrics, and semantic context become critical as AI agents start answering business questions directly — and how we’re thinking about this at @RillData with @ClickHouseDB.
RSVP: meetup.com/clickhouse-delhi-…
#ClickHouse #AgenticAI #RealTimeAnalytics #DataEngineering #RillData
Rill Data retweeted
AI Council 2026 Party Update!
@Category_VC and @RillData are handing the mic to @wesmckinn (creator of the Python pandas and co-creator of Apache Arrow), @LinghuaJ (co-founder of @cocoindex_io), and @jacopotagliabue (co-founder of @Bauplan_labs) to talk about how agents are redefining what’s possible at the infrastructure layer.
Come enjoy drinks and eats while listening to these (truly) top 1% builders.
🗓️ Wednesday, May 13
🕠 5:30PM - 7:30PM PDT
📍Just two blocks from the SF Marriott Marquis.
See you there! RSVP: luma.com/61g18sqg
Rill Data retweeted
The world’s top developers are unlocking stunning gains in productivity with parallel agentic coding sessions, custom harnesses, and constant experimentation with frontier models.
This is more than an evolution in technique; it’s is a new breed of software engineering.
If you’re in SF on May 13, come join us for a fireside chat with Wes McKinney (@wesmckinn), creator of Python Pandas & Apache Arrow, and a pioneer of agent-enabled software development, alongside other founders at the @Category_VC offices, right after #aicouncil sessions conclude.
Excited to co-host an evening with @medriscoll on May 13th in our SF office featuring @wesmckinn (Principal Architect at Posit, creator of Python pandas project) and @LinghuaJ (Founder & CEO of @cocoindex_io).
Whether you are in town for AI Council or an SF resident, come hear what top builders are shipping today and how agents are reshaping AI and Data infra.
Spots are limited. Sign up here: luma.com/61g18sqg
@Category_VC @villi @_shriyanshk
Replying to @ceo_clickhouse @medriscoll
Two of our favorite products here at @cloudx !
Rill Data retweeted
8/ Check out the full breakdown of how Rill is rethinking the semantic layer for the age of AI here: dataengineeringweekly.com/i/… #SQL #Analytics #DataScience
Rill Data retweeted
We've heard it all. BI and dashboards are dead. But every time, only to rediscover its power and resurrection whenever we need grounded data analysis in any enterprise and startup space.
Benn Stancil was writing about it in 2021, drawing parallels to the Salesforce "End of Software" declaration in 2000. We compare the parallels with today, as it's very interesting, as it's almost the same statement today with AI, that no more software developers are needed.
But is BI dead today? It depends on what you mean by it. If you mean ad-hoc creation of a visualization, probably yes. But if you mean a well-crafted operational dashboard, where you can see your whole company performing in a split second by looking at a single, highly dense dashboard with individual charts and visualizations tailored to convey information about each sub-area in the best possible way. Probably not.
However, BI was never just about dashboards. Many need the extracts BI provides from your large SAP system, linked to the right customers in the CRM, enhancing decision-making even further. It's the primitives behind the dashboards that matter more: speed, metrics, and the semantics behind them. The hard work of aligning the business, verifying the numbers are correct, and joining and aggregating at the right granularity.
Data projects need governance and implementation of best practices. Otherwise, we are back to the same old way of using local Excel files, where everyone is doing their own thing with no alignment, governance, or broader verification.
But most importantly, who is maintaining it all with the explosion of dashboard creation? What's the solution? In this new article, we look at how BI evolved, how dashboards are actually used today, and what remains relevant.
There's a good approach that we know works well, which involves the same old ingredient that we use in the software domain: artifacts can be versioned, recoverable, and declared. BI needs trustworthy metrics, semantics, AND ownership.
This can be achieved with some version of BI-as-Code, and with that, we can also generate safer visualizations. After all, the hard part was never generating visualizations; it was having metrics and a strong backend. Having a unified data interface that has an agent with access to source, ETL, and dashboard.
And Amdahl's Law still applies: 50x faster generation of BI charts, but if the tools it depends on were designed for human speed with slow query APIs, no CLI support, and unversioned metrics, the overall gain collapses to 2-3x.
So, the future with AI reveals why BI still matters, and it's most likely not the dashboards themself. Read more in the full article at rilldata.com/blog/ai-reveals….
Rill Data retweeted
Really great article by @NishantBangarwa, about the history of metrics and how «Metrics SQL», a SQL-based semantic layer that is integrated into Rill.
It really goes into the details of `SQL -> Parser -> Query Compiler -> Executor -> OLAP Engine`, and how Metrics SQL is the interface to it. Worth a read.
Rill Data retweeted
Modern businesses have become a continuous stream of events.
clickhou.se/4cgqTem
See how @RillData uses @ClickHouseDB to power real-time operational business intelligence, giving organizations a developer-first, BI-as-code way to understand business performance 👇
Rill Data retweeted
"We couldn't get people to use it for free... and people openly mocked it," said Lukas Biewald (@l2k) about what would become a $1.7B business, his AI observability startup @wandb.
Luckily, Weights & Biases' first customer was a little-known business named OpenAI. After seeing his product up on monitors in their offices, Lukas thought, "Okay, this is good, even all I can do is help OpenAI, this is something to be proud of."
In the latest episode of Data Talks on the Rocks, I spent almost an hour with Lukas about his journey building one of the seminal startups in AI. In this wide-ranging discussion, we cover:
• Why his earlier AI labeling startup (CrowdFlower) was an example of being right but just too early
• How GitHub's founders inspired him to sell to developers
• What he saw as an unpaid intern at OpenAI before ChatGPT (hint: robots!)
• How he's now back coding and optimizing inference throughput with @karpathy's autoresearch
• Why robotics is a software problem, not a hardware one
Full link to interview in thread below.
Rill Data retweeted
Agents are blind— they can’t see dashboards. But they do need access to the primitives behind them.
AI won’t kill BI, but it will make data modeling, metrics, OLAP cubes, query performance, and governance more important than pretty pie charts.
Agents will reveal what many of us have known for a long time: that BI was never about dashboards.
Rill Data retweeted
In 2014, The Economist ran a special report on how real-time programmatic bidding was revolutionizing advertising. Now, AI is doing it again, and at a faster pace.
Analytics played a critical role in that last revolution, and will be an even bigger part of this one. Agents need insights to drive decisions, and are voracious consumers of analytics. We have a front-row seat to this: Agentic queries are beginning to eclipse dashboard clicks across Rill Data's business intelligence customers.
Yesterday I spoke with @tipsheetai about how agents are transforming analytics and decision-making in every industry, especially in media and advertising. Agents provide their highest leverage at decision points like routing and pricing, which in programmatic advertising are already online and fully digitized.
There is now a global race to unlock the value of intelligence in every vertical, and as usual, media and advertising are at the tip of the spear. Partners like @CloudX and @tv_scientific understand this and are putting agentic analytics and workflows at the core of their platforms.
To paraphrase what William Gibson said about the future: agentic analytics is already here— it's just not evenly distributed.
🤖 Made with AI
Rill Data retweeted
Today's tipsheet interview for Thursday, March 19...
Rill Data CEO Michael Driscoll spoke to tipsheet yesterday about AI and his agentic analytics company. Topics included:
* Mr. Driscoll spoke to tipsheet about Rill Data yesterday, including:
* Rill Data’s origin story at Snap
* What Rill can do for advertising and marketing
* The transition to solutions for humans and agents
* Plugging into large language models (LLMs).
* Observability’s role in advertising today
* What is Conversational BI?
* MCP for Conversational BI
* Are APIs going away?
* The reasoning behind ‘local-first’ analytics
* AI and ‘local versus cloud’
* The state of mediation in today’s ad ecosystem
* Agent-to-agent future at scale — when?
Read: tipsheet.ai/technology/rill-…
Rill Data retweeted
Guess who loves local-first, code-first analytics tools? 🤖 Agents.
Claude Code + Rill can now build a full data stack in seconds – pipelines, database, and dashboards visualizing millions of records – with BI-as-code, on a single machine.
Rill Data retweeted
Times are shifting rapidly toward CLI-first development. You know that's true when even email and calendar get their own Google CLIs. So why not bring that same CLI-first, developer-friendly approach to your business metrics?
If you're a data engineer or analytics engineer building with agents, this one's for you. With the stack of DuckDB+MotherDuck and Rill as an agent-friendly, local-first frontend, that's exactly what's needed these days to work with agents. Especially to retrieve context from local specification of metrics and dashboard definition - getting exact context through SQL and YAML.
Focusing on developer workflow with the use of Claude Code, Codex, and Cursor that can instantly update your dashboard, update metrics in the unified layer for all visualizations to pick up, or just adding new columns to the database with the DuckDB CLI, whether the data is locally or in the cloud with serverless MotherDuck.
To any data engineer, this is a joy to work in, and the iteration cycles from `ambiguous prompts -> verifiable configs -> shipping visualizations` is so fast. Increasing quality by allowing domain-experts who know the business best to own more of the data stack, while everything is still versioned in git, automatable, and easy to work with.
In this new essay about «Building an Agent-Friendly, Local-First Analytics Stack», we look into general data engineering workflows and working with new agent tooling, why you'd use MotherDuck, and how Rill can help you in this stack.
We look at Conversational BI, where Rill turns dashboards into code (and code into agent-readable context), serving as the code abstraction layer in most cases.
What I explore more:
→We discuss what's next with agentic coding, no more dashboards needed?
→We analyze natural language interfaces as they are convenient, but inaccurate?
→Does self-serve with BI-as-Code providing the context we need?
→How the language we choose matters. Looking at SQL, YAML, and how people choose languages based on Agent use (not human familiarity).
And we check limitations the future holds due to the imprecise way of natural language, e.g., "give me the analytics for this week?" Did you mean "from today until last week"? Or how data workloads need to be deterministic and reproducible to backfill faulty data, but AI agents aren't that.
We explore three open-source examples in the article:
1. Stack Overflow Developer Survey with zero-pipeline analytics
2. Updated Multi-Cloud Cost Analyzer to add MotherDuck with `DLT_DESTINATION=motherduck`
3. Including a real-world setup from Salomon Vaisberg from Drio Tech, how he uses Airbyte/dlt + BigQuery/MotherDuck/dbt + Rill.
If you like this, read the full article at: rilldata.com/blog/building-a….
What do you think, and which agent-friendly, local-first analytics stack do you prefer these days?
Rill Data retweeted
I spent years working with data warehouse automation tools before the modern data stack existed.
The biggest lesson? There are two approaches to generating pipelines:
Parametric - you define parameters, the tool generates SQL
Template-based - you write SQL templates with variables
Most modern tools like dbt took the template approach. It's more flexible but requires more SQL knowledge.
The automation tools took the parametric approach. Less flexible but faster for common patterns.
Neither is wrong - they optimize for different teams.
ssp.sh/blog/designing-a-decl…
Rill Data retweeted
Why are hyperscalers racing to offer managed Iceberg?
Because whoever controls the catalog controls the ecosystem.
If your tables are in a managed Iceberg service, you can query them from any engine - Spark, Trino, DuckDB, whatever. But your metadata stays with that provider.
It's a smart strategy. Give away the format, keep the control plane.
ssp.sh/blog/open-table-forma…
Rill Data retweeted
Replying to @DOGE_HHS
For anyone who wants to explore this data with AI, I enriched it and set up a public MCP server you can connect to from Claude, ChatGPT, Cursor, etc.
I added:
- Provider names and locations
- Procedure descriptions and service categories
- Flags for providers who have been excluded from federal healthcare programs for fraud
MCP server URL: api.rilldata.com/v1/orgs/dem…
If you want to click around or validate what your AI finds, here's the source of truth dashboard (better on desktop): ui.rilldata.com/demo/medicai…
Here's the GitHub repo. There's plenty more ways to enrich this, so open to PRs and recommendations!
github.com/rilldata/rill-exa…
Disclaimer: I work at Rill and put this together this morning with Claude Code + Rill.
Rill Data retweeted
How @wesmckinn went from AI skeptic to true believer— using Claude to ship 𝙩𝙝𝙤𝙪𝙨𝙖𝙣𝙙𝙨 𝙤𝙛 𝙡𝙞𝙣𝙚𝙨 𝙤𝙛 𝙘𝙤𝙙𝙚 per week.
In the latest episode of Data Talks on the Rocks, I interview the legendary creator of pandas, Apache Arrow, and Ibis, about how AI is transforming the way he builds software.
He livestreamed his actual coding setup, showing how 𝙧𝙤𝙗𝙤𝙧𝙚𝙫 —his continuous background code review system—helps him generate thousands of lines of reliable code with agents.
"If all of your [AI-generated] code isn't being automatically reviewed by adversarial agents, you've got bugs lurking that can't possibly be found through your own human QA."
Rill Data retweeted
Today, I dig into the details of #StarRocks and how it is gaining traction in the real-time database world, with DWH-like joins and fast retrieval from a Lakehouse-native data architecture, without additional data engineering work to persist and ingest data.
I look at how data can be colocated to avoid network shuffling or broadcast overhead, enabling sub-second responses for dashboards and real-time analytics.
I interviewed two heavy users of StarRocks to get real-world feedback on the pros and potential cons (thank you, Eric Sun and Anton Borisov). We analyze how Coinbase, Pinterest, Fresha, and others use StarRocks in production, and why they chose it over other open-source OLAP solutions.
Things that stood out to me were:
Joins are the differentiator → Every person I spoke with chose StarRocks because joins actually work at speed without heavy pre-denormalization in Flink or Spark. Coinbase ran TPC-H 1TB benchmarks, in which ClickHouse failed 12 of 22 queries.
Colocated joins are surprisingly simple in concept → Tables that need to join share the same bucket key, bucket count, and replica placement. Rows with the same `customer_id` always land on the same node. The join becomes local, no network shuffle.
Pinterest cut p90 query latency by 50% while using only 32% of their previous Druid infrastructure. → That's roughly a 3x improvement in cost-performance.
Cold S3 data still returns in 3-5 seconds → when Iceberg metadata is well-sorted and prepared with e.g., Apache Puffins.
You still need good data modeling. → StarRocks doesn't eliminate architecture thinking. Colocated joins require upfront planning across tables. Partition key choices matter.
#Tradeoffs:
The smaller community compared to ClickHouse is one tradeoff you make. Eric mentioned that most engineers in the Bay Area haven't heard of StarRocks, which affects adoption and hiring.
There's much more in the article, full interview questions, a guideline on when to use StarRocks vs. ClickHouse based on use case, how the multi-tier caching might replace traditional ETL ingestion, and how real-time updates work without merge-on-read overhead.
The full article is at ssp.sh/blog/starrocks-lakeho….
Rill Data retweeted
Amazing talk about AI and the future of data visualization. Mike argues why dashboards won't go away (can condense so much information you'd need 10 prompts) and also certain numbers you don't want to constantly prompt. E.g. speed on your car, you don't want to ask every 10 seconds 🙂 youtube.com/watch?v=tEIQGgS4…
There are many more great insights, but I'll let you discover them yourself. Thanks for sharing, Joe.























