Co-Founder of Tobiko Data
San Francisco, CA
Joined December 2017
- Tweets180
- Following47
- Followers111
- Likes288
Iaroslav retweeted
Today dbt announced column level lineage... but it's not open source and only available for paying cloud users.
dbt is using SQLGlot (an open source SQL framework that my company @TobikoData maintains) to power this newly gated feature. SQLGlot's lineage wouldn't exist without the open source community so it's kind of a shame.
But there's an open source alternative to dbt cloud... @SQLMesh, where column level lineage is free and open source for everyone to use.
SQLMesh is backwards compatible with existing dbt projects, so you can gain all of its benefits without rewriting your project.
Check out our blog post about lineage through SQLMesh's open source UI / IDE.
tobikodata.com/sqlmesh-ui.ht…
If you want to chat about how we can make data transformation better for everyone, we'd love to chat in our slack channel at tobikodata.com/slack.
Iaroslav retweeted
#SQLGlot and #SQLMesh are now implemented in @rustlang! 🤯
Jump on the bandwagon with us and parse #SQL 30-40% faster 😎
Check out @TobikoData's latest #blog for the details.
#Rust #data #transform
tobikodata.com/sqlglot-jumps…
Iaroslav retweeted
Unlike dbt, SQLMesh was designed to work efficiently with extremely large scales of data. Stop hemorrhaging money and stop wasting time manually managing big data sets!
We've spent a lot of time on automated frameworks for working with massive data.
tobikodata.com/evolving-larg…
Iaroslav retweeted
@SQLMesh v0.28.0 supports MSSQL (Microsoft SQL Server). Even better, it was contributed by a community member Dan!
I'm so excited to see SQLMesh grow and gain traction!
github.com/TobikoData/sqlmes…
sqlmesh.readthedocs.io/en/st…
#dataengineering
Iaroslav retweeted
Alex Butler, senior data engineer at SF-based software delivery company @harness, chose @dltHub + @SQLMesh to build an end to end data platform 💪
Learn more about his developer journey as he continues to build out the platform & its benefits to Harness
dlthub.com/success-stories/h…
Iaroslav retweeted
Are you using dbt and have heard of @SQLMesh but aren't quite sure what it is?
You are in luck, because this article is for you! We will teach you the basics of SQLMesh from a dbt user's perspective to help get you up to speed.
tobikodata.com/sqlmesh_for_d…
Iaroslav retweeted
Although companies heavily rely on SQL / data pipelines to power applications and make decisions, testing is usually an afterthought. However, systematic testing of data is critical to creating trustworthy and reliable pipelines.
tobikodata.com/we-need-even-…
I’ve just accidentally glanced at my wife’s feed and realized that ads that show up in our feeds are probably the most revealing thing about us.
Iaroslav retweeted
As the usage of dbt grows, the cracks in its architecture become more apparent. You can either have simplicity or efficiency... but why should you have to choose?
Check out this amazing blog post by @izeigerman detailing the costs associated with dbt.
tobikodata.com/simplicity-or…
Iaroslav retweeted
We spend so much time writing #SQL. Why don't our tools understand SQL? When you parse SQL you unlock:
- Column Level Lineage
- Automatic dependencies (no more {{ ref() }})
- Transpilation
Check out this great post by @izeigerman
tobikodata.com/semantic-unde…
Iaroslav retweeted
SQLMesh v0.8.0 just dropped! Some exciting new features like docs which is integrated inside the IDE!
We've also launched our Github CI / CD bot!
sqlmesh.readthedocs.io/en/st…
Iaroslav retweeted
I wrote a post hoping to demystify incremental loads for data pipelines. Even if you don't have Netflix's data scale, incremental loads can save you time and money!
tobikodata.com/correctly-loa…
#dataengineering #sql
My new post on categorizing changes in #SQL queries is out!
This is one of the key components for how we achieve automatic #data contracts in @SQLMesh.
Managing a large project with interconnected #SQL queries can be extremely challenging. Understanding how changes impact downstream queries is important so that your data is always correct and consistent.
tobikodata.com/automatically…
#dataengineering
Iaroslav retweeted
Yesterday, dbt announced contracts and versions. They're just additional YAML syntax further contributing to the pile of spaghetti code/configs.
It puts even more burden on the end user without solving the underlying problems.
tobikodata.com/the-false-pro…
Iaroslav retweeted
Love seeing a new community grow around @sqlmesh - check out what @Captaintobs & the Tobiko Data team are building!
This Post is from an account that no longer exists. Learn more
The next big thing in #data transformation space is here. Check this out to see why you should run your #dbt project with @SQLMesh today.
dbt's inherent inefficiency is good for Snowflake's bottom line, but not your team.
How many times does your data team fully copy your warehouse just to make a simple change?
@izeigerman explains how we can finally stop this madness
github.com/TobikoData/sqlmes…
Iaroslav retweeted
I love how DevOps enables software engineers to safely ship code faster.
As a data engineer, I think we deserve something similar: the DataOps revolution.
Here’s a 🧵 on why I made SQLMesh, an open source DataOps framework, which launches today github.com/TobikoData/sqlmes…
Wtf is he talking about? The nonsensical nature of these bullets aside - what about months of terror, tens of thousands of lost lives among civil population and destroyed civil infra? Who will pay for this? He's out of his mind if he thinks that #Ukraine will back down.
Ukraine-Russia Peace:
- Redo elections of annexed regions under UN supervision. Russia leaves if that is will of the people.
- Crimea formally part of Russia, as it has been since 1783 (until Khrushchev’s mistake).
- Water supply to Crimea assured.
- Ukraine remains neutral.
41%Yes
59%No
2,748,378 votes • Final results