Data quality https://xitter.cf/t.co/aqDglaYbhi (@getpiperider) Data versioning https://xitter.cf/t.co/i6r2cQA5YB End-to-end MLOps https://xitter.cf/t.co/rECe82dVL3 Discord community: https://xitter.cf/t.co/UXpEaSuQK0
Taiwan
Joined July 2018
- Tweets581
- Following715
- Followers307
- Likes577
InfuseAI retweeted
Data projects often have two extremes
- no pre-merge checks, fast merge times, but constant breakages
- adopt best practices causing merge times to increase from hours to days
Keep best practices and speed up PR review with Recce
datarecce.io
#dbt #dataengineering
Nice! This is perfect for some static analysis and a taster of what PipeRider's Impact Reports can offer:
This quoted post is unavailable.
InfuseAI retweeted
LLM/AI sharing x LangChain Watch Party
Awesome sharings from @langchain, @InfuseAI CEO @clkao, and developers of the open-source project Accio(getaccio.ai/)!
InfuseAI retweeted
🔓 Unlocking the Power of DBT: Visualizing Data Lineage, Diff Analysis, and Impact Analysis for Efficient Data Pipeline Management by @DaveFlynn
medium.com/inthepipeline/dbt…
Please help get a PipeRider a home on the dbt Slack to help users 🙏
getdbt.slack.com/archives/C0…
This quoted post is unavailable.
Check out Alexey's thread below - he breaks down the MLOps process in this easy to understand thread
And if you need an open-source MLOps platform in 30 minutes, check out the PrimeHub 1-click AWS install:
one.primehub.io/
#MLOps #MachineLearning #AI #opensource
Get the latest version of PipeRider now, with improved branch comparison.
Also, follow @getpiperider for tweets about PipeRider releases, features, and data quality related content!
#dataops #dataquality #DataEngineering #Analyticsengineering #dbt #datareliability
This quoted post is unavailable.
PrimeHub 4.0 released last month 📢
The #1 open-source MLOps platform just got even better:
- K8s 1.24 support
- Group resource dashboard
- Increased SDK and CLI support
GitHub
github.com/InfuseAI/primehub
Read more here
blog.infuseai.io/primehub-4-…
#MLOps #MachineLearning #OpenSource
If you plan to build and deploy your dbt project using GitHub Actions, you'll need to connect to your data warehouse
Here's a quick guide on how to run dbt with BigQuery in GitHub actions:
medium.com/infuseai/how-to-r…
#BigQuery #GitHubActions #dbt #DataEngineering #DataOps
Thanks @jfcohh_ glad we could help!
If you have any questions or need helping using PipeRider, just join our Discord server like Juan did:
discord.gg/328QcXnkKD
#dataquality #datareliability @opensource #dataprofiling #DataViz
I've been working these days with #PipeRider and it just amazed me the quickness of handling 36M records. This kind of cool tool would save me a lot of code, time and effort. Thanks to @DaveFlynn for supporting me on my doubts
Details about our @DataTalksClub Workshop can also be found in this blog post:
medium.com/infuseai/data-eng…
The workshop is useful to all #dbt users (with repo provided).
If you're following the #DataEngineering Zoomcamp there is homework at the end 👩🎓
#opensource #dataquality
Last week, we had special guests on Data Engineering Zoomcamp!
You'll want to check this out if you missed it!
Dave Flynn from @InfuseAI presented a free hands-on workshop on data profiling with dbt and PipeRider.
1/2
The PipeRider workshop that accompanies week 4 of the @datatalksclub Data Engineering Zoomcamp is now online to watch:
youtube.com/watch?v=O-tyUOQc…
You’ll learn how to use PipeRider's data comparison to understand the impact of your #dbt data model changes
The data profile comparison summary highlights things like schema change the percentage change of values within tables
The markdown-formatted summary is specially designed for pull request comments:
Oh yeah, and the workshop has its own self-contained repo.
If you were naughty and skipped the Zoomcamp module, you can fork-and-go our repo and get stuck in.
All the steps you need are in the readme:
github.com/InfuseAI/taxi_rid…
#dataengineering #dbt #analyticsengineering
Don't forget that the PipeRider workshop with Data Talks Club is coming up on Wednesday Feb 22.
If you're following along with the Data Engineering Zoomcamp then the workshop will be linked with Week 4. (but really all you need is a dbt project to join!)
eventbrite.com/e/maximizing-…
We'll be joining @DataTalksClub to show how to maximize your confidence making data model changes in dbt using PipeRider
You'll learn how to use PipeRider's data profile comparison to compare production and dev data models and more
linkedin.com/events/maximizi…
In this first in a series of articles about GPT, InfuseAI Customer Success Engineer Simon Liu looks at the history of GPT models.
Mandarin content 中文:
blog.infuseai.io/gpt-model-p…
#gpt #chatgpt #NLP #語言模型
We'll be joining @DataTalksClub to show how to maximize your confidence making data model changes in dbt using PipeRider
You'll learn how to use PipeRider's data profile comparison to compare production and dev data models and more
linkedin.com/events/maximizi…
InfuseAI retweeted
➡️ Confidence in Data Model Changes: Staging + Data Profile Comparison. By @DaveFlynn blog.infuseai.io/how-to-be-m…
📢PipeRider 0.18.0 is out now and our #dbt support is even better!
- dbt defined metrics in HTML reports
- Visualize metric differences between data profiles
- Metric comparison summary in Markdown to paste into your pull request comment
⭐️github.com/InfuseAI/piperide…
#opensource
ALT PipeRider data profile comparison summary in a pull request comment. The perfect way to see the difference between data profiles such as development and production environments