Collect, aggregate, and visualize a data ecosystem's metadata. Powered by @OpenLineage.
SF
Joined August 2018
- Tweets240
- Following33
- Followers907
- Likes156
MarquezProject retweeted
Our next TSC meeting is tomorrow, May 8th, at 9:30am PT. On the tentative agenda: announcements, recent release highlights, protobuf support in Flink, project management improvements, discussion items, open discussion. All are welcome! More info: bit.ly/OLwiki
MarquezProject retweeted
Register today for Accenture+Confluent's Open Standards for Data Lineage virtual roundtable on April 25th! events.confluent.io/roundtab…
MarquezProject retweeted
New on the YouTube channel from Astronomer's Paweł Leszczyński: a demo of cross-platform lineage from Apache Flink and Apache Airflow jobs using Marquez. youtu.be/FGD0QRdQ8Zk
MarquezProject retweeted
Join us on March 30th at Data Council Austin for an OpenLineage meetup! Learn about the project's goals and design, meet other members of the data ecosystem, and help shape the future of the spec. For more info, check out the OpenLineage blog: openlineage.io/blog/data-cou….
MarquezProject retweeted
Attention all data ops professionals, data scientists & data engineers in New England and beyond: we're hosting a Data Lineage Meetup on March 9th in Providence. No registration required. More info: openlineage.io/blog/data-lin…
MarquezProject retweeted
We are looking for feedback on the @OpenLineage @ApacheFlink integration. openlineage.io/docs/integrat…
If you are using Flink and are interested in collecting lineage from your streaming jobs, give it a try. (did you check out @MarquezProject ?)
MarquezProject retweeted
My talk on backfilling Airflow DAGs using @MarquezProject is now available!
You can now watch @wslulciuc's talk at Open Source Summit North America by @linuxfoundation!
Learn how to automate Airflow backfills with #Marquez!
youtube.com/watch?v=sN7j5mZc…
MarquezProject retweeted
In his talk today, @wslulciuc will introduce you to how backfills are handled in #Airflow and discuss how DAG #lineage metadata stored in @MarquezProject can be used to automate backfilling DAGs.
airflowsummit.org/live/
MarquezProject retweeted
If you have @SnowflakeDB Enterprise and you like lineage, I have good news for you. You can now easily send it to your favorite @MarquezProject or any other @OpenLineage compatible consumer. (Hint: check my bio)
The OpenLineage Adapter offers Snowflake's enterprise users a powerful tool for analyzing their pipelines. Read our latest blog post to learn more: openlineage.io/blog/openline…
MarquezProject retweeted
If you want a @MarquezProject or @OpenLineage sticker and are not able to come chat in person at @DataCouncilAI there’s now a form for that!
astronomer.io/datakin-swag
MarquezProject retweeted
Looking forward to speaking @DataCouncilAI this week on @MarquezProject and @OpenLineage. Oh, and don’t forget to grab some swag!
@wslulciuc and @J_ will be at @DataCouncilAI next week in Austin talking OpenLineage and @ApacheAirflow datacouncil.ai/talks/data-li…
MarquezProject retweeted
Is there a topic you think the community should discuss at the next @OpenLineage TSC meeting? Reply or DM with your item, and we’ll add it to the agenda. Mark your calendars: the next TSC meeting is Wednesday, March 9 at 9 am PT. tinyurl.com/openlineagetsc
MarquezProject retweeted
A great example is the Egeria project (whose project lead drove the proxy backend), which captures OL information and uses it to augment its own metadata, while still making lineage data available for @MarquezProject consumption odpi.github.io/egeria-docs/f… 6/9
MarquezProject retweeted
Join us Dec 9th to learn about Data Lineage with @ApacheAirflow and @OpenLineage!
Presentation: Data Lineage with Apache Airflow using OpenLineage by @wslulciuc meetu.ps/e/KCntQ/1CNtn/i
MarquezProject retweeted
Now to see how @MarquezProject goes about versioning and storing that data!
MarquezProject retweeted
New @MarquezProject 0.19.1 release just went out. A few minor bug fixes, but important to anyone referencing File-system-type datasets, e.g., in hdfs, s3, or gcs
github.com/MarquezProject/ma…
MarquezProject retweeted
“Both the @MarquezProject and @OpenLineage communities have been extremely welcoming, and that has been a huge factor in our success at @NW_Financial. Our feedback has been encouraged and heard, evidenced by evolving roadmaps and accepted contributions.”
openlineage.io/blog/openline…
MarquezProject retweeted
“The flexibility offered by the Marquez deployment architecture and our ability to customize its details allowed us to activate new production use cases in about a month.”
openlineage.io/blog/openline…
MarquezProject retweeted
"the ultimate easy button approach"
Nice blog by Kevin at Northwestern Mutual's Enterprise Data Platform about their experience with @OpenLineage and @MarquezProject
openlineage.io/blog/openline…
