In this post, Ian & Niall answer a frequent question posed by dbt users to optimize dbt performance and cost efficiency: how many dbt threads should be used?

select.dev

503

pei · Nov 29, 2023 · 3:03 AM UTC

SELECT retweeted

pei@pei080429 Nov 2023

SELECT Cloud、3ヶ月ほど運用したので満を持して、事例公開しました。 OSS版も素晴らしいですが、Cloudはもっとすごいので、Snowflakeのコストやパフォーマンスで、お困りの方は、是非チェックしてください🥰 @SnowflakeDB_jp @SnowflakeDB @select_dev

CARTA Engineers

@carta_engineers29 Nov 2023

❄ SELECT Cloud国内初導入！❄ Snowflake使用コストを最大40%最適化 SELECT Cloudについて @pei0804 が導入実績を解説！ > 利用料を40％程度削減できてるワークロードも出てきて、この節約機能だけで、SELECT Cloudの利用料を回収できてしまうレベルのインパクトでした。 techblog.cartaholdings.co.jp…

SELECTを使った手間なしSnowflakeコスト最適化 - CARTA TECH BLOG

株式会社CARTA MARKETING FIRMで、データエンジニアをやっている@pei0804 です。普段の業務は、データエンジニアの仕事はもちろん、組織・採用戦略を考えたり、データエンジニア育成など、データ活用を推進するための色々なことをやっています。当記事では、業務で開発・運用しているSnowflakeベース…

techblog.cartaholdings.co.jp

6,779

SELECT · Jul 5, 2023 · 10:10 PM UTC

SELECT@select_dev5 Jul 2023

We finally got some time to I finally got some time properly reflect on everything @SnowflakeDB announced last week at Summit 2023. Learn about every announcement and our thoughts on each in our latest post👇 select.dev/posts/summit-2023

Every Major Announcement at Snowflake Summit 2023 and 1 Word Never Mentioned

In this post we provide a deep dive into all Snowflake Summit 2023 announcements, why they matter and which ones we're most excited about.

select.dev

708

SELECT · May 8, 2023 · 5:27 PM UTC

SELECT@select_dev8 May 2023

Back in March we had the opportunity to speak at @DataCouncilAI in Austin. We had a blast sharing everything we've learned about @SnowflakeDB cost and performance optimization. Slides & recording now available 👇 select.dev/posts/data-counci…

1,288

Carlin Eng · Mar 30, 2023 · 11:57 PM UTC

SELECT retweeted

Carlin Eng@carlineng30 Mar 2023

Geeking out about Snowflake optimization with the @select_dev crew @NiallWoodward and @ianwhitestone. 5/7

590

Julia Schottenstein · Mar 24, 2023 · 11:38 PM UTC

SELECT retweeted

Julia Schottenstein

@j_schottenstein24 Mar 2023

New @dbt_labs Analytics Engineering Podcast is LIVE🎙️! @jthandy and I sit down with @brad_culberson from @SnowflakeDB and @NiallWoodward from @select_dev to talk about cloud warehouse optimization. Listen for practical advise on a top of mind topic 🧠🫰 open.spotify.com/episode/2j8…

Cloud Warehouse Cost Optimization (w/ Niall Woodward + Brad Culberson)

The Analytics Engineering Podcast · Episode

open.spotify.com

1,272

SELECT · Mar 15, 2023 · 4:51 PM UTC

SELECT@select_dev15 Mar 2023

Was about to tweet our latest post but @toppare bet me to it 🏃‍♂️. Thanks for sharing! Curious about when to use CTEs in Snowflake? Read on!

Baran Toppare 🧟@toppare15 Mar 2023

Another great post from @select_dev about CTEs. Summary: - continue using CTEs 🤘 - specify column names (don't "import" with select *) - for special queries, experiment with repeating logic instead of reusing CTEs - learn how to read query plan select.dev/posts/should-you-…

397

SELECT · Mar 15, 2023 · 4:54 PM UTC

SELECT@select_dev15 Mar 2023

beat* 🤦‍♂️ @elonmusk edit button pretty plz

244

SELECT · Mar 15, 2023 · 4:51 PM UTC

SELECT@select_dev15 Mar 2023

select.dev/posts/should-you-…

162

Brooklyn Data Co. (a Velir company) · Mar 9, 2023 · 5:44 PM UTC

SELECT retweeted

Brooklyn Data Co. (a Velir company)@BrooklynData9 Mar 2023

We're two weeks out from the next Analytics Engineering meetup in London at the @thoughtmachine office. 🙏Big thank you to our friends over @SpectaclesCI and @select_dev for letting us support such a great event! The countdown to grab your seat is on! 👉 bit.ly/3Izk2hj

London Analytics Engineering Meetup #6, Thu, Mar 23, 2023, 6:00 PM | Meetup

We're delighted to announce our next meetup will be hosted by **Thought Machine**. This meetup will take a panel format, where we're be joined by three of London's top anal

meetup.com

326

Brooklyn Data Co. (a Velir company) · Feb 20, 2023 · 4:38 PM UTC

SELECT retweeted

Brooklyn Data Co. (a Velir company)@BrooklynData20 Feb 2023

🗣️UK friends: The next Analytics Engineering meetup is approaching fast! 🤝We’ve joined forces with @SpectaclesCI and @select_dev in co-hosting this event at @thoughtmachine in London, March 23 at 6pm GMT. Save your seat 👉bit.ly/3Izk2hj

London Analytics Engineering Meetup #6, Thu, Mar 23, 2023, 6:00 PM | Meetup

We're delighted to announce our next meetup will be hosted by **Thought Machine**. This meetup will take a panel format, where we're be joined by three of London's top anal

meetup.com

366

SELECT · Jan 23, 2023 · 3:08 PM UTC

SELECT@select_dev23 Jan 2023

In @SnowflakeDB 's latest release, they've given us a nice new set of aggregate functions: min_by and max_by. In this example I look across each user's query history, and find the ID of the first and last queries they executed.

15,535

SELECT · Jan 23, 2023 · 3:08 PM UTC

SELECT@select_dev23 Jan 2023

More generally, you can use these to find the row containing the min/max value for a particular column, then return the value of another column in that row.

419

SELECT · Jan 23, 2023 · 3:08 PM UTC

SELECT@select_dev23 Jan 2023

⚠️ Unfortunately, this function isn't guaranteed to be deterministic. As a result, it won't be able to leverage Snowflake's result cache, so be careful when using in performance or cost sensitive applications where the query is executed frequently.

359

SELECT · Jan 21, 2023 · 6:36 PM UTC

SELECT@select_dev21 Jan 2023

Range joins are notoriously slow in many databases. @SnowflakeDB is no exception. We're using a binned range join technique across a number of models in our @getdbt project and have seen incredible results. A 300x speedup for this query.

565

SELECT · Jan 21, 2023 · 6:36 PM UTC

SELECT@select_dev21 Jan 2023

All the details are in here 👇 select.dev/posts/snowflake-r…

How to speed up range joins in Snowflake by 300x

A deep dive into how you can optimize queries involving a range join for up to a 300x performance improvement.

select.dev

182

SELECT · Dec 23, 2022 · 12:16 PM UTC

SELECT@select_dev23 Dec 2022

As of Tuesday, users now have programatic access to all the query performance statistics available in the Query Profile. This is possible through a brand new function, get_query_operator_stats. You can run this function on one query_id at a time:

1,474

SELECT · Dec 23, 2022 · 12:50 PM UTC

SELECT@select_dev23 Dec 2022

oh FFS i forgot a *

230

SELECT · Dec 23, 2022 · 12:16 PM UTC

SELECT@select_dev23 Dec 2022

Similar to the Query Profile, data is only retained for queries run in the last 14 days. If you want this to stick around for longer, you’ll have to persist it with a scheduled Snowflake job.

270

SELECT · Dec 23, 2022 · 12:16 PM UTC

SELECT@select_dev23 Dec 2022

We'll be diving deeper into this functionality and sharing some sample queries in the coming weeks. For now, you can read the: - Original announcement post: snowflake.com/blog/programma… - Snowflake docs: docs.snowflake.com/en/sql-re… - Our post on the Query Profile: select.dev/posts/snowflake-q…

235