@dask_dev
Account based inUnited Kingdom!
About this account
- Account based in
- United Kingdom
- Connected via
- Web
X says this location may be affected by a proxy or VPN.
Account-level information from X, not a live location or the device used for a specific post.
Dask natively scales Python Dask provides advanced parallelism for analytics, enabling performance at scale for the tools you love
Joined July 2017
- Tweets926
- Following0
- Followers8.6K
- Likes846
Reminder its the Dask Community Meeting on Thursday November 6th 2025 at 10am US Central time (4pm UTC)
Come along and hear about what's going on in the Dask community and to share what you're building with Dask.
Ad-hoc demos very welcome!
github.com/dask/community/is…
The monthly Dask Community Meeting is on Thursday, October 2nd at 10:00 US/Central.
Come along and share what you've been doing with Dask.
github.com/dask/community/is…
Our February community meeting is today at 10am US Central time. We will be chatting about ongoing development of Dask and showing community demos of cools things folks have built.
Come along!
docs.dask.org/en/stable/supp…
It's out first community meeting of 2025 today. Come and join us at 10am central for project updates, demos and more!
docs.dask.org/en/stable/supp…
Dask retweeted
Read about the latest improvement to GroupBy.map with Dask: xarray.dev/blog/dask-detrend…
Thanks to Patrick Hoefler of @CoiledHQ for the great work here!
Dask retweeted
New blog post: Scale AI-based Data Processing EASY
The FineWeb-Edu dataset comes from processing 45TB (🤯) of FineWeb
And it uses a Language Model to classify the educational level of the text 😭😭
Still, we reproduced it in a few lines of code !
The key ? HF + Dask 😎
Demos from the September community meeting are now up on YouTube. See how Dask is being used for scalable computing in Astronomy and the latest updates from dask-jobqueue.
youtu.be/afmus2EvccU
Unfortunately we've had some spam on the Dask Community Forum recently.
To combat this we've limited logins to GitHub OAuth. If you previously signed up with email/password please login with a GitHub account with the same email.
More info here dask.discourse.group/t/switc…
Today at 10am US central time we have our monthly Dask community meeting.
Come along if you want to hear about what's going on in the Dask community!
docs.dask.org/en/latest/supp…
Quick note that we are skipping the Dask Community Meeting this month because it falls on July 4th which is a holiday for many attendees. See you all in August!
Dask retweeted
Introducing a new Python package called dask-ee! It can turn an #EarthEngine Feature Collection into a #dask DataFrame with one line of code. Accelerate your geospatial workflow with parallel computing
github.com/alxmrs/dask-ee
Dask DataFrame is now 20x faster. Some of most prominent changes include:
- Apache Arrow support in @pandas_dev
- Better shuffling algorithm for faster joins
- Automatic query optimization
Learn more: docs.coiled.io/blog/dask-dat…
ALT Bar chart showing a 20x improvement in Dask DataFrame performance with the addition of Arrow stings, more efficient shufffling, and a query optimizer.
Don't forget, our next community meeting is this Thursday on June 6th.
Come and hear about the latest in Dask, see what others are building with Dask and learn about how you can get involved.
Meeting info here 👉 docs.dask.org/en/stable/supp…
Are you using Dask in your projects? The rest of the community would love to hear about it!
Come and give an informal demo at our next community meeting on June 6th.
Demo sign up issue is here github.com/dask/community/is…
Next month we are trying a new consolidated Community Meeting format.
All Dask users/developers are welcome!
Topics will include:
• Development updates
• Dask Demos
• Maintenance coordination
📅 Add it to your calendar now
docs.dask.org/en/stable/supp…
We had some great talks at last month's Dask Demo Day like dask on @databricks, scaling embedding pipelines with @llama_index and deploying @PrefectIO on the cloud.
Join the next one this Thursday, 11am ET github.com/dask/community/is…
Watch the recording: youtube.com/watch?v=07e1JL83…
Dask retweeted
I'm updating the Dask.org homepage and could use quotes from happy Dask users that don't mind having their name and face on the site.
Any kind words you can share about why you like Dask, find it easy, or how helped you solve a problem?
Short answers preferred!
Query planning for Dask Dataframe released
github.com/dask/dask/issues/…
Dask dataframe is pretty fast now, even when folks write less-than-perfect code.
$ pip/conda/uv/mamba install dask
Join us for Dask Demo Day to see how to deploy @databricks on Dask, run @PrefectIO workflows in the cloud, and scale embedding pipelines.
🗓️February 15 (today!)
⏰11am ET
github.com/dask/community/is…
Dask retweeted
📢Really happy to announce the "Scaling with Dask guide" for @Panel_org.
🤝In many ways @Panel_org and @dask_dev is a perfect couple as they share both philosophies and key technologies.
👇Link to guide below
#python #dataviz @pandas_dev @CoiledHQ #datascience #Analytics
