@TomAugspurger

@TomAugspurger@mastodon.social

 Des Moines, IA
tomaugspurger.github.io
Joined March 2009
  • Tweets2.4K
  • Following173
  • Followers4.7K
86Media
Icechunk's design solves so many of the headaches we faced when trying to update Zarr datasets on the Planetary Computer. Check it out!
Earthmover@EarthmoverHQ15 Oct 2024
🚀 We are thrilled to announce the release of the Icechunk storage engine, a new open-source library and specification for the storage of multidimensional array (a.k.a. tensor) data in cloud object storage. Read our blog post about Icechunk here: earthmover.io/blog/icechunk

Announcing Icechunk! | Earthmover

Earthmover announces Icechunk, an open-source transactional storage engine for Zarr that brings ACID transactions, time travel, data versioning, and high-performance Rust-based I/O to multidimensio...

earthmover.io
1
5
28
2,376
Some personal news: I'm looking for a job! tomaugspurger.net/posts/leav… Some of my (very talented) former teammates are also looking for a job, so reach out if you're hiring!

What's Next? (2024 edition)

I have, as they say, some personal news to share. On Monday I (along with some very talented teammates, see below if you’re hiring) was laid off from Microsoft as part of a reorganization. Like my...

tomaugspurger.net
14
43
11
122
36,788
Finally got around to writing a blogpost on flox. Faster groupby/binning/resampling/climatologies with @xarray_dev and/or @dask_dev described at xarray.dev/blog/flox See flox.readthedocs.io/en/lates… for quick examples

flox: Faster GroupBy reductions with Xarray

flox enables significantly faster groupby calculations for Xarray/Dask/Pangeo array computing ecosystem.

xarray.dev
1
25
2
117
14,828
Debugging a dask-geopandas performance issue, which turned out to be a data partitioning issue: tomaugspurger.github.io/post…
1
3
11
3,944
Planetary Computer Release (January 2023): tomaugspurger.github.io/post…
15
1
99
10,534
For those at AMS, I'll be presenting (virtually) on the Planetary Computer at 10:45: ams.confex.com/ams/103ANNUAL…

Using Big Data Repositories: Open Data Feeding Open Science

Following up in the annual Big Data Town Hall, this session seeks presentations on the use of big data repositories including the NOAA Open Data Dissemination Program ( former Big Data Program) the...

ams.confex.com
3
918
Come work with Julia Kent, @scotty_h_q, @JessicaScheick, Alan Snow and me on improving @xarray_dev satellite data workflows for a PAID summer internship at NCAR! See project 8: www2.cisl.ucar.edu/outreach/… for a description but the forecast is "cloudy with a chance of @dask_dev"
1
23
3
32
Tom Augspurger retweeted
Kyle Walker
@kyle_e_walker28 Nov 2022
I'm excited to announce pygris, a new #Python package to help you work with @uscensusbureau geographic datasets (and other resources)! Read the docs: walker-data.com/pygris/ Try out pygris on Colab: colab.research.google.com/dr… Source code: github.com/walkerke/pygris #pydata #gischat
Census tracts in King County, WA with water area removed

ALT Census tracts in King County, WA with water area removed

A map using SAHIE Census data with counties shifted and rescaled.

ALT A map using SAHIE Census data with counties shifted and rescaled.

Example usage of pygris to get Census tracts within 5km of a location.

ALT Example usage of pygris to get Census tracts within 5km of a location.

3
54
9
247
Tom Augspurger retweeted
Pangeo@pangeo_data4 Nov 2022
All are welcome to join us at the next Pangeo Showcase at the Community meeting where we welcome @jorisvdbossche to discuss advances in @geopandas. discourse.pangeo.io/t/wednes…

Wednesday November 9th 2022: GeoPandas: Easy, fast and scalable geospatial analysis in Python

Next week, November 9th, we are pleased to welcome Joris Van den Bossche to the Pangeo Showcase at the Community meeting to talk to us about the most recent improvements to GeoPandas and how our two...

discourse.pangeo.io
6
7
Tom Augspurger retweeted
Pete Gadomski@petegadomski4 Nov 2022
I made a small CLI tool for downloading a @STACspec item's assets from the Planetary Computer: github.com/gadomski/pc-rs/ If you use it, let me know what you think! 🦀

GitHub - gadomski/pc-rs: Small CLI tool for downloading assets from a Planetary Computer STAC Item

Small CLI tool for downloading assets from a Planetary Computer STAC Item - gadomski/pc-rs

github.com
3
7
30
Do I know anyone using GOES-GLM data goes-r.gov/spacesegment/glm.…? Are people doing any kind of longer time-series analysis with data from many files, or are you typically just using one file at a time?

Geostationary Lightning Mapper (GLM)

The Geostationary Lightning Mapper (GLM) is a single-channel, near-infrared optical detector on the GOES-R Series satellites.

nesdis.noaa.gov
2
1
I'm a sucker for discussions on risk vs. uncertainty, but I'd recommend anyone listen to this episode.
Allen Downey@AllenDowney28 Oct 2022
This podcast with @CMastication is very good (and I always appreciate an audio player with speed control) datascience.salon/project/ep…

Episode 27 - Probabilistic Thinking with James "JD" Long

Our show host and Senior Content Advisor, Q McCallum, has been thinking a lot about what he calls "moving beyond the point estimate" in ML modeling. That usually starts with seeing the world in terms...

ailovesdata.com
4
Tom Augspurger retweeted
Rob Emanuele@lossyrob25 Oct 2022
Are you a senior level software engineer? Come work at @microsoft and build the Planetary Computer with us! aka.ms/build-the-planetary-c…
1
28
2
65
Tom Augspurger retweeted
Pangeo@pangeo_data19 Oct 2022
Today's Pangeo Showcase will be at **12PM EDT**. An earlier post listed the incorrect time. 🤦 We're excited to hear @matthmohr and @_stille83_ talk about @openEO_Platform! discourse.pangeo.io/t/wednes…

Wednesday October 19th 2022: openEO: What it is and how it relates to Pangeo

Announcement This week on Pangeo showcase we are pleased to welcome Matthias Mohr and Alexander Jacob to talk about openEO, what it is and how our communities can collaborate! Meeting Logistics...

discourse.pangeo.io
4
1
4
Tom Augspurger retweeted
Matthew Rocklin@mrocklin17 Oct 2022
Dask is trying out a monthly demo showcase. Interested in sharing your work in a 5-10 minute demo to the broader community? Engage on this thread, or in this GitHub issue: github.com/dask/community/is… I'd like to get a good mix of dev tools and use cases. Please don't be shy!

Demo day 2022-10-27 · Issue #282 · dask/community

We'll be organizing a demo day (see #280) Thursday next week at 8am US Pacific, 5pm Central European Time. Context I'd like to solicit 5-10 minute demos that show off ongoing or lesser know...

github.com
8
16
Tom Augspurger retweeted
Andreas Mueller@amuellerml14 Oct 2022
Pandas DataFrame output is now available for all sklearn transformers (in dev)! scikit-learn.org/dev/auto_ex… This will make running pipelines on dataframes soo much easier, and provides better ways to track feature names! thanks to @thomasjpfan @glemaitre58 and Christian Lorentzen!

Introducing the set_output API

This example will demonstrate the set_output API to configure transformers to output pandas DataFrames. set_output can be configured per estimator by calling the set_output method or globally by se...

scikit-learn.org
13
139
27
603
Tom Augspurger retweeted
Joe Hamman@_jhamman11 Oct 2022
In the near term, we’re looking to hire two engineers to help us build our first products. My DMs are open for any questions about these positions. earthmover.io/posts/earthmov…
5
13
Tom Augspurger retweeted
Pangeo@pangeo_data5 Oct 2022
What's happening? We're about to hear from @LeahAWasser at the community meeting in an hour! discourse.pangeo.io/t/wednes…

Wednesday October 5th 2022: pyOpenSci: A diverse community that supports open tools that drive open...

Announcement Hello all, showcase will be taking a brief hiatus this week, but please still come to the community meeting if interested. Please join us at next weeks showcase to learn about pyOpenSci...

discourse.pangeo.io
7
8
Tom Augspurger retweeted
SatSummit@sat_summit23 Sep 2022
Managing Planetary Scale Archives in the Cloud Weds, 9/28 - 3:25 PM ET 2022.satsummit.io/agenda#28-… 🛰️@yayyyimee @developmentseed 🛰️@TomAugspurger @Microsoft Planetary Computer 🛰️@_VincentS_ @developmentseed 🛰️Monica Youngman, @NOAANCEI 🛰️Michele Thornton, @ORNL #SatSummit2022
4
8
Load more