@zarr_dev
Account based inGermany
About this account
- Account based in
- Germany
- Connected via
- Web
Account-level information from X, not a live location or the device used for a specific post.
Hi Zarrites! 👋🏻
We have our bi-weekly community meeting today. 🗓️
These meetings are a great place to share updates, showcase your projects, raise an issue, or converse with the vibrant community. 🧑🏻💻
Join here: zarr.dev/community-calls/
zarr_dev retweeted
3/ 𝐅𝐥𝐮𝐱 𝐜𝐡𝐚𝐧𝐠𝐞𝐬 𝐭𝐡𝐚𝐭.
Flux is a plug-and-play solution for serving @zarr_dev data directly from object storage—no bespoke APIs, no server maintenance. Just standard-compliant, production-grade endpoints your tools already know how to use.
zarr_dev retweeted
Very happy to announce our winter release of @syGlassVR: 2.2.0!
Now control syGlass with your voice! We've also enhanced auto-segmentation, mask handling, and supercharged our narration system. We've also included some basic support for @zarr_dev.
syglass.io/blog/announcing-s…
zarr_dev retweeted
Our friend's over at @zarr_dev made a big release today!
Xarray v2025.01.1 was also released today with full support for Zarr-Python 3 🚀
🎉 Zarr-Python 3 is here! 🎉
- Full support for Zarr v3 spec
- Chunk-sharding for more efficient data storage
- Major performance boosts with async I/O & parallel compression
💻 pip install --upgrade zarr
Blog post: zarr.dev/blog/zarr-python-3-…
🎉 Zarr-Python 3 is here! 🎉
- Full support for Zarr v3 spec
- Chunk-sharding for more efficient data storage
- Major performance boosts with async I/O & parallel compression
💻 pip install --upgrade zarr
Blog post: zarr.dev/blog/zarr-python-3-…
Hi, Zarr community! 👋
🚨 Big news: Zarr-Python 3.0 is dropping next week! 🚨
If your project depends on Zarr-Python, make sure to check out the migration guide to get ready for the update.
Guide: zarr.readthedocs.io/en/lates…
More updates soon! 🧑🏻💻
Hi Zarrites! 👋🏻
We have our bi-weekly community meeting today. 🗓️
These meetings are a great place to share updates, showcase your projects, raise an issue, or converse with the vibrant community. 🧑🏻💻
Join here: zarr.dev/community-calls/
zarr_dev retweeted
Also on Thursday, I'll be giving an invited talk titled "Seamless Arrays: A Full Stack, Cloud-Native Architecture for Fast, Scalable Data Access". It combines all that we've been working on for the past year including @zarr_dev v3, #icechunk, and Xpublish.
agu.confex.com/agu/agu24/mee…
Hi Zarrites! 👋🏻
We have our bi-weekly community meeting today. 🗓️
These meetings are a great place to share updates, showcase your projects, raise an issue, or converse with the vibrant community. 🧑🏻💻
Join here: zarr.dev/community-calls/
zarr_dev retweeted
Kicking off the OME-NGFF #hackathon 2024 @UZH_en today! 🚀 With funding kindly provided by @NFDI4BIOIMAGE, we are bringing together experts on #OME #Zarr in Python, Java & image analysis workflows. Follow for updates on the future of a #FAIR bioimaging standard.
zarr_dev retweeted
In their Perspective article, @VirginieUhlmann, Matthew Hartley, @notjustmoore, Erin Weisbart and @AssafZaritsky tell us how we can make the most out bioimage data through interdisciplinary interactions.
journals.biologists.com/jcs/…
#JCSImagingSI
ALT Cartoon of two squirrels breaking into a nut. One squirrel has a collection of walnuts and is ‘describing’ the nut within the nutshell, while holding up a nut from a nearby broken shell. The other squirrel presents an equation showing that they get the nut by hitting the nutshell with a hammer, while hitting and breaking one of the nutshells with a hammer. The cartoon was drawn by Henning Falk.
Hi Zarrites! 👋🏻
We have our bi-weekly community meeting today. 🗓️
These meetings are a great place to share updates, showcase your projects, raise an issue, or converse with the vibrant community. 🧑🏻💻
Join here: zarr.dev/community-calls/
zarr_dev retweeted
#30DayMapChallenge Day 6: Rasters
Opinionated metrics on where's good to live, based on a year or two of @ECMWF ERA5 data. Built a lib called zarr-gl to make this work, maybe a useful step getting @zarr_dev into everyone's browsers. Check it out: rainy.rdrn.me/
zarr_dev retweeted
Very proud to announce Dataset v2.0! ✨
When we first set out to build a universal data format, I wasn't sure if it would ever work. Work to be done, but by building on top of @zarr_dev we're standing on the shoulders of giants.
Come build with us! 🧑💻
github.com/polaris-hub/polar…
🧵With the Polaris Hub, we sought to design a universal data format for ML scientists in drug discovery.
Whether you’re working with phenomics, small molecules, or protein structures, you shouldn’t have to spend time learning about domain-specific file formats, APIs, and software tools to be able to run some ML experiments.
zarr_dev retweeted
If you've ever wondered about rendering @zarr_dev in @Blender, you should check out @GrosOane's video! 🤩
Microscopy Nodes 2.0 is out! This includes a new channel interface and OME-Zarr support! 🔬🎉
youtube.com/watch?v=ybQcKEqU…
zarr_dev retweeted
Xarray v2024.10.0 has just been released, including support for xarray.DataTree and zarr-python v3 !!!
github.com/pydata/xarray/rel…
@xarray_dev @zarr_dev
Hi Zarrites! 👋🏻
☁️ Looking for a reliable cloud-based data storage format? ☁️
🛠️ Interested in how Zarr works? 🛠️
If you have more questions, please join us during Zarr's office hours today! 🧑🏻💻
More info: zarr.dev/office-hours/
zarr_dev retweeted
⚡️ Icechunk is fast! What does this mean for users? Reduced cost for all data-intensive compute jobs and enhanced productivity for the data scientists who work with data all day long.
Icechunk, @EarthmoverHQ's new transactional cloud-native storage engine for array / tensor data, works together with @zarr_dev , augmenting the Zarr core data model with features that enhance performance, collaboration, and safety in a multi-user cloud-computing context.
Reading data through Icechunk is 36x faster than trying to read HDF5 files from cloud object storage, 6x faster than regular Zarr alone, and 2.5x faster than regular Zarr + Dask. Most importantly, Icechunk can achieve throughput on par with the compute instance network bandwidth, the "hardware limit" for I/O bound workloads.
Want to learn more about this benchmark? Come to our Icechunk informational webinar tomorrow, Tuesday, October 22nd from 12 - 1 PM EST. Registration link: share.hsforms.com/1SCOFqe2kT…
ALT Performance analysis of various I/O stacks for reading data from S3. The NetCDF dataset was a 1.8 GB NetCDF file (4GB uncompressed) from the NSF NCAR Curated ECMWF Reanalysis 5 (ERA5) The dataset was transformed to Zarr with zstd compression and written in both V2, V3, and V3 + Icechunk format. It was read back using Xarray plus different I/O stacks, with and without Dask.
zarr_dev retweeted
We’re hosting a webinar on Tuesday, October 22 from 12- 1 PM EST to discuss what Icechunk means for the scientific data community and answer questions from attendees. Register here: share.hsforms.com/1SCOFqe2kT…
🚀 We are thrilled to announce the release of the Icechunk storage engine, a new open-source library and specification for the storage of multidimensional array (a.k.a. tensor) data in cloud object storage.
Read our blog post about Icechunk here: earthmover.io/blog/icechunk
Hi Zarrites! 👋🏻
We have our bi-weekly ZEP meeting today at 9:00 PT. 🗓️
ZEP meetings hold discussions for the Zarr specification and ways to evolve it, ongoing ZEPs, and improving the overall process. 🧑🏻💻
Join here: zarr.dev/zeps/meetings/