Description: This two-part seminar will introduce Xarray and Zarr and dive into the details of how these tools can be used to manipulate large multi-dimensional datasets. Zarr is becoming a common format for large multi-dimensional datasets in AI/ML workflows due to its ability to chunk large datasets and enable fast, scalable access. Xarray provides a high-level interface to multi-dimensional data that simplifies working with Zarr files. Part 1 of this seminar will cover the basics of Xarray for reading, writing, and interacting with multi-dimensional data and introduce the Zarr specification. Part 2 will cover a few advanced capabilities of Xarray and demonstrate an end-to-end workflow that pre-processes geophysical data, trains a model, and generates outputs.

CUI