2024-03-06

Attending: Sanket Verma (SV), Davis Bennett (DB), Josh Moore (JM), Eric Perlman (EP), Gabor Kovacs (GB), Norman Rzepka (NR), Felix Cremer (FC), Agriya Khetarpal (AP)

TL;DR:

Key updates include a new blog post, upcoming HTTP Extension Meeting, and a SciPy 2024 talk submission. Discussions covered introductions, HTTP extension requirements, a potential new release, testing on big-endian images, organizing community meetings, and updates on GeoZarr conversion, ZipStore limitations, and Pydantic-Zarr.

Updates:

• New blog post: https://zarr.dev/blog/zulip-transition/
  • Join ZulipChat: https://ossci.zulipchat.com/
• Next HTTP Extension Meeting on 3/14
  • Previous meeting notes: https://docs.google.com/document/d/14TJfrjbfU1R2REjrZ35GjV74MJ18j_m6geWdj0oB83Y/edit?usp=sharing
  • Info: https://zarr.dev/community-calls/
• Joe H. submitted a talk on Zarr-Python V3 @ SciPy 2024
• Davis re-initiated the effort for Thinning Zarr-Python: https://ossci.zulipchat.com/#narrow/stream/423692-Zarr/topic/thinning.20.60zarr-python.60

Meeting Minutes:

• Introductions w/ Favourite Python Package
  • SV: Zarr-Python
  • FC: From Julia Programming Language
  • EP: Msgpack
  • DB: Typing
  • NR: Zarrita
  • JM: SnoopyCrimeCop
  • GB: NumPy
  • AK: Improve Pyiodide distribution; favourite package: SciPy
• HTTP Extension
  • Davis: is it clear what they need/want?
  • Josh: requirement seemed to be up/down navigation
  • Eric: “nanocent” per listing. Would suggest avoiding it.
  • EP: Would be against HTTP extension - would be in favour of it it’s an optional spec
  • NR: Valid uses cases to discover hierarchies - could be a sidecar file
  • EP: https://forum.image.sc/t/updated-ngff-support-in-fiji-hdf5-n5-zarr-ome-ngff/91705
• New release 2.17.1? → https://github.com/zarr-developers/zarr-python/pull/1673
  • JM: Doing a release via Zoom ScreenSharing
• Enable testing on big endian image → https://github.com/zarr-developers/zarr-python/pull/869#issuecomment-1978443218
  • JM: Antonio Valentine from Pytables
  • SV: Maybe involve Scientific Python community - they’re looking for packages to upload nighly wheels
• Organising community meetings over at Gather
  • For e.g.: https://napari.zulipchat.com/#narrow/stream/212875-general/topic/aint.20no.20party.20like.20a.20PR.20party
• https://gist.github.com/joshmoore/715b6cb74e74fce4feac7c610eef4d96
  • JM: Helper to convert Geoparquet → GeoZarr
  • DB: PangeoForge might have a solution
  • DB: GeoParquet is mostly raster data - the lat and lon need to form a grid
  • JM: Rasterize to Zarr!
  • DB: Maybe Xarray support Zarr
  • JM: Couldn’t get Dask to open parquet file
• https://github.com/zarr-developers/zarr-python/issues/1695
  • ZipStore can only write once
• DB: Released a new version of Pydantic-Zarr
  • Release notes: https://github.com/janelia-cellmap/pydantic-zarr/releases
• AK: Would like to send a PR improve the Pyiodide support with numcodecs
  • DB: Numcodecs is not super busy and PRs improving stuff are most welcome