2023-10-18

Attending: Davis Bennett (DB), Florian Ziemen (FZ), Sanket Verma (SV), Eric Perlman (EP), Ward Fisher (WF), John Kirkham (JK), Janos Zimmermann (JZ), Norman Rzepka (NR), Dennis Heimbigner (DH)

TL;DR:

Today, everyone shared their favourite books during the introduction round. FZ asked if NetCDF has HTTP support. WF will be submitting a pre-recorded talk to AGU and wondered if he could include anything graphical for Zarr.

SV asked for general feedback from the community and was happy to receive a positive response! 🎉

We concluded the meeting after having discussions on ZarrCon.

Updates:

• Updates from the Zarr-Python refactor and benchmarking team
  • Plan to use Zarrita classes in Zarr-Python - initial PR by Joe Hamman: https://github.com/jhamman/zarr-python/pull/1
  • Jack is on roll and have been working super hard - check the progress here: https://github.com/orgs/zarr-developers/projects/4/views/1
• Josh applied for CZI EOSS6 - covers community engagement portion of the project
• Sanket presented at CSCCE on how to manage specs and technical documentation - Slides and other links: https://github.com/MSanKeys963/presentations/tree/main/cscce_os_tools_trials
• Recent developments at numcodecs - moving towards a new release
• Numcodecs 0.12.1 release
• NR gave a talk about OME-Zarr at the Crick X-Ray symposium

Meeting Minutes:

• Introductions w/ favourite books
  • SV: A Song of Ice and Fire
  • DB: 266 by Roberto Bolanó
  • EP: Through the looking glass
  • FZ: German Climate Computing Centre; Book - Magnum Magnum
  • WF: House of Leaves
  • JK: You have more influence than you think
  • JZ: German Climate Computing Centre; Book - Gardening and Sustainability
  • NR: LOTR
• Question for Ward/Dennis (Unidata) - Do you plan to have support for HTTP in NetCDF-C? Open for collaborations?
  • FZ: Idea is to use NetCDF to access Zarr Store via HTTPS
  • WF: Happy to expand on this in the meeting, but we support http/https through the DAP2/DAP4 protocols (https://www.opendap.org/). We also have S3 support that we are planning how to better publicize.
  • WF: We are also always open for collaborations!
  • DH: If data storage server can read Zarr and can handle the translations DAP3/4; it could work
  • DH: Byte range access for contiguous data
  • DH: Need to add support for Zarr directory subtree format as a driver to accomplish - good idea!
• WF: I’ll be submitting a pre-recorded talk to AGU re: the current state of NetCDF integration w/ Zarr. I’d be interested in including any general Zarr info into the talk.
  • SV: Useful resources for Ward
    • Zarr Illustrations: https://github.com/zarr-developers/zarr-illustrations-falk-2022
    • Zarr Poster: https://zenodo.org/records/8340248
• Feedback from the community
  • DH: Excellent Job by Sanket! 👏🏻
  • FZ: Feels welcomed as I’ve joined the community recently!
  • DB: Think about Gitter!
    • SV: Summary of other platforms - Discord, Discourse, Zulip, Slack etc.
    • EP: Zarr is not big enough for a Slack
    • FZ: Mattermost similar to Slack
  • NR: Very grateful for the meeting notes!
• SV: ZarrCon
  • NR: Janelia might be interested - Having 2 conferences not makes sense - bring people from various domains together will foster collaboration
  • DB: +1 to the idea
  • EP and FZ: Align the ZarrCon with other big conferences, e.g. Supercomputing conference
  • EP: Send out a poll to see which conferences are people going to attend