Skip to main content Link Menu Expand (external link) Document Search Copy Copied

4th November, 2020

Notes, with Daylight saving time ending it might be unclear at what time this meeting is.

Attending: Ryan Williams, Mathias Bussonnier, Eric Perlman, Martin Durant, Josh Moore, John Kirkham

“Waiting for the host to start this meeting”… I think it’s Josh’s zoom right?

I’ll make a Zoom in the meantime: https://us02web.zoom.us/j/86935712322

It requests a password:

Josh: Sorry, I thought we had another 45 minutes. Am currently “at” #biodata20

Discussing #645; Martin to have a look.

TravisCI changing terms

FAQ; TravisCI to give one-off 1000mins to OSS on 1/1/21? won’t last long

  • GH actions has macOS; unsure how to spin up Docker multiple docker services (e.g. redis) in GH actions?

    • in travis we use `sudo: true` and run services outside docker
  • unsure where else we can test on macOS; CircleCI seems to support it (for $$).

  • thinking we can negotiate something w/ TravisCI

  • Azure has {macOS,Linux/Windows}.

  • Could put some things on GHA, leave some on Travis

  • Github Action Vuln: https://news.ycombinator.com/item?id=24980187 ; https://bugs.chromium.org/p/project-zero/issues/detail?id=2070&can=2&q=&colspec=ID%20Type%20Status%20Priority%20Milestone%20Owner%20Summary&cells=ids


new fsspec feature (unreleased): map specific remote byte ranges to local path? cf. zarr-python#556, intake/filesystem_spec#464, HDF5-walking gist

  • in principle, could also use this to virtually concatenate byte-ranges from multiple remote files into one “local” file
  • Eric Perlman: scale to millions or billions? Probably not, but could use a generator approach.
  • Neuroglancer: https://github.com/google/neuroglancer
  • Also sped up by the new async work.
  • Trevero Manz (or colleague)’s tiff-tiler (offsets from OME-TIFF): https://github.com/hms-dbmi/ome-tiff-tiler/blob/master/context/ometiff_tiler.py

Lots of open PRs need review on zarr-{python,specs}.

Misc:

  • (after everything else) Josh: Zoom link & calendar entry