QPE StageIV Conversion to Zarr
Checklist for Workflow associated with dataset conversion:
Dataset Name: QPE_StageIV
-
Identify Source Data location and access -
Collect ownership information (Who do we ask questions of if we have problems?) -
Create new workflow notebook from template; stash in the ./workflows
folder tree in an appropriate spot.-
Identify landing spot on S3 -
Calculate chunking, layout, compression, etc -
Run notebook -
Read test (pattern to be determined by the dataset)
-
-
Reportage -
add notebook and the dask performance report to the repo -
Calculate summary statistics on output (compression ratio, total size)
-
-
Merge and close the issue.
Edited by Blodgett, David L.