red_river_2018 Conversion to Zarr

Checklist for Workflow associated with dataset conversion:

Dataset Name: Very High-Resolution Dynamic Downscaling of Regional Climate for Use in Long-term Hydrologic Planning along the Red River Valley System

https://cida.usgs.gov/thredds/catalog/demo/thredds/red_river_2018/catalog.html

https://cida.usgs.gov/thredds/catalog.html?dataset=cida.usgs.gov/red_river_2018

Dataset {
    Float32 HFX[Time = 315576][south_north = 165][west_east = 248];
    Float32 LH[Time = 315576][south_north = 165][west_east = 248];
    Float32 PBLH[Time = 315576][south_north = 165][west_east = 248];
    Float32 Q2[Time = 315576][south_north = 165][west_east = 248];
    Float32 RAINC[Time = 315576][south_north = 165][west_east = 248];
    Float32 RAINNC[Time = 315576][south_north = 165][west_east = 248];
    Float32 SWDOWN[Time = 315576][south_north = 165][west_east = 248];
    Float32 T2[Time = 315576][south_north = 165][west_east = 248];
    Float32 U10[Time = 315576][south_north = 165][west_east = 248];
    Float32 V10[Time = 315576][south_north = 165][west_east = 248];
    String time_char[Time = 315576];
    Int32 Time[Time = 315576];
    Float32 XLAT[south_north = 165][west_east = 248];
    Float32 XLONG[south_north = 165][west_east = 248];
} red_river_2018;

Recommend working from OPeNDAP

---

• Identify Source Data location and access (check the dataset spreadsheet)

• Collect ownership information (Who do we ask questions of if we have problems?)

• Create new workflow notebook from template; stash in the ./workflows folder tree in an appropriate spot.
  • Identify landing spot on S3 (currently somewhere in: https://s3.console.aws.amazon.com/s3/buckets/nhgf-development?prefix=workspace/&region=us-west-2)
  • Calculate chunking, layout, compression, etc
  • Run notebook
  • Read test (pattern to be determined by the dataset)
• Create STAC catalog entry;
  • Verify all metadata
  • Create entry
• Reportage
  • add notebook and the dask performance report to the repo
  • Calculate summary statistics on output (compression ratio, total size)
  • Save STAC JSON snippet to repo
• Merge and close the issue.