FLET Conversion to Zarr

Checklist for Workflow associated with dataset conversion:

Dataset Name: Daily reference and potential evapotranspiration, and supporting meteorological data, solar insolation data from the GOES satellite, and blue-sky albedo data from the MODIS satellite, Florida

https://cida.usgs.gov/thredds/catalog.html?dataset=cida.usgs.gov/flet_narr https://cida.usgs.gov/thredds/catalog.html?dataset=cida.usgs.gov/flet_stns

https://cida.usgs.gov/thredds/catalog/demo/thredds/FLET/catalog.html

Two aggregated OPeNDAP endpoints. Dataset is not large.

Recommend conversion directly from OPeNDAP endpoints.

---

• Identify Source Data location and access (check the dataset spreadsheet)

• Collect ownership information (Who do we ask questions of if we have problems?)

• Create new workflow notebook from template; stash in the ./workflows folder tree in an appropriate spot.
  • Identify landing spot on S3 (currently somewhere in: https://s3.console.aws.amazon.com/s3/buckets/nhgf-development?prefix=workspace/&region=us-west-2)
  • Calculate chunking, layout, compression, etc
  • Run notebook
  • Read test (pattern to be determined by the dataset)
• Create STAC catalog entry;
  • Verify all metadata
  • Create entry
• Reportage
  • add notebook and the dask performance report to the repo
  • Calculate summary statistics on output (compression ratio, total size)
  • Save STAC JSON snippet to repo
• Merge and close the issue.