NetCDF Data

Using @jaltekruse repo, netcdf-test, as a starting point create Python logic to download data from ScienceBase and create NetCDF files.

Follow same logic as ncm-database to download from ScienceBase and use Poetry for Python dependency management.

Steps:

• Initial Python Poetry setup (see !47 (merged))
• Setup ability to download from ScienceBase (see !49 (merged))
• Add preprocessing code to parse files and get dimensions for NetCDF (see !50 (merged))
• Add code to convert 2018a model to NetCDF

mentioned in issue #15 (closed)

changed milestone to %Models & Data (extended)

added To Do label

added In Progress label and removed To Do label

marked the checklist item Initial Python Poetry setup as completed

changed the description

@bclayton - code is "cleaned up" on branch prep-for-import (https://code.usgs.gov/ghsc/users/jaltekruse/netcdf-test/-/tree/prep-for-import/) and ready to be brought over to nshmp-netcdf. I think all you need is in the python directory. I didn't move it to a src/main/python directory structure as I figured there would be other changes, once moved here, that would also break the tests so I didn't want to do it twice.

The nshmpNetcdf.retrieve does download data from ScienceBase, but I wrote this before I new about the ScienceBase API. Dataset paths and files are hard coded (for all NSHMP datasets from 2008 to the latest 2018 release).

For reference: http://unidata.github.io/netcdf4-python/

mentioned in merge request !49 (merged)

marked the checklist item Setup ability to download from ScienceBase as completed

changed the description

mentioned in merge request !50 (merged)

changed the description

marked the checklist item Add preprocessing code to parse files and get dimensions for NetCDF (see !50 (merged)) as completed

mentioned in merge request !53 (merged)

closed with merge request !53 (merged)

mentioned in commit 6e58b953