add functionality to use new counts receipts from WQP 3.0 services
The new WQP 3.0 services have a different method for delivering relevant metadata for a query. Rather than pulling that information from the headers, it creates a 'receipt' that a user can retrieve (temporarily) using a wqp-request-id. Any functionality that relies on this metadata (provider counts, total # rows, etc) will need to be updated to use this new method.
Ex. curl -v -o "download.csv" "https://www.waterqualitydata.us/montage-svs-a/data/Result/search?providers=STORET&siteid=PYRAMIDLAKE-TRMPD&startDateHi=01-01-2010&startDateLo=01-01-2005&dataProfile=narrow"
The request is downloaded to "download.csv". There is a bunch of output, including this line showing the 'wqp-request-id' header: wqp-request-id: "b6c9a6d6-f093-4ada-9ce9-035824a79ce4"
Now make a request to the 'status' service w/ that id:
Dev tier 'montage' service (old)
curl "https://www.waterqualitydata.us/montage-svs-a/data/status/b6c9a6d6-f093-4ada-9ce9-035824a79ce4"
Prod service (use this one)
curl "https://www.waterqualitydata.us/wqx3/status/b6c9a6d6-f093-4ada-9ce9-035824a79ce4"
This is what is returned from the 'status' service:
{ "requestId": "7e2464f6-900d-44ce-82fa-f4855b74cb7b", "startTime": "2024-04-11T14:40:37.313696087Z[GMT]", "complete": false, "totalRows": 92701, "headerProvider": { "name": "epa-headers", "completeOrCancelled": true, "failed": false, "sourceRowCount": 1, "outputRowCount": 1 }, "dataProviders": [ { "name": "epa", "completeOrCancelled": false, "failed": false, "sourceRowCount": 67700, "outputRowCount": 67699 }, { "name": "usgs", "completeOrCancelled": false, "failed": false, "sourceRowCount": 25002, "outputRowCount": 25001 } ] }