Scientific software - domain review
Following a discussion on 08/27/24, the Vizlab team has decided to move forward with website releases being "Scientific software" releases, whereby:
Scientific Software. Software containing source code implementing scientific algorithms or producing scientific data. It may include any custom developed code yielding scientific results, thereby facilitating a clear scientific workflow of analysis, scientific integrity, and reproducibility.
which requires domain review:
Domain reviews are specific to Scientific Software (Refer to Scientific Software IM) and ensure the software generates output that aligns with published or otherwise well-known expected results. Domain reviews may involve:
- Comparing output with external data sets
- Comparing algorithms with published, scholarly articles about the algorithm
- Reviewing unit and integration test results
Domain reviews should be performed by a trusted scientific expert with applicable subject-matter knowledge as well as sufficient applicable programming knowledge.
Domain reviews must be applied at Scientific Software stages:
- Approved Software
This process was done post hoc in the Merge Request (MR) process. Namely in these MR's where @cnell helped review processing and munging of the Uncertainty Summary of Water Vulnerability in the Western US 2000-2022 data used:
- !2 (merged) (Processing vulnerability data for evidence & agreement)
- !13 (merged) (Updating dendrogram data source)
- !21 (merged) (Use updated indicator uncertainty data)
- !22 (merged) (Beeswarm visualization elements)
- !23 (merged) (Adding Census maps to accordions)
- !40 (merged) (Refining dendrogram function and design)
@cnell, please confirm whether this thoroughly follows the domain review process. And/or if additional review is needed. Thank you.