Overhaul EdgeFactory and MiniSeedFactory for Edge data migration
- Feb 18, 2025
-
-
Erin (Josh) Rigler authored
I want to push this MR to production as soon as we've verified things work in the dev environment as well as in local testing. Since I forgot to update to 1.13.0 in the last release tag, I'll make this part of 1.13.1.
-
Erin (Josh) Rigler authored
-
Erin (Josh) Rigler authored
- MiniSeedInputClient expects a stream as input, not a trace (like RawInputClient), and unit tests were designed around this; I reverted _put_channel() to its original design, which sends an entire stream instead of one trace at a time. - I forgot to include a tiny change to RawInputClient_test that was part of the original (abandoned) MR - I also made the read client timeout configurable
-
Erin (Josh) Rigler authored
- assumes updates to filters.py, EdgeFactory, and MiniSeedFactory included in this feature branch - removes default ports in favor of factory defaults - tenhertz data will still use MiniSeedFactory, and if channels "U", "V", or "W" are requested, the raw voltage and bin data will be used to calculate nT outputs
-
Erin (Josh) Rigler authored
-
Erin (Josh) Rigler authored
- stop using factory.py; just instantiate factories in filters.py...it's only a little extra code, and a lot less confusing - copy 1-second ObsRio float data (e.g., F, UK*) to RawInput so it is available using EdgeFactory, and also so we have the option in the future to prune 10Hz data from EdgeCWB that has already been archived at IRIS. - set up calls to _copy_channel to legacy sncls to be removed once Edge data migration is complete - make all *_filter methods require an instantiated io factory, and set no default options - other than the *temporary* write ports for copies of legacy sncl data, allow no default ports in filters.py; either accept the factory defaults, or force user to specify ports with call to geomag-filter app.
-
Erin (Josh) Rigler authored
- better handle hour and day intervals in create_empty_trace - enode_stream now handles "STEIM" encoding - fixed bug in pad_and_trim_trace
-
Erin (Josh) Rigler authored
- align timestamps more consistently for "update" intervals - (related) add "interval" option to get_realtime_interval
-
Erin (Josh) Rigler authored
- handle intervals other than 1s and 1m properly
-
Erin (Josh) Rigler authored
- configurable scale_factor and float vs. int conversion logic - configurable sncl_mode for different channel mapping - multiple read ports allowed for fail-over logic - generally more (if not perfectly) compatible with MiniSeedFactory
-
Erin (Josh) Rigler authored
- configurable scale_factor and float vs. int conversion logic - configurable sncl_mode for different channel mapping - multiple read ports allowed for fail-over logic - configurable write_encoding for setting miniseed data type - generally more (if not perfectly) compatible with EdgeFactory
-