Skip to content
Snippets Groups Projects

Overhaul EdgeFactory and MiniSeedFactory for Edge data migration

  1. Feb 18, 2025
    • Erin (Josh) Rigler's avatar
      Update version info in preparation · 4aa57dfa
      Erin (Josh) Rigler authored
      I want to push this MR to production as soon as we've verified things work in the dev environment as well as in local testing. Since I forgot to update to 1.13.0 in the last release tag, I'll make this part of 1.13.1.
      4aa57dfa
    • Erin (Josh) Rigler's avatar
    • Erin (Josh) Rigler's avatar
      Fix minor unit test failures: · 2d7c3cdd
      Erin (Josh) Rigler authored
      - MiniSeedInputClient expects a stream as input, not a trace
        (like RawInputClient), and unit tests were designed around this;
        I reverted _put_channel() to its original design, which sends an
        entire stream instead of one trace at a time.
      - I forgot to include a tiny change to RawInputClient_test that was
        part of the original (abandoned) MR
      - I also made the read client timeout configurable
      2d7c3cdd
    • Erin (Josh) Rigler's avatar
      Use EdgeFactory for all but tenhertz data: · 2e7a766f
      Erin (Josh) Rigler authored
      - assumes updates to filters.py, EdgeFactory, and MiniSeedFactory included in this feature branch
      - removes default ports in favor of factory defaults
      - tenhertz data will still use MiniSeedFactory, and if channels "U", "V", or "W" are requested, the raw voltage and bin data will be used to calculate nT outputs
      2e7a766f
    • Erin (Josh) Rigler's avatar
      Add "tenhertz" to LegacySNCL.py · edd44e60
      Erin (Josh) Rigler authored
      edd44e60
    • Erin (Josh) Rigler's avatar
      Update filters.py (code for geomag-filter typer app): · e3387de2
      Erin (Josh) Rigler authored
      - stop using factory.py; just instantiate factories in filters.py...it's only a little extra code, and a lot less confusing
      - copy 1-second ObsRio float data (e.g., F, UK*) to RawInput so it is available using EdgeFactory, and also so we have the option in the future to prune 10Hz data from EdgeCWB that has already been archived at IRIS.
      - set up calls to _copy_channel to legacy sncls to be removed once Edge data migration is complete
      - make all *_filter methods require an instantiated io factory, and set no default options
      - other than the *temporary* write ports for copies of legacy sncl data, allow no default ports in filters.py; either accept the factory defaults, or force user to specify ports with call to geomag-filter app.
      e3387de2
    • Erin (Josh) Rigler's avatar
      TimeseriesUtility Updates: · 18cece6d
      Erin (Josh) Rigler authored
      - better handle hour and day intervals in create_empty_trace
      - enode_stream now handles "STEIM" encoding
      - fixed bug in pad_and_trim_trace
      18cece6d
    • Erin (Josh) Rigler's avatar
      Controller Update: · 114bbd6f
      Erin (Josh) Rigler authored
      - align timestamps more consistently for "update" intervals
      - (related) add "interval" option to get_realtime_interval
      114bbd6f
    • Erin (Josh) Rigler's avatar
      RawInputClient Update: · e5b61b9d
      Erin (Josh) Rigler authored
      - handle intervals other than 1s and 1m properly
      e5b61b9d
    • Erin (Josh) Rigler's avatar
      EdgeFactory Upgrades: · 2702d9f4
      Erin (Josh) Rigler authored
          - configurable scale_factor and float vs. int conversion logic
          - configurable sncl_mode for different channel mapping
          - multiple read ports allowed for fail-over logic
          - generally more (if not perfectly) compatible with MiniSeedFactory
      2702d9f4
    • Erin (Josh) Rigler's avatar
      MiniSeedFactory Upgrades: · 2bb0ec23
      Erin (Josh) Rigler authored
      - configurable scale_factor and float vs. int conversion logic
      - configurable sncl_mode for different channel mapping
      - multiple read ports allowed for fail-over logic
      - configurable write_encoding for setting miniseed data type
      - generally more (if not perfectly) compatible with EdgeFactory
      2bb0ec23
Loading