As a user, I want EDAN/IDS operations to keep pace with ingests. Ingest current runs in multiple pipelines. The EDAN/IDS operations run in a single pipeline and lags well behind the ingest pace. When ingest is heavy the EDAN/IDS pipeline cannot catch up but only completes when there is a slowdown of ingest operations. This will only get worse with the inclusion of event-driven updates.
Revise the EDAN/IDS to support multiple parallel pipelines.
- relates to
-
SID-1116 As a operator, I want EDAN/IDS operations to keep pace with ingests because ingest can get backed up waiting (Pipeline Enhancement Task 1)
- Closed