Skip to content
This repository has been archived by the owner on Dec 22, 2022. It is now read-only.

Create more test coverage for ingest pipeline #1639

Open
weiweishi opened this issue May 9, 2019 · 1 comment
Open

Create more test coverage for ingest pipeline #1639

weiweishi opened this issue May 9, 2019 · 1 comment
Labels
current phase issues identified as need to be fixed in current phase technical-debt

Comments

@weiweishi
Copy link
Contributor

We currently don't have much test coverage for the ingest pipeline, including sources from symphony, SFX, databases, and Kule collections. We'd like to create more tests to validate the ingest is successful, and the metadata are ingested as expected.
As part of this, we will also need to rethink the test dataset #1628. A potential solution is to have separate seed files for UAT where more data is needed for acceptance tests, and one for spec tests.

@weiweishi weiweishi added current phase issues identified as need to be fixed in current phase technical-debt labels May 17, 2019
@weiweishi
Copy link
Contributor Author

weiweishi commented May 17, 2019

  • Have a radioactive record for each of the ingest pipeline. need one for each ingest pipeline.
  • Compare test metadata with the data in Solr, check a few fields with Solr queries i.e q=title_t:*
  • Compare the number of test records vs the number of item ingested in Solr.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
current phase issues identified as need to be fixed in current phase technical-debt
Projects
None yet
Development

No branches or pull requests

1 participant