Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a way to filter invalid activities from an IATI file to make it valid #58

Open
rolfkleef opened this issue May 19, 2022 · 1 comment
Labels
Improvement Fixes for quality that affect the customer experience (bugs, incidents, changes) S2I Updates and changes related to spreadsheet conversions

Comments

@rolfkleef
Copy link
Member

The offline conversion process includes a filter step at the end: it does schema validation using a paid-licensed Saxon version to obtain Xpaths of elements with schema validation errors, and then uses these Xpaths to filter the IATI XML, and exclude any iati-activity with an error inside.

The resulting IATI XML may miss information about some activities, but is guaranteed schema-valid.

We rely on this in a custom configuration, where the exports from various source systems are not consistent.
For instance, there may be information about transactions that are not related to projects with general information.
Since the source systems are not linked, it is not possible to exclude such transactions from the export, but activities with only transaction information can easily be filtered using this schema validation filter step.

@rolfkleef rolfkleef added Improvement Fixes for quality that affect the customer experience (bugs, incidents, changes) S2I Updates and changes related to spreadsheet conversions labels May 19, 2022
@rolfkleef rolfkleef self-assigned this May 19, 2022
@rolfkleef rolfkleef moved this to Backlog in iati-workbench r&d May 19, 2022
@rolfkleef rolfkleef moved this from Backlog to Todo in iati-workbench r&d May 19, 2022
@rolfkleef
Copy link
Member Author

removing from epic: no longer a requirement, but a feature to discuss

@rolfkleef rolfkleef removed their assignment Mar 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Improvement Fixes for quality that affect the customer experience (bugs, incidents, changes) S2I Updates and changes related to spreadsheet conversions
Projects
Development

No branches or pull requests

1 participant