Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop an automated test under FAIR evaluator for ontology coverage assessment #45

Open
mcourtot opened this issue Oct 11, 2019 · 2 comments
Assignees
Labels
Resolute Issue associated with RESOLUTE project

Comments

@mcourtot
Copy link
Collaborator

Write a test for the metric using Wilkinson tool that can be assessed against the proteomics dataset.
Maybe create FAIRPlus collection of metrics at same time?

@mcourtot mcourtot added the Resolute Issue associated with RESOLUTE project label Oct 11, 2019
@mcourtot
Copy link
Collaborator Author

See https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/evaluations/170 for the existing evaluation of the transcriptomics

We need to see if we can write a test for a specific metric (eg Cellosaurus IDs on transcriptomics dataset) and possibly create a FAIRPlus transcriptomics collection.
If we can't we need to feedback to Mark and Michel that we need support for using the tool

@FuqiX
Copy link
Collaborator

FuqiX commented Jan 15, 2020

@JolandaS and @rgiessmann have discussed about this. Robert has more expertise in writing automatic tests.
Need to check if what can be measured from the UC2.
Also need to compare different evaluators.
The FAIRplus tests can be added to the FAIR evaluator GH.
Nick suggested the tests can be very dataset-specific. Chris suggested some indicators are more important for certain dataset.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Resolute Issue associated with RESOLUTE project
Projects
None yet
Development

No branches or pull requests

3 participants