Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mapping rdfization #51

Draft
wants to merge 126 commits into
base: master
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
126 commits
Select commit Hold shift + click to select a range
773df87
ignoring analytic tests
callahantiff Nov 1, 2020
b96ef26
removing unneeded tests
callahantiff Nov 1, 2020
0d4a803
reorganizing branch
callahantiff Nov 1, 2020
c6e0e8c
adding func to process mapping data
callahantiff Nov 2, 2020
6381145
adding funcs to process grouped mapping data
callahantiff Nov 2, 2020
fd3dbfe
adding missing data
callahantiff Nov 2, 2020
65c54d9
adding more missing data
callahantiff Nov 2, 2020
8a71b8f
improving func assumptions
callahantiff Nov 2, 2020
c554fc2
relaxing assumptions
callahantiff Nov 3, 2020
98e1e84
improving concept-level logic
callahantiff Nov 4, 2020
de8e778
completing draft of map results
callahantiff Nov 4, 2020
805fb5e
added rescaling func
callahantiff Nov 5, 2020
1cd1188
adding init for analyses repo
callahantiff Nov 5, 2020
aec6024
first draft pass
callahantiff Nov 6, 2020
6420eb1
updating plot information
callahantiff Nov 7, 2020
6a1b971
adding funcs to process concept prevalence data
callahantiff Nov 7, 2020
84d42fc
adding notbeook for mapping validation
callahantiff Nov 7, 2020
4b7af52
adding error analysis func
callahantiff Nov 8, 2020
6302767
updating notebook title
callahantiff Nov 9, 2020
70a481f
adding funcs to process missing concept sets
callahantiff Nov 9, 2020
57eb964
fixing classifies missing concept assumptions
callahantiff Nov 11, 2020
f5db55f
completed first draft of validation
callahantiff Nov 11, 2020
b2a8fcb
adding weighted sum
callahantiff Nov 11, 2020
a0dbac3
adding ro relation doc
callahantiff Nov 12, 2020
c91ffa2
adding readme with details on mapping kr
callahantiff Nov 12, 2020
5b3989a
removing period
callahantiff Nov 14, 2020
f4dd904
adding new script for semantic map processing
callahantiff Nov 14, 2020
7ec58d3
adding white space at end of file
callahantiff Nov 14, 2020
aa5a5cf
adding class constructor tests
callahantiff Nov 14, 2020
df32d5b
2/3 validation draft
callahantiff Nov 14, 2020
81c3ff2
cleaning up imports
callahantiff Nov 14, 2020
08f027a
adding recursive ancestor finding func
callahantiff Nov 15, 2020
b0f2ba0
refreshing output
callahantiff Nov 16, 2020
b1b2758
adding ontology merging function
callahantiff Nov 16, 2020
541d123
adding ontology merging test
callahantiff Nov 16, 2020
d844b75
adding ontology loading func and test
callahantiff Nov 16, 2020
36f49eb
re-generated output
callahantiff Nov 19, 2020
bbc709f
fixed typo in function
callahantiff Nov 20, 2020
c523028
updates the ontology ancestor finding alg
callahantiff Nov 27, 2020
c85cd7d
reordered/updated tests to match class parameters
callahantiff Nov 28, 2020
608a4e5
adding logic for domain input
callahantiff Nov 28, 2020
3bd8540
removing maping_semantics from gitignore
callahantiff Nov 28, 2020
e1b4f05
updating ro terms
callahantiff Nov 28, 2020
a059735
providing additional detail to README
callahantiff Nov 28, 2020
b1838c6
overhauled faulty tests
callahantiff Nov 29, 2020
07c96c0
adding test for dta org method
callahantiff Nov 29, 2020
d03c1e4
adding complementOf method and test
callahantiff Nov 30, 2020
4357cd3
added class construction method and test
callahantiff Nov 30, 2020
e525cb2
added method and tests to format ontology file output
callahantiff Nov 30, 2020
1a52728
adding method to serialize semantic representations
callahantiff Nov 30, 2020
ade7201
adding function and tests to add metadata
callahantiff Dec 1, 2020
d0cc27b
updated merging method
callahantiff Dec 1, 2020
ec617a5
light updates
callahantiff Dec 1, 2020
b53b491
adding ontology dictionary input parameter and tests
callahantiff Dec 3, 2020
5cac3d7
updating serialization method
callahantiff Dec 3, 2020
49cebbb
remove irrelevant comment
callahantiff Dec 8, 2020
c4ad686
updating logic extract method and tests
callahantiff Dec 8, 2020
5d3b4c0
added new data utils method
callahantiff Dec 11, 2020
9a1d678
updated data util tests
callahantiff Dec 11, 2020
a3479bd
refined overlapping span method
callahantiff Dec 11, 2020
1e6958e
overhaul overlap method
callahantiff Dec 11, 2020
a9ccf74
cleaned up logic extraction method
callahantiff Dec 11, 2020
4bec48f
had index output to overlap method
callahantiff Dec 12, 2020
6f92f83
overhauled class construction method
callahantiff Dec 12, 2020
c542b8f
satisfy typing check
callahantiff Dec 12, 2020
09f9f31
typing checkand test updates
callahantiff Dec 12, 2020
19c7d7c
added method to clean ontologies
callahantiff Dec 13, 2020
02f9beb
incorporating ontology cleaning method
callahantiff Dec 13, 2020
25695a9
adding owl output to mapping_semantics directory
callahantiff Dec 13, 2020
8180251
adding print statement
callahantiff Dec 13, 2020
477e83f
cleaned up comments
callahantiff Dec 13, 2020
93e7958
updated cleaning protocol
callahantiff Dec 15, 2020
0391f29
complete single construction draft
callahantiff Dec 15, 2020
443d116
adding regex
callahantiff Dec 15, 2020
df0d391
fixed broken assumptions
callahantiff Dec 15, 2020
673521a
moving file
callahantiff Dec 15, 2020
f388293
sig assumption overhaul
callahantiff Dec 15, 2020
186fbe2
adding openpxyl to setup requirements
callahantiff Dec 15, 2020
2ebfca0
updating requirements
callahantiff Dec 15, 2020
8935548
rolling back some modules
callahantiff Dec 15, 2020
4c85662
again...
callahantiff Dec 15, 2020
cb8dd9b
updating read_excel for new pandas version
callahantiff Dec 15, 2020
6b66fbf
strengthened filepaths
callahantiff Dec 15, 2020
5173d86
re-working file shutil
callahantiff Dec 15, 2020
4f94a05
remove duplicate code chunk
callahantiff Dec 15, 2020
be7c402
adding comment
callahantiff Dec 15, 2020
4e3e69a
chasing Travis error
callahantiff Dec 15, 2020
8540940
trying updated symlinks argument
callahantiff Dec 15, 2020
da9ab43
running experiment
callahantiff Dec 15, 2020
a3dea9d
swapping out copyfile for copy2
callahantiff Dec 15, 2020
b542932
remade erroneous write directory
callahantiff Dec 15, 2020
2bed7b3
adding print statements to debug
callahantiff Dec 16, 2020
fc04f0f
adding print statements to debug...again
callahantiff Dec 16, 2020
e9dc693
adding new data and changing last move argument
callahantiff Dec 16, 2020
438be1f
reworking shutil.copy2 --> os.rename
callahantiff Dec 16, 2020
4b51778
removing old code
callahantiff Dec 16, 2020
bf0bcbc
github actions hotfix from master
callahantiff Dec 18, 2020
88cb8ae
badge reorg
callahantiff Dec 18, 2020
80907fe
moving data source
callahantiff Dec 18, 2020
29c228b
improving paths
callahantiff Dec 18, 2020
f1973a9
fixing broken tests
callahantiff Dec 18, 2020
7a3890a
adding print statement
callahantiff Dec 19, 2020
21f445b
adding more print statement
callahantiff Dec 19, 2020
db8ebd8
adding more print statements...again
callahantiff Dec 19, 2020
3c1a6ed
replacing shutil.copyfile with shutil.copy
callahantiff Dec 19, 2020
fc5a2fa
trying something else
callahantiff Dec 19, 2020
05a058e
moving print statement
callahantiff Dec 19, 2020
cf59881
trying other path
callahantiff Dec 19, 2020
ea54fa7
approach revamp
callahantiff Dec 19, 2020
7396468
approach revamp ... take 2
callahantiff Dec 19, 2020
782a3ca
attempt to resolve semantic typing errors
callahantiff Dec 19, 2020
9e8bdd1
attempt to resolve semantic typing errors ... take 2
callahantiff Dec 19, 2020
9c3fa50
fixing typing errors
callahantiff Dec 19, 2020
b0b1171
removing dead code
callahantiff Dec 19, 2020
c6e500f
fixing badge layout
callahantiff Dec 19, 2020
28248af
updating class comments
callahantiff Dec 21, 2020
8d7ba2c
updating comments
callahantiff Dec 21, 2020
a7e4976
cleaning up line spacing
callahantiff Dec 21, 2020
9e9f84a
cleaned up comments and error assertions
callahantiff Dec 21, 2020
5391560
fixing code smells
callahantiff Dec 21, 2020
d8f5da8
adding missing argument to sonar properties
callahantiff Dec 21, 2020
ce29699
polishing actions requirements
callahantiff Dec 22, 2020
8ec5d35
re-arranging badges
callahantiff Dec 22, 2020
f7e3b83
fixing badge order
callahantiff Dec 22, 2020
2d26d38
removing redundant closure
callahantiff Dec 25, 2020
5b33906
adding mypy badge
callahantiff Dec 31, 2020
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
64 changes: 64 additions & 0 deletions .github/workflows/build-qa.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
# WorkFlow Do: install Python dependencies, run tests, linter, and return code coverage
name: Domo Arigato CI Roboto
on: [push, pull_request]
jobs:

build:
name: Quality Check
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
with:
fetch-depth: 0

- name: Setup Python
uses: actions/setup-python@v2
with:
python-version: 3.6

- name: Install Requirements and Dependencies
run: |
pip install --upgrade pip setuptools
pip install -e .[test]

- name: Prepare Environment
run: |
rm -rf .coverage
coverage erase
curl -L https://codeclimate.com/downloads/test-reporter/test-reporter-latest-linux-amd64 > ./cc-test-reporter
chmod +x ./cc-test-reporter

- name: Run Tests and Generate Coverage Results
run: |
pytest --cov=omop2obo --cov-report xml:coverage.xml
coverage report
coverage xml
python-codacy-coverage -r coverage.xml
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
CODACY_PROJECT_TOKEN: ${{ secrets.CODACY_PROJECT_TOKEN }}

- name: Linting with Mypy
run: mypy --strict-optional omop2obo

- name: Sonar Cloud Scanner
uses: sonarsource/sonarcloud-github-action@master
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
SONAR_TOKEN: ${{ secrets.SONAR_TOKEN }}

- name: Codacy
uses: codacy/codacy-coverage-reporter-action@master
with:
project-token: ${{ secrets.CODACY_PROJECT_TOKEN }}
coverage-reports: coverage.xml

- name: Code Climate
uses: paambaati/[email protected]
env:
CC_TEST_REPORTER_ID: ${{ secrets.CC_TEST_REPORTER_ID }}

- name: Coveralls
run: coveralls
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
4 changes: 3 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@
*.pyc
__pycache__
.ipynb_checkpoints/*
resources/analyses/.ipynb*

## testing resources ##
#################################
Expand All @@ -25,15 +26,16 @@ resources/clinical_data
!resources/clinical_data/README.md
resources/documentation
resources/mappings/
resources/mapping_semantics/
!resources/mappings/condition_codes/.gitkeep
!resources/mappings/laboratory_tests/.gitkeep
!resources/mappings/medication_codes/.gitkeep
!resources/mappings/source_code_vocab_map.csv
!resources/mapping_semantics/*.md
resources/ontologies/
!resources/ontologies/ontology_source_metadata.txt
resources/programming/

## scripts ##
#################################
scratch.py

43 changes: 0 additions & 43 deletions .travis.yml

This file was deleted.

Loading