Skip to content

Commit

Permalink
Release/517 (#713)
Browse files Browse the repository at this point in the history
* optimized EMR imports for less chance of import errors

* bump versions

* update release notes

* drop deprecated setup.py

* Endpoint tests (#637)

* example databricks serve notebooks and cluster creation

* updated healthcecks

* databricks serve + john snow labs endpoints module

* `clean_cluster` and `write_db_credentials` parameters for db cluster creation

* databricks serve + john snow labs endpoints docs + typo fixes

* databricks serve + john snow labs endpoints docs + typo fixes

* updated tests

* updated tests

* fix block_until_deployed bug

* fix block_until_deployed bug

* support for GPU and nlu.predict params in endpoints

* bump versions

* Docs update

* update notebooks

* endpoint test job generator

* improved list_db_runtime_versions

* multi cluster testing endpoints

* Support for submitting notebook to databricks and various utils & refactor to databricks utils

* db test refactor into  db_info/endpoint/hdfs/submit tests

* get_or_create_test_cluster() and varous more db testing utils, pytest.ini and non-verbose parameterization of tests

* add docs for notebook execution

* bump enterprise nlp version

* Update EMR initialization script (#661)

* update release notes

* update version

* Feature/513/parameterized db submit (#684)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Feature/513/list of additional db installs (#689)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Docs & example notebook for parameterized run_in_databricks

* updated noteoboks

* support for extra_pip_installs and pandas==1.5.3 fix on new clusters

* refactor db cluster creation to install_to_databricks and add deprecation warning to nlp.install() for db clusters

* db install  tests with custom libs

* Fix update existing databricks cluster (#680)

* update release notes

* bump versions

* removed pandas >= 2 htofix

* remove debug print

* bump version

* upgrade visual to 502

* bump jsl verison

* Update EMR config to support yarn mode (#710)

* Release/513 (#690)

* optimized EMR imports for less chance of import errors

* bump versions

* update release notes

* drop deprecated setup.py

* Endpoint tests (#637)

* example databricks serve notebooks and cluster creation

* updated healthcecks

* databricks serve + john snow labs endpoints module

* `clean_cluster` and `write_db_credentials` parameters for db cluster creation

* databricks serve + john snow labs endpoints docs + typo fixes

* databricks serve + john snow labs endpoints docs + typo fixes

* updated tests

* updated tests

* fix block_until_deployed bug

* fix block_until_deployed bug

* support for GPU and nlu.predict params in endpoints

* bump versions

* Docs update

* update notebooks

* endpoint test job generator

* improved list_db_runtime_versions

* multi cluster testing endpoints

* Support for submitting notebook to databricks and various utils & refactor to databricks utils

* db test refactor into  db_info/endpoint/hdfs/submit tests

* get_or_create_test_cluster() and varous more db testing utils, pytest.ini and non-verbose parameterization of tests

* add docs for notebook execution

* bump enterprise nlp version

* Update EMR initialization script (#661)

* update release notes

* update version

* Feature/513/parameterized db submit (#684)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Feature/513/list of additional db installs (#689)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Docs & example notebook for parameterized run_in_databricks

* updated noteoboks

* support for extra_pip_installs and pandas==1.5.3 fix on new clusters

* refactor db cluster creation to install_to_databricks and add deprecation warning to nlp.install() for db clusters

* db install  tests with custom libs

* Fix update existing databricks cluster (#680)

---------

Co-authored-by: Kshitiz <[email protected]>

* Release/514 (#691)

* optimized EMR imports for less chance of import errors

* bump versions

* update release notes

* drop deprecated setup.py

* Endpoint tests (#637)

* example databricks serve notebooks and cluster creation

* updated healthcecks

* databricks serve + john snow labs endpoints module

* `clean_cluster` and `write_db_credentials` parameters for db cluster creation

* databricks serve + john snow labs endpoints docs + typo fixes

* databricks serve + john snow labs endpoints docs + typo fixes

* updated tests

* updated tests

* fix block_until_deployed bug

* fix block_until_deployed bug

* support for GPU and nlu.predict params in endpoints

* bump versions

* Docs update

* update notebooks

* endpoint test job generator

* improved list_db_runtime_versions

* multi cluster testing endpoints

* Support for submitting notebook to databricks and various utils & refactor to databricks utils

* db test refactor into  db_info/endpoint/hdfs/submit tests

* get_or_create_test_cluster() and varous more db testing utils, pytest.ini and non-verbose parameterization of tests

* add docs for notebook execution

* bump enterprise nlp version

* Update EMR initialization script (#661)

* update release notes

* update version

* Feature/513/parameterized db submit (#684)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Feature/513/list of additional db installs (#689)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Docs & example notebook for parameterized run_in_databricks

* updated noteoboks

* support for extra_pip_installs and pandas==1.5.3 fix on new clusters

* refactor db cluster creation to install_to_databricks and add deprecation warning to nlp.install() for db clusters

* db install  tests with custom libs

* Fix update existing databricks cluster (#680)

* update release notes

* bump versions

* removed pandas >= 2 htofix

---------

Co-authored-by: Kshitiz <[email protected]>

* Docs/nlplab541 (#681)

* changes for 541

* changes

* added images

* missed version

* changes

* changes in git images

---------

Co-authored-by: pranab <[email protected]>
Co-authored-by: Pranab Rajbhandari <[email protected]>

* fastapi_api.py updated (#692)

* fix issues (#695)

* FEATURE NMH-170: Remove open source posts from johnsnowlabs repo (#694)

* Release/515 (#697)

* optimized EMR imports for less chance of import errors

* bump versions

* update release notes

* drop deprecated setup.py

* Endpoint tests (#637)

* example databricks serve notebooks and cluster creation

* updated healthcecks

* databricks serve + john snow labs endpoints module

* `clean_cluster` and `write_db_credentials` parameters for db cluster creation

* databricks serve + john snow labs endpoints docs + typo fixes

* databricks serve + john snow labs endpoints docs + typo fixes

* updated tests

* updated tests

* fix block_until_deployed bug

* fix block_until_deployed bug

* support for GPU and nlu.predict params in endpoints

* bump versions

* Docs update

* update notebooks

* endpoint test job generator

* improved list_db_runtime_versions

* multi cluster testing endpoints

* Support for submitting notebook to databricks and various utils & refactor to databricks utils

* db test refactor into  db_info/endpoint/hdfs/submit tests

* get_or_create_test_cluster() and varous more db testing utils, pytest.ini and non-verbose parameterization of tests

* add docs for notebook execution

* bump enterprise nlp version

* Update EMR initialization script (#661)

* update release notes

* update version

* Feature/513/parameterized db submit (#684)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Feature/513/list of additional db installs (#689)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Docs & example notebook for parameterized run_in_databricks

* updated noteoboks

* support for extra_pip_installs and pandas==1.5.3 fix on new clusters

* refactor db cluster creation to install_to_databricks and add deprecation warning to nlp.install() for db clusters

* db install  tests with custom libs

* Fix update existing databricks cluster (#680)

* update release notes

* bump versions

* removed pandas >= 2 htofix

* remove debug print

* bump version

---------

Co-authored-by: Kshitiz <[email protected]>

* Release/516 (#698)

* optimized EMR imports for less chance of import errors

* bump versions

* update release notes

* drop deprecated setup.py

* Endpoint tests (#637)

* example databricks serve notebooks and cluster creation

* updated healthcecks

* databricks serve + john snow labs endpoints module

* `clean_cluster` and `write_db_credentials` parameters for db cluster creation

* databricks serve + john snow labs endpoints docs + typo fixes

* databricks serve + john snow labs endpoints docs + typo fixes

* updated tests

* updated tests

* fix block_until_deployed bug

* fix block_until_deployed bug

* support for GPU and nlu.predict params in endpoints

* bump versions

* Docs update

* update notebooks

* endpoint test job generator

* improved list_db_runtime_versions

* multi cluster testing endpoints

* Support for submitting notebook to databricks and various utils & refactor to databricks utils

* db test refactor into  db_info/endpoint/hdfs/submit tests

* get_or_create_test_cluster() and varous more db testing utils, pytest.ini and non-verbose parameterization of tests

* add docs for notebook execution

* bump enterprise nlp version

* Update EMR initialization script (#661)

* update release notes

* update version

* Feature/513/parameterized db submit (#684)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Feature/513/list of additional db installs (#689)

* support for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* tests for parameterization of NB sumit runs in run_in_databricks()

* Docs & example notebook for parameterized run_in_databricks

* Docs & example notebook for parameterized run_in_databricks

* updated noteoboks

* support for extra_pip_installs and pandas==1.5.3 fix on new clusters

* refactor db cluster creation to install_to_databricks and add deprecation warning to nlp.install() for db clusters

* db install  tests with custom libs

* Fix update existing databricks cluster (#680)

* update release notes

* bump versions

* removed pandas >= 2 htofix

* remove debug print

* bump version

* upgrade visual to 502

* bump jsl verison

---------

Co-authored-by: Kshitiz <[email protected]>

* md file update (#696)

* Models hub internal (#706)

* 2023-03-29-icd10cm_resolver_pipeline_en (#44)

* Add model 2023-03-29-icd10cm_resolver_pipeline_en

* Add model 2023-03-29-icd10cm_resolver_pipeline_en

---------

Co-authored-by: Ahmetemintek <[email protected]>

* 2023-03-29-oncology_general_pipeline_en (#46)

* Add model 2023-03-29-oncology_general_pipeline_en

* Add model 2023-03-29-oncology_diagnosis_pipeline_en

* Add model 2023-03-29-oncology_biomarker_pipeline_en

* Add model 2023-03-29-icd10_icd9_mapping_en

* Add model 2023-03-29-icd10cm_snomed_mapping_en

* Add model 2023-03-29-icd10cm_umls_mapping_en

* Add model 2023-03-29-icd9_resolver_pipeline_en

* Add model 2023-03-29-icdo_snomed_mapping_en

* Add model 2023-03-29-mesh_umls_mapping_en

* Add model 2023-03-29-rxnorm_ndc_mapping_en

* Add model 2023-03-29-rxnorm_umls_mapping_en

* Add model 2023-03-29-snomed_icd10cm_mapping_en

* Add model 2023-03-29-snomed_icd10cm_mapping_en

* Add model 2023-03-29-snomed_icdo_mapping_en

* Add model 2023-03-29-oncology_therapy_pipeline_en

* Add model 2023-03-29-snomed_umls_mapping_en

---------

Co-authored-by: Cabir40 <[email protected]>

* 2023-03-29-icd10cm_resolver_pipeline_en (#45)

* Add model 2023-03-29-icd10cm_resolver_pipeline_en

* Add model 2023-03-29-umls_drug_resolver_pipeline_en

---------

Co-authored-by: Ahmetemintek <[email protected]>

* Add model 2023-03-30-text_generator_biomedical_biogpt_en (#48)

Co-authored-by: Cabir40 <[email protected]>

* 2023-03-30-summarizer_generic_jsl_en (#49)

* Add model 2023-03-30-summarizer_generic_jsl_en

* Update 2023-03-30-summarizer_generic_jsl_en.md

---------

Co-authored-by: Cabir40 <[email protected]>
Co-authored-by: Cabir C <[email protected]>

* Add model 2023-03-30-summarizer_clinical_jsl_augmented_en (#51)

* Update 2023-03-30-summarizer_generic_jsl_en.md

* Update 2023-03-30-text_generator_biomedical_biogpt_en.md

* Update 2023-03-30-summarizer_clinical_jsl_augmented_en.md

* 2023-04-02-ner_jsl_limited_80p_for_benchmarks_en (#58)

* Add model 2023-04-02-ner_jsl_limited_80p_for_benchmarks_en

* Update 2023-04-02-ner_jsl_limited_80p_for_benchmarks_en.md

* Update 2023-04-02-ner_jsl_limited_80p_for_benchmarks_en.md

---------

Co-authored-by: Damla-Gurbaz <[email protected]>
Co-authored-by: Cabir C <[email protected]>
Co-authored-by: Veysel Kocaman <[email protected]>

* 2023-03-30-ner_vop_wip_en (#52)

* Add model 2023-03-30-ner_vop_wip_en

* Update 2023-03-30-ner_vop_wip_en.md

---------

Co-authored-by: mauro-nievoff <[email protected]>
Co-authored-by: Cabir C <[email protected]>

* 2023-03-30-umls_clinical_findings_resolver_pipeline_en (#47)

* Add model 2023-03-30-umls_clinical_findings_resolver_pipeline_en

* Add model 2023-03-30-cvx_resolver_pipeline_en

* Add model 2023-03-30-umls_disease_syndrome_resolver_pipeline_en

* Add model 2023-03-30-umls_major_concepts_resolver_pipeline_en

* Add model 2023-03-30-umls_drug_substance_resolver_pipeline_en

* Add model 2023-03-31-medication_resolver_pipeline_en

* Add model 2023-03-31-medication_resolver_transform_pipeline_en

* Add model 2023-03-31-spellcheck_clinical_pipeline_en

---------

Co-authored-by: Ahmetemintek <[email protected]>

* Add model 2023-04-03-ner_oncology_limited_80p_for_benchmarks_en (#61)

* 2023-04-03-text_generator_biomedical_biogpt_base_en (#60)

* Delete 2023-03-30-text_generator_biomedical_biogpt_en.md

* Update 2023-04-03-text_generator_generic_flan_base_en.md

* Update 2023-03-30-summarizer_clinical_jsl_augmented_en.md

* Update 2023-03-30-summarizer_generic_jsl_en.md

* Add model 2023-04-04-text_generator_generic_flan_t5_large_en (#64)

* 2023-04-07-embeddings_clinical_medium_en (#75)

* Add model 2023-04-07-embeddings_clinical_medium_en

* Update 2023-04-07-embeddings_clinical_medium_en.md

---------

Co-authored-by: Cabir40 <[email protected]>
Co-authored-by: Cabir C <[email protected]>

* Add model 2023-04-07-embeddings_clinical_large_en (#79)

* 2023-04-10-genericclassifier_sdoh_mental_health_embeddings_clinical_en (#81)

* Add model 2023-04-10-genericclassifier_sdoh_mental_health_embeddings_clinical_en

* Add model 2023-04-10-genericclassifier_sdoh_under_treatment_sbiobert_cased_mli_en

* Add model 2023-04-10-genericclassifier_sdoh_housing_insecurity_sbiobert_cased_mli_en

* added missing md files

* Add model 2023-04-10-genericclassifier_sdoh_mental_health_clinical_en

* Delete 2023-04-10-genericclassifier_sdoh_mental_health_embeddings_clinical_en.md

* Update 2023-04-10-genericclassifier_sdoh_under_treatment_sbiobert_cased_mli_en.md

* Update 2023-04-10-genericclassifier_sdoh_mental_health_clinical_en.md

* Update 2023-04-10-genericclassifier_sdoh_housing_insecurity_sbiobert_cased_mli_en.md

* Update 2023-04-10-genericclassifier_sdoh_under_treatment_sbiobert_cased_mli_en.md

* Update 2023-04-10-genericclassifier_sdoh_mental_health_clinical_en.md

---------

Co-authored-by: hsaglamlar <[email protected]>
Co-authored-by: Cabir ÇELİK <[email protected]>
Co-authored-by: Cabir C <[email protected]>

* 2023-04-10-medication_resolver_pipeline_en (#83)

* Add model 2023-04-10-medication_resolver_pipeline_en

* Add model 2023-04-11-medication_resolver_transform_pipeline_en

---------

Co-authored-by: SKocer <[email protected]>

* 2023-04-11-umls_clinical_findings_resolver_pipeline_en (#89)

* Add model 2023-04-11-umls_clinical_findings_resolver_pipeline_en

* Add model 2023-04-11-umls_drug_substance_resolver_pipeline_en

---------

Co-authored-by: Cabir40 <[email protected]>

* 2023-04-12-ner_vop_emb_clinical_large_wip_en (#100)

* Add model 2023-04-12-ner_vop_emb_clinical_large_wip_en

* Add model 2023-04-12-ner_vop_emb_clinical_medium_wip_en

---------

Co-authored-by: mauro-nievoff <[email protected]>

* Add model 2023-04-12-biogpt_chat_jsl_en (#103)

Co-authored-by: Cabir40 <[email protected]>

* 2023-04-12-ner_oncology_emb_clinical_large_en (#101)

* Add model 2023-04-12-ner_oncology_emb_clinical_large_en

* Add model 2023-04-12-ner_oncology_emb_clinical_medium_en

---------

Co-authored-by: Meryem1425 <[email protected]>

* 2023-04-12-ner_posology_emb_clinical_large_en (#99)

* Add model 2023-04-12-ner_posology_emb_clinical_large_en

* Update 2023-04-12-ner_posology_emb_clinical_large_en.md

Fixed the given sample text

* Add model 2023-04-12-ner_posology_emb_clinical_medium_en

* Update 2023-04-12-ner_posology_emb_clinical_medium_en.md

Corrected thr code block view

* Add model 2023-04-12-ner_deid_large_emb_clinical_large_en

* Update 2023-04-12-ner_deid_large_emb_clinical_large_en.md

Corrected the code block view

* Add model 2023-04-12-ner_deid_large_emb_clinical_medium_en

* Update 2023-04-12-ner_deid_large_emb_clinical_medium_en.md

corrected the python code block view

* Update 2023-04-12-ner_posology_emb_clinical_medium_en.md

Fixed scala code

* Update 2023-04-12-ner_posology_emb_clinical_large_en.md

Fixed scala code

---------

Co-authored-by: gokhanturer <[email protected]>
Co-authored-by: Gökhan <[email protected]>

* 2023-04-12-ner_jsl_emb_clinical_medium_en (#98)

* Add model 2023-04-12-ner_jsl_emb_clinical_medium_en

* Add model 2023-04-12-ner_jsl_emb_clinical_large_en

---------

Co-authored-by: Damla-Gurbaz <[email protected]>

* 2023-04-12-ner_sdoh_emb_clinical_medium_wip_en (#96)

* Add model 2023-04-12-ner_sdoh_emb_clinical_medium_wip_en

* Add model 2023-04-12-ner_sdoh_emb_clinical_large_wip_en

---------

Co-authored-by: hsaglamlar <[email protected]>

* 2023-04-13-ndc_hcpcs_mapper_en (#113)

* Add model 2023-04-13-ndc_hcpcs_mapper_en

* Add model 2023-04-13-hcpcs_ndc_mapper_en

---------

Co-authored-by: Ahmetemintek <[email protected]>

* Add model 2023-04-13-medication_resolver_pipeline_en (#110)

Co-authored-by: Cabir40 <[email protected]>

* Add model 2023-04-17-ner_sdoh_emb_clinical_large_wip_en (#126)

* Add model 2023-04-18-biogpt_chat_jsl_conversational_en (#130)

Co-authored-by: HashamUlHaq <[email protected]>

* 2023-04-20-explain_clinical_doc_medication_en (#140)

* Add model 2023-04-20-explain_clinical_doc_medication_en

* Add model 2023-04-20-explain_clinical_doc_radiology_en

* Add model 2023-04-20-explain_clinical_doc_ade_en

* Add model 2023-04-20-explain_clinical_doc_era_en

* Add model 2023-04-20-explain_clinical_doc_carp_en

---------

Co-authored-by: Cabir40 <[email protected]>

* 2023-04-23-summarizer_jsl_radiology_en (#145)

* Update 2023-04-23-summarizer_jsl_radiology_en.md

* 2023-04-20-ner_vop_anatomy_wip_en (#139)

* 2023-04-26-ner_profiling_biobert_en (#151)

* 2023-04-27-genericclassifier_sdoh_housing_insecurity_sbiobert_cased_mli_en (#168)

* Update 2023-04-23-summarizer_jsl_radiology_en.md

* 2023-04-27-genericclassifier_sdoh_insurance_status_sbiobert_cased_mli_en (#170)

* Add model 2023-04-27-genericclassifier_sdoh_insurance_status_sbiobert_cased_mli_en

* Add model 2023-04-28-genericclassifier_sdoh_insurance_type_sbiobert_cased_mli_en

* Add model 2023-04-28-genericclassifier_sdoh_insurance_coverage_sbiobert_cased_mli_en

* Update 2023-04-27-genericclassifier_sdoh_insurance_status_sbiobert_cased_mli_en.md

* Update 2023-04-28-genericclassifier_sdoh_insurance_type_sbiobert_cased_mli_en.md

---------

Co-authored-by: hsaglamlar <[email protected]>
Co-authored-by: Halil Saglamlar <[email protected]>

* Add model 2023-05-01-bert_token_classifier_ner_jsl_en (#181)

Co-authored-by: Damla-Gurbaz <[email protected]>

* Add model 2023-04-28-icd10cm_resolver_pipeline_en (#174)

Co-authored-by: Meryem1425 <[email protected]>

* 2023-04-28-ner_profiling_biobert_en (#171)

* Add model 2023-04-28-ner_profiling_biobert_en

* Add model 2023-04-28-ner_profiling_clinical_en

---------

Co-authored-by: Cabir40 <[email protected]>

* Add model 2023-05-02-ner_demographic_extended_en (#187)

Co-authored-by: andrei9825 <[email protected]>

* Add model 2023-05-04-classifier_logreg_ade_en (#194)

Co-authored-by: gpirge <[email protected]>

* 2023-05-04-ner_profiling_clinical_en (#196)

* Update 2023-05-04-bert_token_classifier_ner_jsl_en.md

Add benchmark

* fixed typos on 2023-05-04-bert_token_classifier_ner_jsl_en.md

* 2023-05-05-ner_clinical_de (#199)

* 2023-05-04-classifierml_ade_en (#197)

* 2023-05-08-summarizer_clinical_key_facts_en (#201)

* Add model 2023-05-08-summarizer_clinical_key_facts_en

* Update 2023-05-08-summarizer_clinical_key_facts_en.md

changed model name

* Update 2023-05-08-summarizer_clinical_key_facts_en.md

Changed description

---------

Co-authored-by: HashamUlHaq <[email protected]>
Co-authored-by: Damla Gurbaz <[email protected]>

* renamed md file

* 2023-05-09-generic_logreg_classifier_ade_en (#202)

* Add model 2023-05-09-generic_logreg_classifier_ade_en

* Update 2023-05-09-generic_logreg_classifier_ade_en.md

corrected the indentations of the Python codes

* Update 2023-05-09-generic_logreg_classifier_ade_en.md

changed the title

* Add model 2023-05-09-generic_svm_classifier_ade_en

---------

Co-authored-by: gpirge <[email protected]>
Co-authored-by: gursev.pirge <[email protected]>

* Add model 2023-05-08-ner_clinical_de (#200)

Co-authored-by: Ahmetemintek <[email protected]>

* Add model 2023-05-11-biogpt_chat_jsl_conditions_en (#204)

Co-authored-by: HashamUlHaq <[email protected]>

* 2023-05-11-classifier_logreg_ade_en (#209)

* Add model 2023-05-11-classifier_logreg_ade_en

* Add model 2023-05-11-classifierml_ade_en

---------

Co-authored-by: gpirge <[email protected]>

* 2023-05-12-ner_abbreviation_emb_clinical_medium_en (#214)

* Add model 2023-05-12-ner_abbreviation_emb_clinical_medium_en

* Add model 2023-05-12-ner_abbreviation_emb_clinical_large_en

* Update 2023-05-12-ner_abbreviation_emb_clinical_medium_en.md

* Update 2023-05-12-ner_abbreviation_emb_clinical_large_en.md

---------

Co-authored-by: Damla-Gurbaz <[email protected]>
Co-authored-by: Damla Gurbaz <[email protected]>

* 2023-05-11-icd10cm_cause_claim_mapper_en (#210)

* Add model 2023-05-11-icd10cm_cause_claim_mapper_en

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

The provided example is updated based on the review. Additional explanation is added for the case where there is no equivalent claim analysis code.

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

The output results are changed.

---------

Co-authored-by: SKocer <[email protected]>
Co-authored-by: Samed K <[email protected]>
Co-authored-by: muhammetsnts <[email protected]>

* Add model 2023-05-13-spellcheck_drug_norvig_en (#220)

Co-authored-by: Ahmetemintek <[email protected]>

* Update 2023-05-08-summarizer_clinical_guidelines_large_en.md

* 2023-05-15-ner_anatomy_emb_clinical_medium_en (#225)

* Add model 2023-05-15-ner_anatomy_emb_clinical_medium_en

* Add model 2023-05-15-ner_anatomy_emb_clinical_large_en

* Update 2023-05-15-ner_anatomy_emb_clinical_medium_en.md

* Update 2023-05-15-ner_anatomy_emb_clinical_large_en.md

* Update 2023-05-15-ner_anatomy_emb_clinical_medium_en.md

* Update 2023-05-15-ner_anatomy_emb_clinical_large_en.md

* Update 2023-05-15-ner_anatomy_emb_clinical_medium_en.md

---------

Co-authored-by: gokhanturer <[email protected]>
Co-authored-by: Gökhan <[email protected]>

* 2023-05-15-biogpt_pubmed_qa_en (#227)

* Add model 2023-05-15-biogpt_pubmed_qa_en

* Update 2023-05-15-biogpt_pubmed_qa_en.md

* Add model 2023-05-15-flan_t5_base_jsl_qa_en

* Update 2023-05-15-flan_t5_base_jsl_qa_en.md

---------

Co-authored-by: Cabir40 <[email protected]>
Co-authored-by: Cabir C <[email protected]>

* Add model 2023-05-17-medical_qa_biogpt_en (#234)

Co-authored-by: Cabir40 <[email protected]>

* Update 2023-04-20-explain_clinical_doc_carp_en.md

* Update 2023-04-20-explain_clinical_doc_era_en.md

* Update 2023-04-20-explain_clinical_doc_carp_en.md

* Update 2023-04-28-icd10cm_resolver_pipeline_en.md

* Update 2023-05-08-summarizer_clinical_guidelines_large_en.md

* 2023-05-20-sbiobertresolve_icd10cm_augmented_en (#243)

* Add model 2023-05-20-sbiobertresolve_icd10cm_augmented_en

* Update 2023-05-20-sbiobertresolve_icd10cm_augmented_en.md

* Update 2023-05-20-sbiobertresolve_icd10cm_augmented_en.md

* Update 2023-05-20-sbiobertresolve_icd10cm_augmented_en.md

---------

Co-authored-by: Ahmetemintek <[email protected]>
Co-authored-by: muhammetsnts <[email protected]>

* 2023-05-21-ner_ade_emb_clinical_medium_en (#244)

* Add model 2023-05-21-ner_ade_emb_clinical_medium_en

* Add model 2023-05-21-ner_ade_emb_clinical_large_en

* Add model 2023-05-24-ner_cellular_emb_clinical_medium_en

* Add model 2023-05-24-ner_cellular_emb_clinical_large_en

---------

Co-authored-by: Damla-Gurbaz <[email protected]>

* 2023-05-23-ner_bacterial_species_emb_clinical_medium_en (#252)

* Add model 2023-05-23-ner_bacterial_species_emb_clinical_medium_en

* Update 2023-05-23-ner_bacterial_species_emb_clinical_medium_en.md

* Add model 2023-05-23-ner_bacterial_species_emb_clinical_large_en

* Update 2023-05-23-ner_bacterial_species_emb_clinical_large_en.md

* Update 2023-05-23-ner_bacterial_species_emb_clinical_medium_en.md

* Update 2023-05-23-ner_bacterial_species_emb_clinical_large_en.md

* Update 2023-05-23-ner_bacterial_species_emb_clinical_medium_en.md

---------

Co-authored-by: gokhanturer <[email protected]>
Co-authored-by: Gökhan <[email protected]>

* 2023-05-19-ner_vop_wip_en (#242)

* Add model 2023-05-19-ner_vop_wip_en

* Add model 2023-05-19-ner_vop_wip_embeddings_clinical_medium_en

* Add model 2023-05-19-ner_vop_wip_embeddings_clinical_large_en

* Add model 2023-05-19-ner_vop_anatomy_wip_en

* Add model 2023-05-19-ner_vop_clinical_dept_wip_en

* Add model 2023-05-19-ner_vop_demographic_wip_en

* Add model 2023-05-19-ner_vop_problem_reduced_wip_en

* Add model 2023-05-19-ner_vop_problem_wip_en

* Add model 2023-05-19-ner_vop_temporal_wip_en

* Add model 2023-05-19-ner_vop_test_wip_en

* Add model 2023-05-19-ner_vop_treatment_wip_en

* Update 2023-05-19-ner_vop_anatomy_wip_en.md

Fixing wrong special character (").

* Update 2023-05-19-ner_vop_treatment_wip_en.md

Fixing special character (" to ').

* Update 2023-05-19-ner_vop_test_wip_en.md

Fixing special character (" to ').

* Update 2023-05-19-ner_vop_temporal_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_problem_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_problem_reduced_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_demographic_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_clinical_dept_wip_en.md

Adding sample text.

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_large_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_medium_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_medium_en.md

Changing model name ner_vop_wip_embeddings_clinical_medium to ner_vop_wip_emb_clinical_medium.

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_large_en.md

Changing model name ner_vop_wip_embeddings_clinical_large to ner_vop_wip_emb_clinical_large.

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_medium_en.md

Changed s3 link.

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_large_en.md

Changed s3 link.

* Add model 2023-05-24-bert_sequence_classifier_vop_side_effect_en

* Update 2023-05-24-bert_sequence_classifier_vop_side_effect_en.md

* Update 2023-05-24-bert_sequence_classifier_vop_side_effect_en.md

Minor edit.

* Update 2023-05-24-bert_sequence_classifier_vop_side_effect_en.md

Minor edit.

---------

Co-authored-by: mauro-nievoff <[email protected]>
Co-authored-by: mauro-nievoff <[email protected]>

* 2023-05-24-sbiobertresolve_icd10cm_generalised_augmented_en (#256)

* 2023-05-29-summarizer_clinical_jsl_pipeline_en (#282)

* 2023-05-29-arabic_medical_ner_model_specific_17_entities_ar (#283)

* Add model 2023-05-29-arabic_medical_ner_model_specific_17_entities_ar

* Update 2023-05-29-arabic_medical_ner_model_specific_17_entities_ar.md

* update md file name

* Add model 2023-05-30-ner_deid_generic_ar

* fixed typos

* fixed typos

---------

Co-authored-by: mellahysf <[email protected]>
Co-authored-by: Cabir C <[email protected]>
Co-authored-by: Cabir ÇELİK <[email protected]>

* 2023-05-29-summarizer_clinical_layman_en (#280)

* Add model 2023-05-29-summarizer_clinical_layman_en

* Update 2023-05-29-summarizer_clinical_layman_en.md

* update model name

* Added English names to the example text

---------

Co-authored-by: dcecchini <[email protected]>
Co-authored-by: Cabir ÇELİK <[email protected]>

* 2023-05-26-icd10cm_billable_hcc_mapper_en (#266)

* Add model 2023-05-26-icd10cm_billable_hcc_mapper_en

* Update 2023-05-26-icd10cm_billable_hcc_mapper_en.md

md file was fixed based on the feedback.

* Update 2023-05-26-icd10cm_billable_hcc_mapper_en.md

---------

Co-authored-by: Ahmetemintek <[email protected]>
Co-authored-by: muhammetsnts <[email protected]>

* 2023-05-16-classifier_logreg_ade_en (#232)

* 2023-05-30-genericclassifier_sdoh_housing_insecurity_sbiobert_cased_mli_en (#299)

* 2023-05-30-icd10cm_mapper_en (#295)

* 2023-05-31-sbiobertresolve_hcc_augmented_en (#304)

* Add model 2023-05-31-sbiobertresolve_hcc_augmented_en

* Update 2023-05-31-sbiobertresolve_hcc_augmented_en.md

---------

Co-authored-by: Ahmetemintek <[email protected]>

* 2023-05-31-summarizer_clinical_guidelines_large_pipeline_en (#305)

* Add model 2023-05-31-summarizer_clinical_guidelines_large_pipeline_en

* Add model 2023-05-31-summarizer_radiology_pipeline_en

* Add model 2023-05-31-summarizer_clinical_questions_pipeline_en

* Add model 2023-05-31-summarizer_biomedical_pubmed_pipeline_en

* Delete 2023-05-31-summarizer_biomedical_pubmed_pipeline_en.md

* Add model 2023-05-31-summarizer_generic_jsl_pipeline_en

* Add model 2023-05-31-summarizer_biomedical_pubmed_pipeline_en

* Add model 2023-05-31-summarizer_clinical_jsl_augmented_pipeline_en

* Add model 2023-05-31-summarizer_clinical_jsl_pipeline_en

---------

Co-authored-by: Damla-Gurbaz <[email protected]>
Co-authored-by: Damla Gurbaz <[email protected]>

* 2023-05-31-sbertresolve_icd10cm_slim_billable_hcc_en (#302)

* 2023-05-31-sbertresolve_icd10cm_augmented_en (#306)

* Update 2023-05-26-icd10cm_billable_hcc_mapper_en.md

* 2023-05-31-ner_deid_subentity_pipeline_ar (#313)

* Add model 2023-05-31-ner_deid_subentity_pipeline_ar

* Add model 2023-05-31-ner_deid_generic_pipeline_ar

---------

Co-authored-by: mellahysf <[email protected]>

* 2023-05-31-ner_deid_subentity_pipeline_ar (#313)

* Add model 2023-05-31-ner_deid_subentity_pipeline_ar

* Add model 2023-05-31-ner_deid_generic_pipeline_ar

* Update 2023-05-31-ner_deid_subentity_pipeline_ar.md

---------

Co-authored-by: mellahysf <[email protected]>
Co-authored-by: Cabir C <[email protected]>

* 2023-06-02-ner_chemicals_emb_clinical_large_en (#327)

* Add model 2023-06-06-ner_deid_generic_pipeline_ar (#351)

* 2023-06-06-ner_vop_en (#350)

* Add model 2023-06-08-ner_demographic_extended_healthcare_en (#359)

Co-authored-by: Cabir40 <[email protected]>

* 2023-06-06-summarizer_clinical_laymen_pipeline_en (#352)

* Add model 2023-06-06-summarizer_clinical_laymen_pipeline_en

* Add model 2023-06-06-bert_token_classifier_ner_jsl_pipeline_en

* Add model 2023-06-06-bert_token_classifier_ner_jsl_pipeline_en

* Add model 2023-06-07-bert_token_classifier_ner_jsl_pipeline_en

---------

Co-authored-by: Damla-Gurbaz <[email protected]>

* Add model 2023-06-11-ner_profiling_biobert_en (#362)

Co-authored-by: ahmedlone127 <[email protected]>

* 2023-06-09-ner_vop_pipeline_en (#361)

* Add model 2023-06-09-ner_vop_pipeline_en

* Add model 2023-06-09-ner_vop_anatomy_pipeline_en

* Add model 2023-06-10-ner_vop_clinical_dept_pipeline_en

* Add model 2023-06-10-ner_vop_demographic_pipeline_en

* Add model 2023-06-10-ner_vop_problem_pipeline_en

* Add model 2023-06-10-ner_vop_problem_reduced_pipeline_en

* Add model 2023-06-10-ner_vop_temporal_pipeline_en

* Add model 2023-06-10-ner_vop_test_pipeline_en

* Add model 2023-06-10-ner_vop_treatment_pipeline_en

---------

Co-authored-by: mauro-nievoff <[email protected]>

* Add model 2023-06-13-ner_sdoh_en (#370)

Co-authored-by: hsaglamlar <[email protected]>

* Add model 2023-06-13-icd10cm_umls_mapping_en (#373)

Co-authored-by: C-K-Loan <[email protected]>

* 2023-06-13-ner_profiling_biobert_en (#368)

* Add model 2023-06-13-ner_profiling_biobert_en

* Add model 2023-06-13-explain_clinical_doc_carp_en

* Add model 2023-06-13-explain_clinical_doc_era_en

* Add model 2023-06-13-snomed_icd10cm_mapping_en

* Add model 2023-06-13-icd10cm_umls_mapping_en

* Add model 2023-06-13-mesh_umls_mapping_en

* Add model 2023-06-13-snomed_umls_mapping_en

* Add model 2023-06-13-re_bodypart_directions_pipeline_en

* Add model 2023-06-13-icd10_icd9_mapping_en

* Add model 2023-06-13-re_bodypart_proceduretest_pipeline_en

* Add model 2023-06-13-re_human_phenotype_gene_clinical_pipeline_en

* Add model 2023-06-13-re_temporal_events_clinical_pipeline_en

* Add model 2023-06-13-re_temporal_events_enriched_clinical_pipeline_en

* Add model 2023-06-13-re_test_problem_finding_pipeline_en

* Add model 2023-06-13-re_test_result_date_pipeline_en

* Add model 2023-06-13-explain_clinical_doc_medication_en

* Add model 2023-06-13-icdo_snomed_mapping_en

* Add model 2023-06-13-rxnorm_ndc_mapping_en

* Add model 2023-06-13-snomed_icdo_mapping_en

* Add model 2023-06-13-oncology_general_pipeline_en

* Add model 2023-06-13-oncology_biomarker_pipeline_en

* Add model 2023-06-13-ner_eu_clinical_condition_pipeline_eu

* Add model 2023-06-13-ner_eu_clinical_case_pipeline_en

* Add model 2023-06-13-ner_eu_clinical_case_pipeline_es

* Add model 2023-06-13-ner_eu_clinical_case_pipeline_eu

* Add model 2023-06-13-ner_eu_clinical_case_pipeline_fr

* Add model 2023-06-13-ner_eu_clinical_condition_pipeline_es

* Add model 2023-06-13-ner_eu_clinical_condition_pipeline_fr

* Add model 2023-06-13-ner_eu_clinical_condition_pipeline_it

* Add model 2023-06-13-ner_oncology_anatomy_general_healthcare_pipeline_en

* Add model 2023-06-13-ner_oncology_anatomy_general_pipeline_en

* Add model 2023-06-13-ner_oncology_biomarker_healthcare_pipeline_en

* Add model 2023-06-13-ner_oncology_posology_pipeline_en

* Add model 2023-06-13-ner_oncology_unspecific_posology_healthcare_pipeline_en

* Add model 2023-06-13-ner_sdoh_mentions_pipeline_en

* Add model 2023-06-13-ner_clinical_bert_pipeline_ro

* Add model 2023-06-13-ner_clinical_pipeline_ro

* Add model 2023-06-13-ner_clinical_trials_abstracts_pipeline_es

* Add model 2023-06-13-ner_covid_trials_pipeline_en

* Add model 2023-06-13-ner_deid_generic_bert_pipeline_ro

* Add model 2023-06-13-ner_deid_generic_pipeline_ro

* Add model 2023-06-13-ner_deid_subentity_bert_pipeline_ro

* Add model 2023-06-13-ner_deid_subentity_pipeline_ro

* Add model 2023-06-13-ner_living_species_300_pipeline_es

* Add model 2023-06-13-ner_negation_uncertainty_pipeline_es

* Add model 2023-06-13-ner_oncology_biomarker_pipeline_en

* Add model 2023-06-13-ner_oncology_demographics_pipeline_en

* Add model 2023-06-13-ner_oncology_diagnosis_pipeline_en

* Add model 2023-06-13-ner_oncology_response_to_treatment_pipeline_en

* Add model 2023-06-13-ner_oncology_test_pipeline_en

* Add model 2023-06-13-ner_oncology_therapy_pipeline_en

* Add model 2023-06-13-ner_oncology_tnm_pipeline_en

* Add model 2023-06-13-ner_oncology_unspecific_posology_pipeline_en

* Add model 2023-06-13-ner_pharmacology_pipeline_es

* Add model 2023-06-13-ner_deid_generic_glove_pipeline_en

* Add model 2023-06-13-ner_deid_generic_pipeline_it

* Add model 2023-06-13-ner_deid_subentity_glove_pipeline_en

* Add model 2023-06-13-ner_deid_subentity_pipeline_it

* Add model 2023-06-13-ner_deid_synthetic_pipeline_en

* Add model 2023-06-13-ner_living_species_bert_pipeline_es

* Add model 2023-06-13-ner_living_species_bert_pipeline_fr

* Add model 2023-06-13-ner_living_species_bert_pipeline_it

* Add model 2023-06-13-ner_living_species_bert_pipeline_pt

* Add model 2023-06-13-ner_living_species_bert_pipeline_ro

* Add model 2023-06-13-ner_living_species_pipeline_ca

* Add model 2023-06-13-ner_living_species_pipeline_en

* Add model 2023-06-13-ner_living_species_pipeline_es

* Add model 2023-06-13-ner_living_species_pipeline_fr

* Add model 2023-06-13-ner_living_species_pipeline_gl

* Add model 2023-06-13-ner_living_species_pipeline_it

* Add model 2023-06-13-ner_living_species_pipeline_pt

* Add model 2023-06-13-ner_living_species_roberta_pipeline_es

* Add model 2023-06-13-ner_living_species_roberta_pipeline_pt

* Add model 2023-06-13-ner_chemd_clinical_pipeline_en

* Add model 2023-06-13-ner_nature_nero_clinical_pipeline_en

* Add model 2023-06-13-ner_supplement_clinical_pipeline_en

* Add model 2023-06-13-nerdl_tumour_demo_pipeline_en

* Add model 2023-06-13-ner_diag_proc_pipeline_es

* Add model 2023-06-13-ner_healthcare_pipeline_de

* Add model 2023-06-13-ner_healthcare_slim_pipeline_de

* Add model 2023-06-13-ner_neoplasms_pipeline_es

* Add model 2023-06-13-bert_token_classifier_ade_tweet_binary_pipeline_en

* Add model 2023-06-13-bert_token_classifier_negation_uncertainty_pipeline_es

* Add model 2023-06-13-bert_token_classifier_ner_ade_binary_pipeline_en

* Add model 2023-06-13-bert_token_classifier_disease_mentions_tweet_pipeline_es

* Add model 2023-06-13-bert_token_classifier_ner_anatem_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_bc5cdr_chemicals_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_bc4chemd_chemicals_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_clinical_trials_abstracts_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_living_species_pipeline_es

* Add model 2023-06-13-bert_token_classifier_ner_living_species_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_bc2gm_gene_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_linnaeus_species_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_living_species_pipeline_pt

* Add model 2023-06-13-bert_token_classifier_ner_jnlpba_cellular_pipeline_en

* Add model 2023-06-13-ner_living_species_biobert_pipeline_en

* Add model 2023-06-13-bert_token_classifier_pharmacology_pipeline_es

* Add model 2023-06-13-bert_token_classifier_ner_species_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_clinical_trials_abstracts_pipeline_es

* Add model 2023-06-13-bert_token_classifier_ner_bc5cdr_disease_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_living_species_pipeline_it

* Add model 2023-06-13-bert_token_classifier_ner_pathogen_pipeline_en

* Add model 2023-06-13-bert_token_classifier_ner_ncbi_disease_pipeline_en

---------

Co-authored-by: ahmedlone127 <[email protected]>

* 2023-06-13-ner_profiling_biobert_en (#375)

* Add model 2023-06-13-ner_profiling_biobert_en

* Add model 2023-06-13-snomed_icd10cm_mapping_en

* Add model 2023-06-13-recognize_entities_posology_en

* Add model 2023-06-13-icd10cm_umls_mapping_en

* Add model 2023-06-13-mesh_umls_mapping_en

* Add model 2023-06-13-clinical_deidentification_de

* Add model 2023-06-13-rxnorm_mesh_mapping_en

* Add model 2023-06-13-clinical_deidentification_augmented_es

* Add model 2023-06-13-clinical_deidentification_es

* Add model 2023-06-13-clinical_deidentification_glove_en

* Add model 2023-06-13-clinical_deidentification_fr

* Add model 2023-06-13-ner_deid_generic_augmented_pipeline_en

* Add model 2023-06-13-snomed_umls_mapping_en

* Add model 2023-06-13-rxnorm_umls_mapping_en

* Add model 2023-06-13-icd10_icd9_mapping_en

* Add model 2023-06-13-bert_token_classifier_ner_jsl_pipeline_en

* Add model 2023-06-13-clinical_deidentification_it

* Add model 2023-06-13-re_bodypart_directions_pipeline_en

* Add model 2023-06-13-re_bodypart_proceduretest_pipeline_en

* Add model 2023-06-13-re_human_phenotype_gene_clinical_pipeline_en

* Add model 2023-06-13-re_temporal_events_clinical_pipeline_en

* Add model 2023-06-13-re_temporal_events_enriched_clinical_pipeline_en

* Add model 2023-06-13-re_test_problem_finding_pipeline_en

* Add model 2023-06-13-re_test_result_date_pipeline_en

* Add model 2023-06-13-clinical_deidentification_pt

* Add model 2023-06-13-bert_sequence_classifier_binary_rct_biobert_pipeline_en

* Add model 2023-06-13-icd10cm_snomed_mapping_en

* Add model 2023-06-13-icdo_snomed_mapping_en

* Add model 2023-06-13-rxnorm_ndc_mapping_en

* Add model 2023-06-13-clinical_deidentification_ro

* Add model 2023-06-13-clinical_deidentification_slim_en

* Add model 2023-06-13-ner_medication_pipeline_en

* Add model 2023-06-13-snomed_icdo_mapping_en

* Add model 2023-06-13-ner_deid_subentity_pipeline_ar

---------

Co-authored-by: C-K-Loan <[email protected]>

* 2023-06-13-bert_sequence_classifier_vop_drug_side_effect_en (#376)

* Add model 2023-06-14-clinical_deidentification_ar (#382)

* 2023-06-13-recognize_entities_posology_en (#378)

* Add model 2023-06-13-recognize_entities_posology_en

* Add model 2023-06-13-snomed_icd10cm_mapping_en

* Add model 2023-06-13-icd10cm_umls_mapping_en

* Add model 2023-06-13-mesh_umls_mapping_en

* Add model 2023-06-13-clinical_deidentification_de

* Add model 2023-06-13-clinical_deidentification_es

* Add model 2023-06-13-snomed_umls_mapping_en

* Add model 2023-06-13-rxnorm_umls_mapping_en

* Add model 2023-06-13-clinical_deidentification_glove_en

* Add model 2023-06-13-ner_deid_generic_augmented_pipeline_en

* Add model 2023-06-13-clinical_deidentification_fr

* Add model 2023-06-13-icd10_icd9_mapping_en

* Add model 2023-06-13-bert_token_classifier_ner_jsl_pipeline_en

* Add model 2023-06-13-clinical_deidentification_augmented_es

* Add model 2023-06-13-rxnorm_mesh_mapping_en

* Add model 2023-06-13-re_bodypart_directions_pipeline_en

* Add model 2023-06-13-clinical_deidentification_it

* Add model 2023-06-13-re_bodypart_proceduretest_pipeline_en

* Add model 2023-06-13-re_human_phenotype_gene_clinical_pipeline_en

* Add model 2023-06-13-re_temporal_events_clinical_pipeline_en

* Add model 2023-06-13-re_temporal_events_enriched_clinical_pipeline_en

* Add model 2023-06-13-re_test_problem_finding_pipeline_en

* Add model 2023-06-13-re_test_result_date_pipeline_en

* Add model 2023-06-13-clinical_deidentification_pt

* Add model 2023-06-13-bert_sequence_classifier_binary_rct_biobert_pipeline_en

* Add model 2023-06-13-icd10cm_snomed_mapping_en

* Add model 2023-06-13-icdo_snomed_mapping_en

* Add model 2023-06-13-rxnorm_ndc_mapping_en

* Add model 2023-06-13-clinical_deidentification_ro

* Add model 2023-06-13-clinical_deidentification_slim_en

* Add model 2023-06-13-ner_medication_pipeline_en

* Add model 2023-06-13-snomed_icdo_mapping_en

* Add model 2023-06-13-ner_deid_subentity_pipeline_ar

---------

Co-authored-by: Cabir40 <[email protected]>

* 2023-06-13-bert_sequence_classifier_vop_side_effect_pipeline_en (#380)

* Add model 2023-06-15-ner_profiling_biobert_en (#397)

Co-authored-by: ahmedlone127 <[email protected]>

* Add model 2023-06-16-ner_profiling_biobert_en (#399)

Co-authored-by: ahmedlone127 <[email protected]>

* Add model 2023-06-16-ner_profiling_biobert_en (#400)

Co-authored-by: Cabir40 <[email protected]>

* 2023-06-16-ner_profiling_biobert_en (#401)

* Add model 2023-06-16-ner_profiling_biobert_en

* Add model 2023-06-16-clinical_deidentification_en

* Add model 2023-06-16-explain_clinical_doc_carp_en

* Add model 2023-06-16-explain_clinical_doc_era_en

* Add model 2023-06-16-recognize_entities_posology_en

* Add model 2023-06-16-explain_clinical_doc_ade_en

* Add model 2023-06-16-snomed_icd10cm_mapping_en

* Add model 2023-06-16-snomed_umls_mapping_en

* Add model 2023-06-16-mesh_umls_mapping_en

* Add model 2023-06-16-clinical_deidentification_de

* Add model 2023-06-16-clinical_deidentification_es

* Add model 2023-06-16-rxnorm_umls_mapping_en

* Add model 2023-06-16-rxnorm_mesh_mapping_en

* Add model 2023-06-16-icd10_icd9_mapping_en

* Add model 2023-06-16-bert_token_classifier_ner_cellular_pipeline_en

* Add model 2023-06-16-icd10cm_umls_mapping_en

* Add model 2023-06-16-bert_token_classifier_ner_chemicals_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_chemprot_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_anatomy_pipeline_en

---------

Co-authored-by: ahmedlone127 <[email protected]>

* 2023-06-16-clinical_deidentification_fr (#403)

* Add model 2023-06-16-clinical_deidentification_fr

* Add model 2023-06-16-bert_token_classifier_ner_clinical_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_jsl_slim_pipeline_en

* Add model 2023-06-16-clinical_deidentification_augmented_es

* Add model 2023-06-16-bert_token_classifier_ner_deid_pipeline_en

* Add model 2023-06-16-jsl_ner_wip_greedy_clinical_pipeline_en

* Add model 2023-06-16-jsl_ner_wip_greedy_biobert_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_drugs_pipeline_en

* Add model 2023-06-16-jsl_ner_wip_modifier_clinical_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_bionlp_pipeline_en

* Add model 2023-06-16-jsl_rd_ner_wip_greedy_clinical_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_ade_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_bacteria_pipeline_en

* Add model 2023-06-16-clinical_deidentification_glove_en

* Add model 2023-06-16-ner_abbreviation_clinical_pipeline_en

* Add model 2023-06-16-jsl_rd_ner_wip_greedy_biobert_pipeline_en

* Add model 2023-06-16-ner_ade_biobert_pipeline_en

* Add model 2023-06-16-ner_ade_clinical_pipeline_en

* Add model 2023-06-16-jsl_ner_wip_clinical_pipeline_en

* Add model 2023-06-16-ner_ade_clinicalbert_pipeline_en

* Add model 2023-06-16-ner_anatomy_coarse_biobert_pipeline_en

* Add model 2023-06-16-ner_anatomy_biobert_pipeline_en

* Add model 2023-06-16-ner_anatomy_coarse_pipeline_en

* Add model 2023-06-16-ner_anatomy_pipeline_en

* Add model 2023-06-16-ner_bacterial_species_pipeline_en

* Add model 2023-06-16-ner_biomarker_pipeline_en

* Add model 2023-06-16-ner_bionlp_biobert_pipeline_en

* Add model 2023-06-16-ner_bionlp_pipeline_en

* Add model 2023-06-16-ner_cancer_genetics_pipeline_en

* Add model 2023-06-16-ner_cellular_biobert_pipeline_en

* Add model 2023-06-16-ner_cellular_pipeline_en

* Add model 2023-06-16-ner_chemicals_pipeline_en

* Add model 2023-06-16-ner_chemprot_biobert_pipeline_en

* Add model 2023-06-16-ner_chemprot_clinical_pipeline_en

* Add model 2023-06-16-ner_chexpert_pipeline_en

* Add model 2023-06-16-ner_clinical_biobert_pipeline_en

* Add model 2023-06-16-ner_clinical_large_pipeline_en

* Add model 2023-06-16-ner_clinical_pipeline_en

* Add model 2023-06-16-ner_deid_augmented_pipeline_en

* Add model 2023-06-16-ner_deid_biobert_pipeline_en

* Add model 2023-06-16-ner_deid_enriched_biobert_pipeline_en

* Add model 2023-06-16-ner_deid_enriched_pipeline_en

* Add model 2023-06-16-ner_deid_generic_augmented_pipeline_en

* Add model 2023-06-16-ner_deid_generic_pipeline_de

* Add model 2023-06-16-ner_deid_large_pipeline_en

* Add model 2023-06-16-ner_deid_sd_large_pipeline_en

* Add model 2023-06-16-ner_deid_sd_pipeline_en

* Add model 2023-06-16-ner_deid_subentity_augmented_i2b2_pipeline_en

* Add model 2023-06-16-ner_deid_subentity_augmented_pipeline_en

* Add model 2023-06-16-ner_deid_subentity_pipeline_de

* Add model 2023-06-16-ner_deidentify_dl_pipeline_en

* Add model 2023-06-16-ner_diseases_biobert_pipeline_en

* Add model 2023-06-16-ner_diseases_large_pipeline_en

* Add model 2023-06-16-ner_diseases_pipeline_en

* Add model 2023-06-16-ner_drugprot_clinical_pipeline_en

* Add model 2023-06-16-ner_drugs_greedy_pipeline_en

* Add model 2023-06-16-ner_drugs_large_pipeline_en

* Add model 2023-06-16-ner_drugs_pipeline_en

* Add model 2023-06-16-ner_events_admission_clinical_pipeline_en

* Add model 2023-06-16-ner_events_biobert_pipeline_en

* Add model 2023-06-16-ner_events_clinical_pipeline_en

* Add model 2023-06-16-ner_genetic_variants_pipeline_en

* Add model 2023-06-16-ner_human_phenotype_gene_biobert_pipeline_en

* Add model 2023-06-16-ner_human_phenotype_gene_clinical_pipeline_en

* Add model 2023-06-16-ner_human_phenotype_go_biobert_pipeline_en

* Add model 2023-06-16-ner_human_phenotype_go_clinical_pipeline_en

* Add model 2023-06-16-ner_jsl_biobert_pipeline_en

* Add model 2023-06-16-ner_jsl_enriched_biobert_pipeline_en

* Add model 2023-06-16-ner_jsl_enriched_pipeline_en

* Add model 2023-06-16-ner_jsl_greedy_biobert_pipeline_en

* Add model 2023-06-16-ner_jsl_greedy_pipeline_en

* Add model 2023-06-16-ner_jsl_pipeline_en

* Add model 2023-06-16-ner_jsl_slim_pipeline_en

* Add model 2023-06-16-ner_measurements_clinical_pipeline_en

* Add model 2023-06-16-ner_medmentions_coarse_pipeline_en

* Add model 2023-06-16-ner_nihss_pipeline_en

* Add model 2023-06-16-ner_posology_biobert_pipeline_en

* Add model 2023-06-16-ner_posology_experimental_pipeline_en

* Add model 2023-06-16-ner_posology_greedy_pipeline_en

* Add model 2023-06-16-ner_posology_large_biobert_pipeline_en

* Add model 2023-06-16-ner_posology_large_pipeline_en

* Add model 2023-06-16-ner_posology_pipeline_en

* Add model 2023-06-16-ner_posology_small_pipeline_en

* Add model 2023-06-16-ner_radiology_pipeline_en

* Add model 2023-06-16-ner_radiology_wip_clinical_pipeline_en

* Add model 2023-06-16-ner_risk_factors_biobert_pipeline_en

* Add model 2023-06-16-ner_risk_factors_pipeline_en

* Add model 2023-06-16-clinical_deidentification_glove_augmented_en

* Add model 2023-06-16-ner_events_healthcare_pipeline_en

* Add model 2023-06-16-ner_ade_healthcare_pipeline_en

* Add model 2023-06-16-ner_healthcare_pipeline_en

* Add model 2023-06-16-ner_posology_healthcare_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_jsl_pipeline_en

* Add model 2023-06-16-bert_token_classifier_drug_development_trials_pipeline_en

* Add model 2023-06-16-clinical_deidentification_it

* Add model 2023-06-16-explain_clinical_doc_radiology_en

* Add model 2023-06-16-re_bodypart_directions_pipeline_en

* Add model 2023-06-16-re_bodypart_proceduretest_pipeline_en

* Add model 2023-06-16-re_human_phenotype_gene_clinical_pipeline_en

* Add model 2023-06-16-re_temporal_events_clinical_pipeline_en

* Add model 2023-06-16-re_temporal_events_enriched_clinical_pipeline_en

* Add model 2023-06-16-re_test_problem_finding_pipeline_en

* Add model 2023-06-16-re_test_result_date_pipeline_en

* Add model 2023-06-16-explain_clinical_doc_medication_en

* Add model 2023-06-16-spellcheck_clinical_pipeline_en

* Add model 2023-06-16-clinical_deidentification_pt

* Add model 2023-06-16-bert_sequence_classifier_binary_rct_biobert_pipeline_en

* Add model 2023-06-16-ner_biomedical_bc2gm_pipeline_en

* Add model 2023-06-16-ner_clinical_trials_abstracts_pipeline_en

* Add model 2023-06-16-icd10cm_snomed_mapping_en

* Add model 2023-06-16-icdo_snomed_mapping_en

* Add model 2023-06-16-rxnorm_ndc_mapping_en

* Add model 2023-06-16-clinical_deidentification_ro

* Add model 2023-06-16-snomed_icdo_mapping_en

* Add model 2023-06-16-ner_pathogen_pipeline_en

* Add model 2023-06-16-clinical_deidentification_wip_en

* Add model 2023-06-16-clinical_deidentification_slim_en

* Add model 2023-06-16-ner_medication_pipeline_en

* Add model 2023-06-16-oncology_general_pipeline_en

* Add model 2023-06-16-oncology_biomarker_pipeline_en

* Add model 2023-06-16-oncology_therapy_pipeline_en

* Add model 2023-06-16-ner_eu_clinical_condition_pipeline_en

* Add model 2023-06-16-ner_eu_clinical_condition_pipeline_eu

* Add model 2023-06-16-ner_eu_clinical_case_pipeline_en

* Add model 2023-06-16-ner_eu_clinical_case_pipeline_es

* Add model 2023-06-16-ner_eu_clinical_case_pipeline_eu

* Add model 2023-06-16-ner_eu_clinical_case_pipeline_fr

* Add model 2023-06-16-ner_eu_clinical_condition_pipeline_es

* Add model 2023-06-16-ner_eu_clinical_condition_pipeline_fr

* Add model 2023-06-16-ner_eu_clinical_condition_pipeline_it

* Add model 2023-06-16-ner_oncology_anatomy_general_healthcare_pipeline_en

* Add model 2023-06-16-ner_oncology_anatomy_general_pipeline_en

* Add model 2023-06-16-ner_oncology_biomarker_healthcare_pipeline_en

* Add model 2023-06-16-ner_oncology_posology_pipeline_en

* Add model 2023-06-16-ner_oncology_unspecific_posology_healthcare_pipeline_en

* Add model 2023-06-16-ner_sdoh_mentions_pipeline_en

* Add model 2023-06-16-ner_clinical_bert_pipeline_ro

* Add model 2023-06-16-ner_clinical_pipeline_ro

* Add model 2023-06-16-ner_clinical_trials_abstracts_pipeline_es

* Add model 2023-06-16-ner_covid_trials_pipeline_en

* Add model 2023-06-16-ner_deid_generic_bert_pipeline_ro

* Add model 2023-06-16-ner_deid_generic_pipeline_ro

* Add model 2023-06-16-ner_deid_subentity_bert_pipeline_ro

* Add model 2023-06-16-ner_deid_subentity_pipeline_ro

* Add model 2023-06-16-ner_living_species_300_pipeline_es

* Add model 2023-06-16-ner_negation_uncertainty_pipeline_es

* Add model 2023-06-16-ner_oncology_biomarker_pipeline_en

* Add model 2023-06-16-ner_oncology_demographics_pipeline_en

* Add model 2023-06-16-ner_oncology_diagnosis_pipeline_en

* Add model 2023-06-16-ner_oncology_response_to_treatment_pipeline_en

* Add model 2023-06-16-ner_oncology_test_pipeline_en

* Add model 2023-06-16-ner_oncology_therapy_pipeline_en

* Add model 2023-06-16-ner_oncology_tnm_pipeline_en

* Add model 2023-06-16-ner_oncology_unspecific_posology_pipeline_en

* Add model 2023-06-16-ner_pharmacology_pipeline_es

* Add model 2023-06-16-ner_deid_generic_glove_pipeline_en

* Add model 2023-06-16-ner_deid_generic_pipeline_it

* Add model 2023-06-16-ner_deid_subentity_glove_pipeline_en

* Add model 2023-06-16-ner_deid_subentity_pipeline_it

* Add model 2023-06-16-ner_deid_synthetic_pipeline_en

* Add model 2023-06-16-ner_living_species_bert_pipeline_es

* Add model 2023-06-16-ner_living_species_bert_pipeline_fr

* Add model 2023-06-16-ner_living_species_bert_pipeline_it

* Add model 2023-06-16-ner_living_species_bert_pipeline_pt

* Add model 2023-06-16-ner_living_species_bert_pipeline_ro

* Add model 2023-06-16-ner_living_species_pipeline_ca

* Add model 2023-06-16-ner_living_species_pipeline_en

* Add model 2023-06-16-ner_living_species_pipeline_es

* Add model 2023-06-16-ner_living_species_pipeline_fr

* Add model 2023-06-16-ner_living_species_pipeline_gl

* Add model 2023-06-16-ner_living_species_pipeline_it

* Add model 2023-06-16-ner_living_species_pipeline_pt

* Add model 2023-06-16-ner_living_species_roberta_pipeline_es

* Add model 2023-06-16-ner_living_species_roberta_pipeline_pt

* Add model 2023-06-16-ner_chemd_clinical_pipeline_en

* Add model 2023-06-16-ner_nature_nero_clinical_pipeline_en

* Add model 2023-06-16-ner_supplement_clinical_pipeline_en

* Add model 2023-06-16-nerdl_tumour_demo_pipeline_en

* Add model 2023-06-16-ner_diag_proc_pipeline_es

* Add model 2023-06-16-ner_healthcare_pipeline_de

* Add model 2023-06-16-ner_healthcare_slim_pipeline_de

* Add model 2023-06-16-ner_neoplasms_pipeline_es

* Add model 2023-06-16-bert_token_classifier_ade_tweet_binary_pipeline_en

* Add model 2023-06-16-bert_token_classifier_disease_mentions_tweet_pipeline_es

* Add model 2023-06-16-bert_token_classifier_ner_ade_binary_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_anatem_pipeline_en

* Add model 2023-06-16-bert_token_classifier_negation_uncertainty_pipeline_es

* Add model 2023-06-16-bert_token_classifier_ner_clinical_trials_abstracts_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_jnlpba_cellular_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_living_species_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_living_species_pipeline_it

* Add model 2023-06-16-bert_token_classifier_ner_living_species_pipeline_pt

* Add model 2023-06-16-bert_token_classifier_ner_ncbi_disease_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_clinical_trials_abstracts_pipeline_es

* Add model 2023-06-16-bert_token_classifier_ner_species_pipeline_en

* Add model 2023-06-16-bert_token_classifier_pharmacology_pipeline_es

* Add model 2023-06-16-bert_token_classifier_ner_linnaeus_species_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_bc5cdr_chemicals_pipeline_en

* Add model 2023-06-16-ner_living_species_biobert_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_bc5cdr_disease_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_bc4chemd_chemicals_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_pathogen_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_living_species_pipeline_es

* Add model 2023-06-16-bert_token_classifier_ner_bc2gm_gene_pipeline_en

* Add model 2023-06-16-ner_deid_subentity_pipeline_ar

* Add model 2023-06-16-ner_deid_generic_pipeline_ar

---------

Co-authored-by: ahmedlone127 <[email protected]>

* 2023-06-16-ner_profiling_biobert_en (#406)

* Add model 2023-06-16-ner_profiling_biobert_en

* Add model 2023-06-16-clinical_deidentification_en

* Add model 2023-06-16-explain_clinical_doc_carp_en

* Add model 2023-06-16-explain_clinical_doc_era_en

* Add model 2023-06-16-recognize_entities_posology_en

* Add model 2023-06-16-explain_clinical_doc_ade_en

* Add model 2023-06-16-snomed_icd10cm_mapping_en

* Add model 2023-06-16-icd10_icd9_mapping_en

* Add model 2023-06-16-mesh_umls_mapping_en

* Add model 2023-06-16-icd10cm_umls_mapping_en

* Add model 2023-06-16-clinical_deidentification_glove_en

* Add model 2023-06-16-clinical_deidentification_augmented_es

* Add model 2023-06-16-clinical_deidentification_es

* Add model 2023-06-16-clinical_deidentification_fr

* Add model 2023-06-16-bert_token_classifier_ner_chemicals_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_chemprot_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_ade_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_clinical_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_bionlp_pipeline_en

* Add model 2023-06-16-snomed_umls_mapping_en

* Add model 2023-06-16-bert_token_classifier_ner_jsl_slim_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_bacteria_pipeline_en

* Add model 2023-06-16-jsl_ner_wip_clinical_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_deid_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_cellular_pipeline_en

* Add model 2023-06-16-clinical_deidentification_de

* Add model 2023-06-16-jsl_ner_wip_greedy_biobert_pipeline_en

* Add model 2023-06-16-rxnorm_mesh_mapping_en

* Add model 2023-06-16-jsl_ner_wip_modifier_clinical_pipeline_en

* Add model 2023-06-16-jsl_rd_ner_wip_greedy_clinical_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_drugs_pipeline_en

* Add model 2023-06-16-rxnorm_umls_mapping_en

* Add model 2023-06-16-ner_abbreviation_clinical_pipeline_en

* Add model 2023-06-16-ner_ade_biobert_pipeline_en

* Add model 2023-06-16-bert_token_classifier_ner_anatomy_pipeline_en

* Add model 2023-06-16-jsl_rd_ner_wip_greedy_biobert_pipeline_en

* Add model 2023-06-16-ner_anatomy_biobert_pipeline_en

* Add model 2023-06-16-jsl_ner_wip_greedy_clinical_pipeline_en

* Add model 2023-06-16-ner_ade_clinical_pipeline_en

* Add model 2023-06-16-ner_ade_clinicalbert_pipeline_en

* Add model 2023-06-16-ner_anatomy_coarse_pipeline_en

* Add model 2023-06-16-ner_anatomy_coarse_biobert_pipeline_en

* Add model 2023-06-16-ner_anatomy_pipeline_en

* Add model 2023-06-16-ner_bacterial_species_pipeline_en

* Add model 2023-06-16-ner_biomarker_pipeline_en

* Add model 2023-06-16-ner_bionlp_biobert_pipeline_en

* Add…
  • Loading branch information
1 parent acdc40a commit f22aac3
Show file tree
Hide file tree
Showing 9 changed files with 101 additions and 36 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -190,4 +190,4 @@ Chronic bronchitis 241 27 25 0.8992537 0.90601504 0.9026217
Asthma 104 15 25 0.8739496 0.8062016 0.83870965
Macro-average 823 110 193 0.83017427 0.7265169 0.7748944
Micro-average 823 110 193 0.88210076 0.8100393 0.84453565
```
```
Original file line number Diff line number Diff line change
Expand Up @@ -177,4 +177,4 @@ Hypertension 184 30 41 0.8598131 0.8177778 0.8382688
CAD 191 13 14 0.9362745 0.9317073 0.9339853
Macro-average 917 105 136 0.8870357 0.8389225 0.8623085
Micro-average 917 105 136 0.89726025 0.8708452 0.88385534
```
```
Original file line number Diff line number Diff line change
Expand Up @@ -204,4 +204,4 @@ Bipolar_disorder 101 5 10 0.9528302 0.9099099 0.9308756
Schizophrenia 66 4 23 0.94285715 0.74157304 0.8301887
Macro-average 750 73 119 0.89897865 0.8252565 0.8605415
Micro-average 750 73 119 0.9113001 0.863061 0.886524
```
```
3 changes: 2 additions & 1 deletion docs/en/jsl/databricks_utils.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,11 +43,12 @@ nlp.query_and_deploy_if_missing('bert','My String to embed')
| `re_create_endpoint` | if False, endpoint creation is skipped if one already exists. If True, it will delete existing endpoint if it exists |
| `re_create_model` | if False, model creation is skipped if one already exists. If True, model will be re-logged again, bumping the current version by 2 |
| `workload_size` | one of Small, Medium, Large. |
| `gpu` | `True`/`False` to load GPU-optimized jars or CPU-optimized jars in the container |
| `gpu` | `True`/`False` to load GPU-optimized jars or CPU-optimized jars in the container. Must use a gpu based `workload_type` if `gpu=true` |
| `new_run` | if True, mlflow will start a new run before logging the model |
| `db_host` | the databricks host URL. If not specified, the DATABRICKS_HOST environment variable is used |
| `db_token` | the databricks Access Token. If not specified, the DATABRICKS_TOKEN environment variable is used |
| `block_until_deployed` | if True, this function will block until the endpoint is created |
| `workload_type` | `CPU` by default, use `GPU_SMALL` to spawn a GPU based endpoint instead. Check Databricks docs for alternative values |

`nlp.query_and_deploy_if_missing` has the following parameters related to **querying your model**,
which are forwarded to the [model.predict()](https://nlp.johnsnowlabs.com/docs/en/jsl/predict_api) call:
Expand Down
42 changes: 32 additions & 10 deletions docs/en/jsl/jsl_release_notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,22 +15,44 @@ sidebar:

See [Github Releases](https://github.com/JohnSnowLabs/johnsnowlabs/releases) for detailed information on Release History and Featuresasdas

## 5.1.7
Release date: 19-10-2023

The John Snow Labs 5.1.6 Library released with the following pre-installed and recommended dependencies


| Library | Version |
|-----------------------------------------------------------------------------------------|---------|
| [Visual NLP](https://nlp.johnsnowlabs.com/docs/en/spark_ocr_versions/ocr_release_notes) | `5.0.2` |
| [Enterprise NLP](https://nlp.johnsnowlabs.com/docs/en/licensed_annotators) | `5.1.2` |
| [Finance NLP](https://nlp.johnsnowlabs.com/docs/en/financial_release_notes) | `1.X.X` |
| [Legal NLP](https://nlp.johnsnowlabs.com/docs/en/legal_release_notes) | `1.X.X` |
| [NLU](https://github.com/JohnSnowLabs/nlu/releases) | `5.0.3` |
| [Spark-NLP-Display](https://sparknlp.org/docs/en/display) | `4.4` |
| [Spark-NLP](https://github.com/JohnSnowLabs/spark-nlp/releases/) | `5.1.2` |
| [Pyspark](https://spark.apache.org/docs/latest/api/python/) | `3.1.2` |




## 5.1.6
Release date: 11-10-2023

The John Snow Labs 5.1.6 Library released with the following pre-installed and recommended dependencies


| Library | Version |
|---------------------------------------------------------------------------------|---------|
| [Visual NLP](https://nlp.johnsnowlabs.com/docs/en/spark_ocr_versions/ocr_release_notes) | `5.0.2` |
| [Enterprise NLP](https://nlp.johnsnowlabs.com/docs/en/licensed_annotators) | `5.1.1` |
| [Finance NLP](https://nlp.johnsnowlabs.com/docs/en/financial_release_notes) | `1.X.X` |
| [Legal NLP](https://nlp.johnsnowlabs.com/docs/en/legal_release_notes) | `1.X.X` |
| [NLU](https://github.com/JohnSnowLabs/nlu/releases) | `5.0.3` |
| [Spark-NLP-Display](https://sparknlp.org/docs/en/display) | `4.4` |
| [Spark-NLP](https://github.com/JohnSnowLabs/spark-nlp/releases/) | `5.1.1` |
| [Pyspark](https://spark.apache.org/docs/latest/api/python/) | `3.1.2` |

| Library | Version |
|-----------------------------------------------------------------------------------------|---------|
| [Visual NLP](https://nlp.johnsnowlabs.com/docs/en/spark_ocr_versions/ocr_release_notes) | `5.0.2` |
| [Enterprise NLP](https://nlp.johnsnowlabs.com/docs/en/licensed_annotators) | `5.1.1` |
| [Finance NLP](https://nlp.johnsnowlabs.com/docs/en/financial_release_notes) | `1.X.X` |
| [Legal NLP](https://nlp.johnsnowlabs.com/docs/en/legal_release_notes) | `1.X.X` |
| [NLU](https://github.com/JohnSnowLabs/nlu/releases) | `5.0.3` |
| [Spark-NLP-Display](https://sparknlp.org/docs/en/display) | `4.4` |
| [Spark-NLP](https://github.com/JohnSnowLabs/spark-nlp/releases/) | `5.1.1` |
| [Pyspark](https://spark.apache.org/docs/latest/api/python/) | `3.1.2` |




Expand Down
55 changes: 43 additions & 12 deletions johnsnowlabs/auto_install/databricks/endpoints.py
Original file line number Diff line number Diff line change
Expand Up @@ -144,6 +144,7 @@ def create_endpoint(
token,
workload_size="Small",
block_until_deployed=True,
workload_type="CPU",
):
"""Create serving endpoint and wait for it to be ready
maps name of your secret to an env variable with the same name in the container
Expand All @@ -156,7 +157,10 @@ def create_endpoint(
"model_name": model_name,
"model_version": model_version,
"workload_size": workload_size,
"scale_to_zero_enabled": "true",
"workload_type": workload_type,
"scale_to_zero_enabled": "false"
if "gpu" in workload_type.lower()
else "true",
"env_vars": [
{
"env_var_name": "JOHNSNOWLABS_LICENSE_JSON",
Expand All @@ -183,6 +187,7 @@ def create_endpoint(
response.raise_for_status()
if block_until_deployed:
wait_for_endpoint(endpoint_name, db_host, token)

try:
displayHTML(
f"""Created the <a href="/#mlflow/endpoints/{endpoint_name}" target="_blank">{endpoint_name}</a> serving endpoint"""
Expand Down Expand Up @@ -311,8 +316,15 @@ def delete_all_registerd_model(name):
def get_latest_registerd_model_version(name):
from mlflow import MlflowClient

model = MlflowClient().get_registered_model(name)
return model.latest_versions[-1].version
try:
model = MlflowClient().get_registered_model(name)
return model.latest_versions[-1].version
except Exception as e:
print(
f"Failure getting latest model version! This is expected on UC environments \n",
e,
)
return "1"


def model_exists(name):
Expand All @@ -331,7 +343,7 @@ def model_exists(name):
def query_endpoint(data, nlu_model_name, db_host, db_token, base_name=None):
# 5. Query the Endpoint
# endpoint_name = f"{nlu_model_name.replace('.','_')}_ENDPOINT"
endpoint_name = nlu_name_to_endpoint(base_name if base_name else nlu_model_name)
endpoint_name = base_name if base_name else nlu_name_to_endpoint(nlu_model_name)
url = f"{db_host}/serving-endpoints/{endpoint_name}/invocations"
headers = {
"Authorization": f"Bearer {db_token}",
Expand Down Expand Up @@ -420,10 +432,17 @@ def log_nlu_model(nlu_model_name, registerd_model_name, gpu):
)

# # 3. Download wheels to the model (current version +1)
mlflow.models.utils.add_libraries_to_model(
f"models:/{registerd_model_name}/latest",
registered_model_name=registerd_model_name,
)
try:
mlflow.models.utils.add_libraries_to_model(
f"models:/{registerd_model_name}/latest",
registered_model_name=registerd_model_name,
)
except Exception as e:
# /latest is not supported on UC environments
mlflow.models.utils.add_libraries_to_model(
f"models:/{registerd_model_name}/1",
registered_model_name=registerd_model_name,
)


def nlu_name_to_endpoint(nlu_model_name):
Expand Down Expand Up @@ -453,6 +472,7 @@ def query_and_deploy_if_missing(
new_run=True,
block_until_deployed=True,
gpu=False,
workload_type="CPU",
# NLU Predict params
output_level: Optional[str] = None,
positions: Optional[bool] = None,
Expand Down Expand Up @@ -490,7 +510,7 @@ def query_and_deploy_if_missing(
db_token: the databricks Access Token. If not specified, the DATABRICKS_TOKEN environment variable is used
block_until_deployed: if True, this function will block until the endpoint is deployed. If False, it will return immediately after the endpoint is created
gpu: Use GPU for inference
workload_type: 'CPU' or 'GPU_SMALL' or see official docs
output_level : token, chunk, sentence, relation, document
positions: include or exclude character index position of predictions
metadata: include additional metadata
Expand All @@ -509,6 +529,12 @@ def query_and_deploy_if_missing(
"You must specify DATABRICKS_HOST and DATABRICKS_TOKEN en variables"
)

if gpu and workload_type == "CPU":
raise ValueError(
f'When setting gpu=True you must specify a GPU workload_type. I.e. nlp.query_and_deploy(...,workload_type="GPU_SMALL")'
f"Check official databricks docs for alternative values "
)

if output_level and output_level not in [
"token",
"chunk",
Expand Down Expand Up @@ -539,6 +565,8 @@ def query_and_deploy_if_missing(
workload_size=workload_size,
block_until_deployed=block_until_deployed,
gpu=gpu,
workload_type=workload_type,
base_name=base_name,
)
else:
if not base_name:
Expand All @@ -562,6 +590,7 @@ def query_and_deploy_if_missing(
workload_size=workload_size,
block_until_deployed=block_until_deployed,
gpu=gpu,
workload_type=workload_type,
)
if not block_until_deployed:
return
Expand Down Expand Up @@ -595,15 +624,16 @@ def deploy_nlu_model_as_endpoint(
workload_size="Small",
block_until_deployed=True,
gpu=False,
workload_type="CPU",
):
os.environ["MLFLOW_WHEELED_MODEL_PIP_DOWNLOAD_OPTIONS"] = "--prefer-binary"
SCOPE_NAME = "JSL_SCOPE"
SECRET_NAME = "JSL_SECRET_NAME"
SECRET_VALUE = os.environ["JOHNSNOWLABS_LICENSE_JSON_FOR_CONTAINER"]
REGISTERD_MODEL_NAME = nlu_name_to_registerd_model(
base_name if base_name else model_name
REGISTERD_MODEL_NAME = (
base_name if base_name else nlu_name_to_registerd_model(model_name)
)
ENDPOINT_NAME = nlu_name_to_endpoint(base_name if base_name else model_name)
ENDPOINT_NAME = base_name if base_name else nlu_name_to_endpoint(model_name)

if not model_exists(REGISTERD_MODEL_NAME) or re_create_model:
# 1. Log the model
Expand Down Expand Up @@ -642,6 +672,7 @@ def deploy_nlu_model_as_endpoint(
token=db_token,
workload_size=workload_size,
block_until_deployed=block_until_deployed,
workload_type=workload_type,
)
else:
print(
Expand Down
16 changes: 16 additions & 0 deletions johnsnowlabs/auto_install/emr/install_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -109,6 +109,19 @@ def create_emr_cluster(
],
"Properties": {},
},
{
"Classification": "yarn-env",
"Configurations": [
{
"Classification": "export",
"Properties": {
"SPARK_NLP_LICENSE": secrets.HC_LICENSE or "",
"JSL_EMR": "1",
},
}
],
"Properties": {},
},
{
"Classification": "spark-defaults",
"Properties": {
Expand All @@ -119,6 +132,9 @@ def create_emr_cluster(
"spark.yarn.preserve.staging.files": "true",
"spark.yarn.stagingDir": "hdfs:///tmp",
"spark.jsl.settings.aws.region": region,
"spark.yarn.appMasterEnv.SPARK_NLP_LICENSE": secrets.HC_LICENSE
or "",
"spark.executorEnv.SPARK_NLP_LICENSE": secrets.HC_LICENSE or "",
},
},
],
Expand Down
5 changes: 0 additions & 5 deletions johnsnowlabs/auto_install/install_flow.py
Original file line number Diff line number Diff line change
Expand Up @@ -294,8 +294,6 @@ def install_to_databricks(
write_db_credentials=True,
extra_pip_installs: Optional[List[str]] = None,
):
# :param extra_pip_installs: any extra libraries to install,
# e.g. ["pandas==1.2.3", "numpy", 'https://my.website.com/wheel.whl', '/path/to/my/local/wheel.whl']
if refresh_install and os.path.exists(settings.root_dir):
print("🧹 Cleaning up old JSL Home in ", settings.root_dir)
shutil.rmtree(settings.root_dir)
Expand Down Expand Up @@ -346,9 +344,6 @@ def install_to_databricks(
# Databricks Install
if not databricks_host and databricks_token:
raise Exception()
print(
"nlp.install() for databricks will be deprecated next release, instead use nlp.install_to_databricks()"
)
suite = get_install_suite_from_jsl_home(
jvm_hardware_target=hardware_platform,
visual=visual,
Expand Down
10 changes: 5 additions & 5 deletions johnsnowlabs/settings.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,21 +11,21 @@
# These versions are used for auto-installs and version checks


raw_version_jsl_lib = "5.1.6"

raw_version_jsl_lib = "5.1.7"


raw_version_nlp = "5.1.1"
raw_version_nlp = "5.1.2"

raw_version_nlu = "5.0.3"
raw_version_nlu = "5.0.4rc2"



raw_version_pyspark = "3.1.2"
raw_version_nlp_display = "4.1"

raw_version_medical = "5.1.1"
raw_version_secret_medical = "5.1.1"
raw_version_medical = "5.1.2"
raw_version_secret_medical = "5.1.2"

raw_version_secret_ocr = "5.0.2"
raw_version_ocr = "5.0.2"
Expand Down

0 comments on commit f22aac3

Please sign in to comment.