NCI60 - Several incorrect values in chem_name

[jjacobson95]

The validation script is finding several errors in the NCI60 chem_name column in the drugs file.
(This currently translates to be in broad_sanger_drugs.tsv)

[ERROR] [/tmp/nci60_drugs.tsv/2089] 300000000.0 is not of type 'string', 'null' in /chem_name
[ERROR][/tmp/nci60_drugs.tsv/189407] 200000000.0 is not of type 'string', 'null' in /chem_name
[ERROR] [/tmp/nci60_drugs.tsv/196988] 4e+96 is not of type 'string', 'null' in /chem_name
[ERROR] [/tmp/nci60_drugs.tsv/272367] 0.0 is not of type 'string', 'null' in /chem_name
[ERROR] [/tmp/nci60_drugs.tsv/519798] 5052 is not of type 'string', 'null' in /chem_name
[ERROR] [/tmp/nci60_drugs.tsv/520016] 138061 is not of type 'string', 'null' in /chem_name

[sgosline]

Do we know what drugs are causing this?

[jjacobson95]

Out of this small list (the 6 errors above were all of the errors that the validation script found), only two could be found through this simple search.

Both mapped to the same drug: SMI_54937 , Pubchem ID 581 which can be found on pubchem. The values are not seen as identifiers here.

[sgosline]

Here is the REST call for that compound (according to the pubchem_retrieval.py script): https://pubchem.ncbi.nlm.nih.gov/rest/pug/compound/CID/581/synonyms/JSON
I dont see those coming up as chem_names.

I think these are somehow missed by the pubchem call and instead get added as NSC identifiers, but without the 'NSC' prefix.

coderdata/build/broad_sanger/03a-nci60Drugs.py

Line 92 in 4025953

msmi = smiles.filter(pl.col('NSC').is_in(missing))

[jjacobson95]

I have been working on the schema checker and the previous errors were truncated. This issue is also in the other datasets that use these drug. This may help with tracking down the issue.

[ERROR] [/tmp/prism_drugs.tsv/19740] 4e+96 is not of type 'string', 'null' in /chem_name
[ERROR] [/tmp/prism_drugs.tsv/50270] 5052 is not of type 'string', 'null' in /chem_name
[ERROR] [/tmp/prism_drugs.tsv/50305] 138061 is not of type 'string', 'null' in /chem_name
[ERROR] [/tmp/gdscv1_drugs.tsv/5103] 4e+96 is not of type 'string', 'null' in /chem_name

[sgosline]

Was this resolved in #237?

[jjacobson95]

The schema was changed to allow for any values in the chem_name column, but these specific 5 or so chems are still present.

[jjacobson95]

I will look into where this is occurring during the pubchem / build process.