Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing metric for objectDetectionAP #18

Open
micahjsmith opened this issue May 24, 2020 · 0 comments
Open

Missing metric for objectDetectionAP #18

micahjsmith opened this issue May 24, 2020 · 0 comments
Assignees
Milestone

Comments

@micahjsmith
Copy link
Contributor

  • mit-d3m version: 0.2.1
  • Python version: 3.6.8
  • Operating System: macOS 10.15.4

Description

Trying to load LL1_penn_fudan_pedestrian, but get error that there is no metric for objectDetectionAP

What I Did

import mit_d3m
mit_d3m.load_dataset('LL1_penn_fudan_pedestrian')
/usr/local/miniconda3/envs/mlz/lib/python3.6/site-packages/mit_d3m/dataset.py:71: UserWarning: the datasetSchemaVersions in the API and datasetDoc do not match!
  warnings.warn("the datasetSchemaVersions in the API and datasetDoc do not match!")
/usr/local/miniconda3/envs/mlz/lib/python3.6/site-packages/mit_d3m/dataset.py:227: UserWarning: the problemSchemaVersions in the API and datasetDoc do not match!
  warnings.warn("the problemSchemaVersions in the API and datasetDoc do not match!")
---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
<ipython-input-9-a51e1c460555> in <module>
----> 1 mit_d3m.load_dataset('LL1_penn_fudan_pedestrian')

/usr/local/miniconda3/envs/mlz/lib/python3.6/site-packages/mit_d3m/__init__.py in load_dataset(dataset, root, force_download)
    150 
    151     dataset = loader.load(d3mds)
--> 152     dataset.scorer = METRICS_DICT[d3mds.get_metric()]
    153 
    154     return dataset

KeyError: 'objectDetectionAP'
@csala csala modified the milestones: 0.2.2, 0.2.3 May 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants