Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BUG: ROCAUC is not supported for Binary Classifications #780

Open
1 task done
czaloom opened this issue Oct 8, 2024 · 0 comments
Open
1 task done

BUG: ROCAUC is not supported for Binary Classifications #780

czaloom opened this issue Oct 8, 2024 · 0 comments
Assignees
@czaloom
Labels
backlog bug Something isn't working

Comments

@czaloom
Copy link
Collaborator

czaloom commented Oct 8, 2024

valor version checks

  • I have confirmed this bug exists on the latest version of valor.

Reproducible Example

See sklearn's handling of single class data being passed to `roc_auc_score`

Issue Description

The lite ROCAUC implementation is intended for multiclass data and should not be used with binary classification datasets.

Expected Behavior

We should raise a warning or not return ROCAUC if an invalid input is passed.
@czaloom czaloom added bug Something isn't working backlog labels Oct 8, 2024
@czaloom czaloom self-assigned this Oct 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@czaloom czaloom

Labels
backlog bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@czaloom