Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AUC computation #9

Open
tomviering opened this issue Aug 11, 2023 · 0 comments
Open

AUC computation #9

tomviering opened this issue Aug 11, 2023 · 0 comments

Comments

@tomviering
Copy link
Collaborator

It would be nice if we can include AUC scores for the classifiers. This is possible also for the SVM with decision_function

The AUC computation is a bit non-trivial for the one versus rest classifiers, and need to be dealt with by hand.

For SVM, it is possible to convert one versus rest decision functions to one versus one decision functions. This can be used to get the one versus rest AUC. See here:
https://github.com/scikit-learn/scikit-learn/blob/2a2772a87b6c772dc3b8292bcffb990ce27515a8/sklearn/utils/multiclass.py#L479

Additionally, we need to deal with classes that were not seen during training.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant