Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to evaluate the model in another set? #6

Open
vgaraujov opened this issue Jun 8, 2020 · 0 comments
Open

How to evaluate the model in another set? #6

vgaraujov opened this issue Jun 8, 2020 · 0 comments

Comments

@vgaraujov
Copy link

vgaraujov commented Jun 8, 2020

Hello @jbarrow, thank you for this fantastic tutorial. I trained the model using the training and validation sets. Now I want to evaluate the model with the test set. I used the following command:

allennlp evaluate model.tar.gz test.txt --include-package tagging

However, it returns zero metrics.

    "precision-overall": 0.0,
    "recall-overall": 0.0,
    "f1-measure-overall": 0.0,

Could you tell me what is the correct way to do that? Thank you so much!

@vgaraujov vgaraujov changed the title How to evaluate the mode in another set? How to evaluate the model in another set? Jun 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant