Skip to content

Releases: pfnet-research/japanese-lm-fin-harness

v0.2.1

29 Oct 12:56
bb5ddfb
Compare
Choose a tag to compare

Maintenance:

  • Update lm_eval 0.4.5: Some detailed implementations have been changed. See more details in lm_eval release pages.
  • Update vllm versions
  • Downgrade protobuf versions to avoid errors in some models, such as swallows.

v0.2.0

07 May 03:07
135f1e4
Compare
Choose a tag to compare

feat:

  • cpa_audit data is directly imported into this repository
  • lm_eval updated
  • mode results update
  • length normed results are supported
  • anthropic and vertexai supports

bugfix:

  • chabsa-1.0-0.5 prompts

v0.1.0

04 Dec 07:40
Compare
Choose a tag to compare

First release