v0.2.2

Maintenance:

• support python 3.12 (fix fugashi problem)

v0.2.1

Maintenance:

• Update lm_eval 0.4.5: Some detailed implementations have been changed. See more details in lm_eval release pages.
• Update vllm versions
• Downgrade protobuf versions to avoid errors in some models, such as swallows.

v0.2.0

feat:

• cpa_audit data is directly imported into this repository
• lm_eval updated
• mode results update
• length normed results are supported
• anthropic and vertexai supports

bugfix:

• chabsa-1.0-0.5 prompts

v0.1.0

First release