Code

Added ROUGE-L metric for evaluation#500

Code

Open

YourSaDady wants to merge 43 commits intoOptimalScale:mainOptimalScale/LMFlow:mainfrom YourSaDady:mainYourSaDady/LMFlow:mainCopy head branch name to clipboard

+1,539-238

Commits

Commits on Apr 30, 2023

• Added ROUGE-L evaluation.

  Show description for 290be18
  YourSaDady

  authored
  290be18

  Copy full SHA for 290be18

Commits on May 4, 2023

• Evaluation with ROUGE-L

  Show description for 56ae992
  YourSaDady

  authored
  56ae992

  Copy full SHA for 56ae992

Commits on May 10, 2023

• typo fixed

  Show description for 2aa8e02
  YourSaDady

  authored
  2aa8e02

  Copy full SHA for 2aa8e02

Commits on May 11, 2023

• Appended choices lists with ROUGE-L funtions

  Show description for 3e321b2
  YourSaDady

  authored
  3e321b2

  Copy full SHA for 3e321b2

• changed the model_path and deleted lora_model_path

  Show description for 61b38a5
  YourSaDady

  authored
  61b38a5

  Copy full SHA for 61b38a5

• imported deepspeed

  Show description for 6bc78ca
  YourSaDady

  authored
  6bc78ca

  Copy full SHA for 6bc78ca

• typo fixed

  Show description for 3a5c0fc
  YourSaDady

  authored
  3a5c0fc

  Copy full SHA for 3a5c0fc

• Add files via upload

  YourSaDady

  authored
  c88e18f

  Copy full SHA for c88e18f

Commits on Jun 4, 2023

• Simplify the evaluator.py

  Show description for ee17f1a
  YourSaDady

  authored
  ee17f1a

  Copy full SHA for ee17f1a

Commits on Jun 5, 2023

• for testing

  YourSaDady

  authored
  5971fa7

  Copy full SHA for 5971fa7

• the original evaluator file before June 4th

  YourSaDady

  authored
  1ab1afe

  Copy full SHA for 1ab1afe

• the original version before June 4th

  YourSaDady

  authored
  64c3acf

  Copy full SHA for 64c3acf

Commits on Jun 6, 2023

• Newest version of the team

  YourSaDady

  authored
  dcac238

  Copy full SHA for dcac238

Commits on Jun 7, 2023

• Update args.py

  YourSaDady

  authored
  bdcc9f8

  Copy full SHA for bdcc9f8

• Update run_evaluation_with_rougel.sh

  YourSaDady

  authored
  5b6fb41

  Copy full SHA for 5b6fb41

Commits on Jun 8, 2023

• a test case for ROUGE-L metric in evaluation

  YourSaDady

  authored
  545c808

  Copy full SHA for 545c808

• test case for ROUGE-L

  YourSaDady

  authored
  72500db

  Copy full SHA for 72500db

• update

  YourSaDady

  authored
  5851f47

  Copy full SHA for 5851f47

• test ROUGE-L metric

  YourSaDady

  authored
  9c5fd69

  Copy full SHA for 9c5fd69

• Added the function of evaluate.py

  YourSaDady

  authored
  4861bcc

  Copy full SHA for 4861bcc

• updated

  YourSaDady

  authored
  f0304f5

  Copy full SHA for f0304f5

• Add files via upload

  YourSaDady

  authored
  7fc95e7

  Copy full SHA for 7fc95e7

• import evaluate, not AutoPipeline

  YourSaDady

  authored
  dd5005e

  Copy full SHA for dd5005e

• import Test_rougel

  YourSaDady

  authored
  621059a

  Copy full SHA for 621059a

• Add files via upload

  YourSaDady

  authored
  f74cb75

  Copy full SHA for f74cb75

• import Test_rougel

  YourSaDady

  authored
  b1a615d

  Copy full SHA for b1a615d

• Add inference_batch_size_per_device

  YourSaDady

  authored
  19fd37e

  Copy full SHA for 19fd37e

• test for the validity of ROUGE-L metric

  YourSaDady

  authored
  ff58720

  Copy full SHA for ff58720

• split test.py and test_rougel.py

  YourSaDady

  authored
  f46e99b

  Copy full SHA for f46e99b

• deleted the part of test.py

  YourSaDady

  authored
  c3f09e6

  Copy full SHA for c3f09e6

• Added inference_batch_size_per_device

  YourSaDady

  authored
  782ebcf

  Copy full SHA for 782ebcf

• copied the function of Auto_pipeline inside

  YourSaDady

  authored
  91e61cf

  Copy full SHA for 91e61cf

• Update test.py

  YourSaDady

  authored
  4c51c35

  Copy full SHA for 4c51c35

• tiny updates

  YourSaDady

  authored
  73c1d2a

  Copy full SHA for 73c1d2a

• fix issues of JSON dataset format

  YourSaDady

  authored
  ddc294d

  Copy full SHA for ddc294d

• fix the Pool issue

  YourSaDady

  authored
  f088ab6

  Copy full SHA for f088ab6

• fix Pool issue

  YourSaDady

  authored
  b6f703f

  Copy full SHA for b6f703f

• fix weird precision error in comparison of scores

  YourSaDady

  authored
  70cb3c6

  Copy full SHA for 70cb3c6

Commits on Jun 18, 2023

• similar to evaluate.py

  YourSaDady

  authored
  0a29167

  Copy full SHA for 0a29167

• Similar to evaluator.py

  YourSaDady

  authored
  727c82d

  Copy full SHA for 727c82d

• Update test.py

  Show description for 48a392b
  YourSaDady

  authored
  48a392b

  Copy full SHA for 48a392b

• Update test_rougel.py

  YourSaDady

  authored
  eefad15

  Copy full SHA for eefad15

• Update rougel_test_case.sh

  YourSaDady

  authored
  b5abd56

  Copy full SHA for b5abd56