Skip to content

Commit

Permalink
excluded calculating with the first 200 papers
Browse files Browse the repository at this point in the history
  • Loading branch information
Mcilie committed May 3, 2024
1 parent 6d88c7c commit a1a6fd6
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ def evaluate_human_agreement(inputFile="arxiv_papers_with_abstract.csv"):
df["title"] = df["title"].apply(lambda x: process_paper_title(x))

# df = df.iloc[400:800]
df_limited = df.copy() # .iloc[400:800]
df_limited = df.copy().iloc[200:]
df_limited["human_review"] = ~df_limited["title"].isin(blacklist["title"])
keepables = ["highly relevant", "somewhat relevant", "neutral"]

Expand Down

0 comments on commit a1a6fd6

Please sign in to comment.