Skip to content

Data release

Latest
Compare
Choose a tag to compare
@david4096 david4096 released this 28 Aug 00:45
· 8 commits to main since this release

data_array.pkl is sentence transformers for the questions.pkl

import pickle
with open('data_array.pkl', 'rb') as f:  # Open file in read-binary mode
    loaded_data = pickle.load(f) 

Accessing data in the benchmark.pkl

all_comparisons = bds[168]['compare']
just_one_response = bds[168]['compare']['llamallama2-70b']
original_prompt = bds[168]['conversation'][0]['content']
original_response = bds[168]['conversation'][1]['content']