Replies: 1 comment
-
seems like something related to git lfs |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi! I was trying out the steganography eval and a few others, but it seems like only the ones in this list work
Eval steganography not found. Available: ['aba_mrpc_true_false', 'aba_mrpc_true_false.dev.v0', 'actors-sequence', 'actors-sequence.dev.match-v1', 'anagrams', 'anagrams.test.v1', 'balance-chemical-equation', 'balance-chemical-equation.dev.v0', 'belarusian-lexicon', 'belarusian-lexicon.dev.v0', 'best', 'best.dev.v0', 'bigrams', 'bigrams.dev.v0', 'born-first', 'born-first.dev.v0', 'brazilian-lexicon', 'brazilian-lexicon.dev.v0', 'bulgarian-lexicon', 'bulgarian-lexicon.dev.v0', 'chess-match', 'chess-piece-count', 'chess-piece-count.s1.simple-v0', 'chess.match.dev.v0', 'complex-replace-characters', 'complex-replace-characters.dev.v0', 'computer-science-problems', 'computer-science-problems.s1.simple-v0', 'connect4', 'connect4.s1.v1', 'convert-hex-hsl-lightness', 'convert-hex-hsl-lightness.dev.v0', 'coqa-closedqa', 'coqa-closedqa-correct', 'coqa-closedqa-correct.dev.v0', 'coqa-closedqa.dev.v0', 'coqa-fact', 'coqa-fact-expl', 'coqa-fact-expl.dev.v0', 'coqa-fact.dev.v0', 'coqa-match', 'coqa-match.dev.v0', 'crepe', 'crepe.dev.v2', 'cube-pack', 'cube-pack.dev.v0', 'decrypt-caesar-cipher', 'decrypt-caesar-cipher.dev.v0', 'determinant', 'determinant.test.v1', 'diagrammatic_logic', 'diagrammatic_logic.dev.v2', 'diversity', 'diversity.dev.v0', 'emotional-intelligence', 'emotional-intelligence.dev.v0', 'escher-sentences', 'escher-sentences.dev.v0', 'finance', 'finance.dev.v0', 'first-letters', 'first-letters.dev.v0', 'formal-logic', 'formal-logic.dev.v0', 'forth-stack-sim', 'forth-stack-sim-basic', 'forth-stack-sim-basic.dev.v0', 'forth-stack-sim-detailed', 'forth-stack-sim-detailed.dev.v0', 'forth-stack-sim.dev.v0', 'hand_ranks-match', 'hand_ranks.test.v1', 'heart-disease', 'heart-disease.v0', 'hebrew-rhyme', 'hebrew-rhyme.v0', 'illinois-law', 'illinois-law.v0', 'imperial_date_to_string', 'imperial_date_to_string.dev.v0', 'infiniteloop-match', 'infiniteloop-match.s1.simple-v0', 'joke-animals-vs-fruits', 'joke-animals-vs-fruits.dev.v0', 'joke-fruits', 'joke-fruits-ans-meta', 'joke-fruits-ans-meta.dev.v0', 'joke-fruits-expl-meta', 'joke-fruits-expl-meta.dev.v0', 'joke-fruits-likert', 'joke-fruits-likert.dev.v0', 'joke-fruits-meta', 'joke-fruits-meta.dev.v0', 'joke-fruits-v2', 'joke-fruits-v2.dev.v0', 'joke-fruits.dev.v0', 'last-word-nth', 'last-word-nth.s1.simple-v0', 'lat_long_identify', 'lat_long_identify.dev.v0', 'logic-fact', 'logic-fact.dev.v0', 'logic-statements', 'logic-statements.dev.v0', 'logiqa', 'logiqa.dev.v0', 'manga-translation-bubble', 'manga-translation-bubble.dev.v0', 'manga-translation-page', 'manga-translation-page.dev.v0', 'manga-translation-panel', 'manga-translation-panel.dev.v0', 'map-electronic-component-part-to-fact', 'map-electronic-component-part-to-fact.dev.v0', 'mendelian_inheritance', 'mendelian_inheritance.dev.v0', 'mg-humor-people_jp', 'mg-humor-people_jp.dev.v0', 'moral_exceptQA', 'moral_exceptQA.test.v1', 'naughty_strings', 'naughty_strings.test.v1', 'naughty_strings_fuzzy', 'naughty_strings_fuzzy.test.v1', 'naughty_strings_graded', 'naughty_strings_graded.test.v1', 'naughty_strings_graded_meta', 'naughty_strings_graded_meta.test.v1', 'number-pattern', 'number-pattern.dev.v0', 'number-reading', 'number-reading.dev.v0', 'partially_solved_crossword_clues', 'partially_solved_crossword_clues.dev.v0', 'pattern_identification', 'pattern_identification.dev.v0', 'rap-animals-vs-fruits', 'rap-animals-vs-fruits.dev.v0', 'rap-people-vs-fruits', 'rap-people-vs-fruits.dev.v0', 'rap-people-vs-people', 'rap-people-vs-people.dev.v0', 'regex-match', 'regex.match.dev.v0', 'reverse-string', 'reverse-string.s1.simple-v0', 'rot13', 'rot13.s1.simple-v0', 'rucola', 'rucola.test.v0', 'russian-nlp-tasks', 'russian-nlp-tasks.dev.v0', 'sarcasm', 'sarcasm.test.v1', 'simple-knowledge-mongolian', 'simple-knowledge-mongolian.dev.v0', 'stock-option-terms-bear-call-spread', 'stock-option-terms-bear-call-spread.dev.v0', 'stock-option-terms-bull-call-spread', 'stock-option-terms-bull-call-spread.dev.v0', 'stock-option-terms-inverse-iron-butteryfly-spread', 'stock-option-terms-inverse-iron-butteryfly-spread.dev.v0', 'stock-option-terms-inverse-iron-condor-spread', 'stock-option-terms-inverse-iron-condor-spread.dev.v0', 'stock-option-terms-iron-butterfly-spread.dev.v0', 'stock-option-terms-iron-butteryfly-spread', 'stock-option-terms-iron-condor-spread', 'stock-option-terms-iron-condor-spread.dev.v0', 'stock-options-bear-call-spread', 'stock-options-bear-call-spread.dev.v0', 'stock-options-bull-call-spread', 'stock-options-bull-call-spread.dev.v0', 'stock-options-inverse-iron-butterfly-spread', 'stock-options-inverse-iron-butterfly-spread.dev.v0', 'stock-options-inverse-iron-condor-spread', 'stock-options-inverse-iron-condor-spread.dev.v0', 'stock-options-iron-butteryfly-spread', 'stock-options-iron-butteryfly-spread.dev.v0', 'stock-options-iron-condor-spread', 'stock-options-iron-condor-spread.dev.v0', 'swedish-spelling', 'swedish-spelling.dev.v0', 'taxes', 'taxes.dev.v0', 'test-fuzzy-match', 'test-fuzzy-match.s1.simple-v0', 'test-includes', 'test-includes-ignore-case', 'test-includes-ignore-case.s1.simple-v0', 'test-includes.s1.simple-v0', 'test-match', 'test-match.s1.simple-v0', 'ukraine-eit', 'ukraine-eit.val.v0', 'us-tort-law', 'us-tort-law.dev.v0', 'which-is-heavier', 'which-is-heavier.dev.v0']
How can I run the other evals? Sorry if I'm being silly!
Beta Was this translation helpful? Give feedback.
All reactions