Code

Roberta embeddings fixes#10856

Code

Merged

ggerganov merged 5 commits intoggml-org:masterggml-org/llama.cpp:masterfrom gabe-l-hart:RobertaTokenizergabe-l-hart/llama.cpp:RobertaTokenizerCopy head branch name to clipboardDec 19, 2024

+48-2

Commits

Commits on Dec 13, 2024

• fix: Use gpt2 tokenizer for roberta and add eos/bos tokens

  Show description for a2e03b8
  gabe-l-hart

  committed
  a2e03b8

  Copy full SHA for a2e03b8

Commits on Dec 16, 2024

• fixes to position embeddings

  Show description for d5f69e8
  Ssukriti

  committed
  d5f69e8

  Copy full SHA for d5f69e8

Commits on Dec 19, 2024

• map roberta-bpe to gpt-2

  Show description for 334ddfd
  Ssukriti

  committed
  334ddfd

  Copy full SHA for 334ddfd

• Merge branch 'master' into RobertaTokenizer

  Ssukriti

  committed
  be50c0c

  Copy full SHA for be50c0c

• fix linting

  Show description for 0b2f031
  Ssukriti

  committed
  0b2f031

  Copy full SHA for 0b2f031