llama : fix Roberta embeddings (#10856)
* fix: Use gpt2 tokenizer for roberta and add eos/bos tokens
Branch: RobertaTokenizer
Signed-off-by: Gabe Goodhart <[email protected]>
* fixes to position embeddings
Signed-off-by: Sukriti-Sharma4 <[email protected]>
* map roberta-bpe to gpt-2
Signed-off-by: Sukriti-Sharma4 <[email protected]>
* fix linting
Signed-off-by: Sukriti-Sharma4 <[email protected]>
---------
Signed-off-by: Gabe Goodhart <[email protected]>
Signed-off-by: Sukriti-Sharma4 <[email protected]>
Co-authored-by: Gabe Goodhart <[email protected]>
