Skip to content

Commit

Permalink
Remove roberta todo comment
Browse files Browse the repository at this point in the history
  • Loading branch information
abuelnasr0 committed Feb 20, 2024
1 parent f451351 commit 464555c
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion keras_nlp/models/roberta/roberta_tokenizer_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,6 @@ def test_tokenizer_basics(self):
cls=RobertaTokenizer,
init_kwargs=self.init_kwargs,
input_data=self.input_data,
# TODO: </s> should not get tokenized as <s>
expected_output=[[0, 4, 5, 6, 4, 7, 8, 2, 1], [4, 5, 4, 7]],
expected_detokenize_output=[
"<s> airplane at airport<mask></s><pad>",
Expand Down

0 comments on commit 464555c

Please sign in to comment.