Skip to content

Commit

Permalink
scripts: corrected encoding when getting chat template (#11866) (#11907)
Browse files Browse the repository at this point in the history
Signed-off-by: MoonRide303 <[email protected]>
  • Loading branch information
MoonRide303 authored Feb 18, 2025
1 parent 09aaf4f commit 5137da7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scripts/get_chat_template.py
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ def get_chat_template(model_id, variant=None):
# Use huggingface_hub library if available.
# Allows access to gated models if the user has access and ran `huggingface-cli login`.
from huggingface_hub import hf_hub_download
with open(hf_hub_download(repo_id=model_id, filename="tokenizer_config.json")) as f:
with open(hf_hub_download(repo_id=model_id, filename="tokenizer_config.json"), encoding="utf-8") as f:
config_str = f.read()
except ImportError:
import requests
Expand Down

0 comments on commit 5137da7

Please sign in to comment.