convert.py: Hot Fix with VocabFactory Integration#4818

Merged

ggerganov merged 16 commits intoggerganov:masterfrom teleprint-me:convert-py

Jan 9, 2024

+675-312

Commits on Jan 7, 2024

Update Imports and Add Notes for Future Reference
teleprint-me
committed

Commits on Jan 8, 2024

Merge branch 'master' into convert-py
teleprint-me
committed
Refine Model Hyperparameters and Params Class
teleprint-me
committed
Restore BpeVocab and SentencePieceVocab classes
teleprint-me
committed
refactor: Standardize vocabulary handling with HfVocab
teleprint-me
committed
refactor: Enhance readability, functionality, and code quality
teleprint-me
committed
refactor: Update OutputFile class for enhanced model vocabulary management
teleprint-me
committed
feat: Introduce VocabFactory for flexible vocabulary management in model conversion
teleprint-me
committed
refactor: Improve code organization, argument parsing, and user interface
teleprint-me
committed
refactor: Further refine functionality, improve user interaction, and streamline vocabulary handling
teleprint-me
committed
chore: Apply ruff formatting to convert.py
teleprint-me
committed