Add German Umlauts to Default COMPLETE_ALPHABET

[johannesscheibe]

Current Behavior

The current alphabet validation does not support German umlauts (ä, ö, ü) by default.

COMPLETE_ALPHABET = "0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ!@#$%^&*()_+-=[]{};:,./<>? `'\""

This is currently configurable via the CharacterLevelParserConfig but leads to the issue that third party frameworks need to add the support as well (e.g. vllm).

Expected Behavior

The alphabet validation should recognize and accept the following German characters by default:

• ä, Ä
• ö, Ö
• ü, Ü
• ß (sharp s/eszett)

Environment

• lm-format-enforcer version: 0.10.9
• Python version: 3.12.2
• OS: MacOs Sequoia 15.1.1

Related

• vllm integration