Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: align with lmstudio.js 1.0.0 config support #33

Open
ncoghlan opened this issue Mar 4, 2025 · 0 comments
Open

Feature: align with lmstudio.js 1.0.0 config support #33

ncoghlan opened this issue Mar 4, 2025 · 0 comments

Comments

@ncoghlan
Copy link
Collaborator

ncoghlan commented Mar 4, 2025

While the Python SDK will accept speculative decoding config settings, it won't actually send them to the server (see #32).

This issue covers adding those key to the interim config key mapping in _kv_config.py

It also covers adding support for the other config keys that lmstudio-python 1.0.1 accepts but doesn't forward to the server:

  • disabledGpus (in the gpuOffload settings)
  • reasoningParsing

In addition to supporting the above missing keys, this feature also covers implementing the reverse mapping from server configuration settings to SDK client configuration settings, and making the config retrieval/reporting methods and fields public after updating them to return the client settings format rather than the server format.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant