feat: support for customizing “tool_choice” in OpenAI

[leseb]

1016c92 feat: support for customizing “tool_choice” in OpenAI

commit 1016c92
Author: Sébastien Han [email protected]
Date: Mon Jan 27 16:52:45 2025 +0100

feat: support for customizing “tool_choice” in OpenAI

The ModelSettings class uses a TypedDict as its underlying type, providing
flexibility to add options beyond the predefined attributes.

Before generating chat completions, the code now checks if tool_choice is set
in ModelSettings and applies it accordingly.

Fixes: https://github.com/pydantic/pydantic-ai/issues/224
Signed-off-by: Sébastien Han <[email protected]>

Fixes: #224

[sydney-runkle]

I think we'll want to customize this on OpenAIModelSettings, given that tool choice format is specific to different model providers.

[leseb]

I think we'll want to customize this on OpenAIModelSettings, given that tool choice format is specific to different model providers.

@sydney-runkle Thanks for looking into this. Are you referring to exposing a setting like ModelSettings? I’m curious about how frequently users would need to adjust this flag. Thanks!

[sydney-runkle]

Yes, we'll want to expose a setting and document it. Specifically, we'll probably want to add this to OpenAIModelSettings.

[leseb]

I no longer have the time to continue working on this, so I’ll be closing it.

[webcoderz]

thanks @leseb this seems to work..

[webcoderz]

@sydney-runkle see: #825 i added tool_choice to ModelSettings as requested.