supports-parallel-tools param to OpenAI

[Dirt-Nasty]

Added supports-parallel-tools param to OpenAIModel for models that do not support passing this in. ex (Azure Open AI)

[sydney-runkle]

Hmm, I think you can just use parallel_tool_calls in ModelSettings to control this as desired.

[Dirt-Nasty]

@sydney-runkle

There is a difference.

Setting it in ModelSettings as False still executes chat.completions.create with the parallel_tools_calls as False resulting in.

BadRequestError: Error code: 400 - {'error_code': 'BAD_REQUEST', 'message': 'Bad request: json: unknown field "parallel_tool_calls"\n'}

Some models do not accept that.

As an example any model being deployed with MLFlow using 'llm/v1/chat` does not accept that value in the model schema.

https://mlflow.org/docs/latest/llms/deployments/index.html#standard-deployments-parameters
https://github.com/Azure/azure-rest-api-specs/blob/main/specification/cognitiveservices/data-plane/AzureOpenAI/inference/preview/2024-05-01-preview/generated.json

If I were to call an Agent without ModelSettings and tools then I can query my model just fine.

Thats because NOT_GIVEN is being used in that case which omits it from being passed to the function altogether.