AnyScale Endpoints Integration #49

Anindyadeep · 2024-02-23T08:25:10Z

This PR solves:

issue Integrate Anyscale Provider #26
Supports chat_completion, embedding and fine-tuning
Also need to change some portion of OpenAIConenctor side, such that it handles some issues related to anyscale (where some arguments passed can not be None like tools and tools_choice) without compromising with functionalities of OpenAIConnector

- Uses OpenAIConnector as base - supports chat_completion, embedding and fine-tuning

prem_utils/models.json

…fier prefix

Anindyadeep added 4 commits February 23, 2024 13:50

Added models supported by anyscale in models.json

65570db

Added anyscale to e2e

bed1df7

handling optional parameters in kwargs to handle errors in anyscale

cfdb9ea

Feat: Integration of Anyscale endpoints

e6149a5

- Uses OpenAIConnector as base - supports chat_completion, embedding and fine-tuning

Anindyadeep requested review from filopedraz, albemordo and allemonta February 23, 2024 08:25

filopedraz suggested changes Feb 23, 2024

View reviewed changes

prem_utils/models.json Outdated Show resolved Hide resolved

prem_utils/models.json Outdated Show resolved Hide resolved

Anindyadeep added 2 commits February 23, 2024 20:43

Added unique identifier prefix for anyscale models

ed9a787

Handling edge case if user directly copy paste model name with identi…

596dd61

…fier prefix

Anindyadeep requested a review from filopedraz February 23, 2024 15:14

Anindyadeep marked this pull request as draft February 23, 2024 15:14

resolved merge conflicts and added anyscale to e2e

20a14f7

Anindyadeep self-assigned this Feb 26, 2024

Anindyadeep marked this pull request as ready for review February 26, 2024 15:15

filopedraz approved these changes Feb 26, 2024

View reviewed changes

filopedraz merged commit 660fe06 into main Feb 26, 2024
1 check passed

Provide feedback