Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add gemini vertex model provider #297

Merged

Conversation

iwilltry42
Copy link
Contributor

@iwilltry42 iwilltry42 commented Dec 23, 2024

Already implements the /validate endpoint from obot-platform/obot#1019

Ref: obot-platform/obot#872

@thedadams
Copy link
Contributor

My concern with this is that it is not async which we have seen performance issues with non-async model providers.

I noticed that there is a Go package: https://github.com/googleapis/go-genai

In your opinion, would this work for us?

@iwilltry42 iwilltry42 marked this pull request as draft January 7, 2025 20:08
@iwilltry42
Copy link
Contributor Author

Back to draft for the rewrite to Go...

@iwilltry42 iwilltry42 force-pushed the feat/gemini-vertex-model-provider branch 2 times, most recently from 98cb57c to 69fd5cf Compare January 9, 2025 18:57
@iwilltry42
Copy link
Contributor Author

Go Rewrite is done, but I'll continue implementing the embeddings API as well

@iwilltry42 iwilltry42 marked this pull request as ready for review January 10, 2025 12:09
@iwilltry42
Copy link
Contributor Author

iwilltry42 commented Jan 10, 2025

With the Go rewrite, I also the /embeddings endpoint (needed a custom implementation as it's not part of their SDK and I couldn't get it working with what they have there so far... I re-used a bunch of code from knowledge, so it's fine).

@iwilltry42 iwilltry42 force-pushed the feat/gemini-vertex-model-provider branch from c8d48dc to 0fa890a Compare January 10, 2025 12:55
Copy link
Contributor

@thedadams thedadams left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A bunch of nits, but I there are a couple comments that should be addressed.

gemini-vertex-model-provider/main.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/main.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
@iwilltry42 iwilltry42 requested a review from thedadams January 13, 2025 08:52
Copy link
Contributor

@thedadams thedadams left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Adding usages is the last thing I can see.

gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
gemini-vertex-model-provider/server/server.go Outdated Show resolved Hide resolved
@iwilltry42 iwilltry42 force-pushed the feat/gemini-vertex-model-provider branch from 754ce15 to fdbac79 Compare January 17, 2025 11:17
@iwilltry42 iwilltry42 merged commit 588c431 into obot-platform:main Jan 17, 2025
@iwilltry42 iwilltry42 deleted the feat/gemini-vertex-model-provider branch January 17, 2025 14:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants