feat(agents-api): Add litellm proxy to docker compose

[creatorrr]

Signed-off-by: Diwank Tomer [email protected]

---

🚀	This description was created by Ellipsis for commit 781c7ab

Summary:

This PR adds a litellm proxy service to the Docker Compose setup, updates model configurations, and modifies dependencies in the agents-api.

Key points:

• Added llm-proxy/docker-compose.yml to include litellm service with dependencies on litellm-db and litellm-redis.
• Updated agents-api/docker-compose.yml to change MODEL_ID to Alibaba-NLP/gte-large-en-v1.5 and image version to 1.5.
• Removed google-cloud-aiplatform, async-lru, transformers, and xxhash from agents-api/pyproject.toml dependencies.
• Updated litellm version to ^1.43.3 and tiktoken to ^0.7.0 in agents-api/pyproject.toml.
• Added llm-proxy/.dockerignore and llm-proxy/.gitignore to ignore .keys.
• Configured llm-proxy/litellm-config.yaml with various model settings and environment variables.

---

Generated with ❤️ by ellipsis.dev

[ellipsis-dev]

👍 Looks good to me! Reviewed everything up to 781c7ab in 18 seconds

More details

• Looked at 273 lines of code in 7 files
• Skipped 1 files when reviewing.
• Skipped posting 1 drafted comments based on config settings.

1. docker-compose.yml:9

• Draft comment:
  The PR description lacks details about the purpose and functionality of the new litellm proxy service. It would be beneficial to include more information to help team members understand the changes.
• Reason this comment was not posted:
  Confidence changes required: 33%
  The PR title mentions adding a 'litellm proxy to docker compose', but the changes in the docker-compose.yml files and the addition of the llm-proxy directory with its own docker-compose.yml suggest that a new service (litellm proxy) is being added to the overall project infrastructure. The PR description is minimal and does not provide details about why this change is necessary or what the new service does. This lack of detail could make it harder for other team members to understand the purpose and functionality of the new service, potentially leading to confusion or misuse.

Workflow ID: wflow_4547eGRBHPcS2Wdv

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.