How to Use GPT-4o or Gemini-1.5-pro LLM with the Dockerized Pandas-AI Platform Project

[NathanWu12]

I would like to use the gpt-4o or gemini-1.5-pro llm. Could someone please advise which file under the server path should be modified?

[dosubot[bot]]

Hey @NathanWu12! 👋 I'm here to help you with any bugs, questions, or contributions while you wait for a human maintainer. Let's dive in and tackle this challenge together!

I wasn't able to find specific information about integrating gpt-4o or gemini-1.5-pro with the pandas-ai platform. However, to integrate a new LLM, you would typically need to modify the pandasai.json file to specify the LLM and its parameters. Additionally, new LLM integrations should be added to the pandasai/llm directory, as this is where existing LLM integration files are located ^[1].

For guidance on integrating new LLMs, you can refer to the pandasai/llm/base.py file, which provides a base class for implementing a new LLM ^[2]. You might also want to check the documentation for any specific instructions related to third-party LLM integration ^[3].

To continue talking to Dosu, mention @dosu.

[NathanWu12]

I would llike to use the gemini llm. I modified the llm field in pandasai.json and df_config.py, but the log still calls bamboo. Can you help me understand why? @Dusu

pandasai.json:
{
"save_logs": true,
"verbose": false,
"enforce_privacy": false,
"enable_cache": true,
"use_error_correction_framework": true,
"max_retries": 3,
"open_charts": true,
"save_charts": false,
"save_charts_path": "exports/charts",
"custom_whitelisted_dependencies": [],
"llm": "GoogleGemini",
"llm_options": {
"api_key": "$mykeys"
}
}

df_config.py:
from typing import Any, List, Optional, TypedDict

from pandasai.constants import DEFAULT_CHART_DIRECTORY
from pandasai.helpers.dataframe_serializer import DataframeSerializerType
from pandasai.pydantic import BaseModel, Field, validator

from ..llm import LLM, GoogleGemini, LangchainLLM

class LogServerConfig(TypedDict):
server_url: str
api_key: str

class Config(BaseModel):
save_logs: bool = True
verbose: bool = False
enforce_privacy: bool = False
enable_cache: bool = True
use_error_correction_framework: bool = True
open_charts: bool = True
save_charts: bool = False
save_charts_path: str = DEFAULT_CHART_DIRECTORY
custom_whitelisted_dependencies: List[str] = Field(default_factory=list)
max_retries: int = 3
lazy_load_connector: bool = True
response_parser: Any = None
llm: LLM = "GoogleGemini"
data_viz_library: Optional[str] = ""
log_server: LogServerConfig = None
direct_sql: bool = False
dataframe_serializer: DataframeSerializerType = DataframeSerializerType.CSV

class Config:
    arbitrary_types_allowed = True

@validator("llm", always=True)
def validate_llm(cls, llm) -> LLM:
    if not isinstance(llm, (LLM, LangchainLLM)):  # also covers llm is None
        return GoogleGemini()
    return llm

Log:
pandabi-backend | startup.sh: line 6: log: command not found
postgresql-1 |
postgresql-1 | PostgreSQL Database directory appears to contain a database; Skipping initialization
postgresql-1 |
postgresql-1 | 2024-10-29 07:26:31.241 UTC [1] LOG: starting PostgreSQL 14.2 on x86_64-pc-linux-musl, compiled by gcc (Alpine 10.3.1_git20211027) 10.3.1 20211027, 64-bit
postgresql-1 | 2024-10-29 07:26:31.246 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432
postgresql-1 | 2024-10-29 07:26:31.248 UTC [1] LOG: listening on IPv6 address "::", port 5432
postgresql-1 | 2024-10-29 07:26:31.305 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
postgresql-1 | 2024-10-29 07:26:31.387 UTC [22] LOG: database system was shut down at 2024-10-25 10:25:42 UTC
postgresql-1 | 2024-10-29 07:26:31.565 UTC [1] LOG: database system is ready to accept connections
pandabi-frontend |
pandabi-frontend | > [email protected] start
pandabi-frontend | > next start
pandabi-frontend |
pandabi-frontend | ⚠ You are using a non-standard "NODE_ENV" value in your environment. This creates inconsistencies in the project and is strongly advised against. Read more: https://nextjs.org/docs/messages/non-standard-node-env
pandabi-backend | Resolving dependencies...
pandabi-frontend | ▲ Next.js 14.2.3
pandabi-frontend | - Local: http://localhost:3000
pandabi-frontend |
pandabi-frontend | ✓ Starting...
pandabi-backend | Warning: The locked version 3.9.1 for matplotlib is a yanked version. Reason for being yanked: The Windows wheels, under some conditions, caused segfaults in unrelated user code. Due to this we deleted the Windows wheels to prevent these segfaults, however this caused greater disruption as pip then began to try (and fail) to build 3.9.1 from the sdist on Windows which impacted far more users. Yanking the whole release is the only tool available to eliminate these failures without changes to on the user side. The sdist, OSX wheel, and manylinux wheels are all functional and there are no critical bugs in the release. Downstream packagers should not yank their builds of Matplotlib 3.9.1. See matplotlib/matplotlib#28551 for details.
pandabi-frontend | ✓ Ready in 17.3s
pandabi-backend | poetry install
pandabi-backend | Installing dependencies from lock file
pandabi-backend |
pandabi-backend | No dependencies to install or update
pandabi-backend |
pandabi-backend | Installing the current project: pandasai-server (0.1.0)
pandabi-backend | Warning: The current project could not be installed: No file/folder found for package pandasai-server
pandabi-backend | If you do not want to install the current project use --no-root.
pandabi-backend | If you want to use Poetry only for dependency management but not for packaging, you can disable package mode by setting package-mode = false in your pyproject.toml file.
pandabi-backend | In a future version of Poetry this warning will become an error!
pandabi-backend |
pandabi-backend | wait-for-it.sh: 4: shift: can't shift that many
pandabi-backend | export DEBUG='1'
pandabi-backend | export ENVIRONMENT='development'
pandabi-backend | export GPG_KEY='A035C8C19219BA821ECEA86B64E628F8D684696D'
pandabi-backend | export HOME='/root'
pandabi-backend | export HOSTNAME='3bcdc3784d49'
pandabi-backend | export LANG='C.UTF-8'
pandabi-backend | export MAKEFLAGS=''
pandabi-backend | export MAKELEVEL='1'
pandabi-backend | export MFLAGS=''
pandabi-backend | export PATH='/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/bin:/root/.local/bin:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin'
pandabi-backend | export POSTGRES_URL='postgresql+asyncpg://pandasai:password123@postgresql:5432/pandasai-db'
pandabi-backend | export PS1='(pandasai-server-py3.11) '
pandabi-backend | export PWD='/app'
pandabi-backend | export PYTHON_SHA256='07a4356e912900e61a15cb0949a06c4a05012e213ecd6b4e84d0f67aabbee372'
pandabi-backend | export PYTHON_VERSION='3.11.10'
pandabi-backend | export SHLVL='1'
pandabi-backend | export SHOW_SQL_ALCHEMY_QUERIES='0'
pandabi-backend | export TEST_POSTGRES_URL='postgresql+asyncpg://pandasai:password123@postgresql:5432/pandasai-db'
pandabi-backend | export VIRTUAL_ENV='/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11'
pandabi-backend | export VIRTUAL_ENV_PROMPT='pandasai-server-py3.11'
pandabi-backend | export _='/usr/bin/make'
pandabi-backend | export api_key='$mykeys'
pandabi-backend | export llm='GoogleGemini'
pandabi-backend | poetry run alembic upgrade head
pandabi-backend | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
pandabi-backend | INFO [alembic.runtime.migration] Will assume transactional DDL.
pandabi-backend | export DEBUG='1'
pandabi-backend | export ENVIRONMENT='development'
pandabi-backend | export GPG_KEY='A035C8C19219BA821ECEA86B64E628F8D684696D'
pandabi-backend | export HOME='/root'
pandabi-backend | export HOSTNAME='3bcdc3784d49'
pandabi-backend | export LANG='C.UTF-8'
pandabi-backend | export MAKEFLAGS=''
pandabi-backend | export MAKELEVEL='1'
pandabi-backend | export MFLAGS=''
pandabi-backend | export PATH='/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/bin:/root/.local/bin:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin'
pandabi-backend | export POSTGRES_URL='postgresql+asyncpg://pandasai:password123@postgresql:5432/pandasai-db'
pandabi-backend | export PS1='(pandasai-server-py3.11) '
pandabi-backend | export PWD='/app'
pandabi-backend | export PYTHON_SHA256='07a4356e912900e61a15cb0949a06c4a05012e213ecd6b4e84d0f67aabbee372'
pandabi-backend | export PYTHON_VERSION='3.11.10'
pandabi-backend | export SHLVL='1'
pandabi-backend | export SHOW_SQL_ALCHEMY_QUERIES='0'
pandabi-backend | export TEST_POSTGRES_URL='postgresql+asyncpg://pandasai:password123@postgresql:5432/pandasai-db'
pandabi-backend | export VIRTUAL_ENV='/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11'
pandabi-backend | export VIRTUAL_ENV_PROMPT='pandasai-server-py3.11'
pandabi-backend | export _='/usr/bin/make'
pandabi-backend | export api_key='$mykeys'
pandabi-backend | export llm='GoogleGemini'
pandabi-backend | poetry run python main.py
pandabi-backend | INFO: Will watch for changes in these directories: ['/app']
pandabi-backend | INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
pandabi-backend | INFO: Started reloader process [58] using StatReload
pandabi-backend | INFO: Started server process [62]
pandabi-backend | INFO: Waiting for application startup.
pandabi-backend | 2024-10-29 07:27:42,069 INFO sqlalchemy.engine.Engine select pg_catalog.version()
pandabi-backend | 2024-10-29 07:27:42,069 INFO sqlalchemy.engine.Engine [raw sql] ()
pandabi-backend | 2024-10-29 07:27:42,073 INFO sqlalchemy.engine.Engine select current_schema()
pandabi-backend | 2024-10-29 07:27:42,073 INFO sqlalchemy.engine.Engine [raw sql] ()
pandabi-backend | 2024-10-29 07:27:42,077 INFO sqlalchemy.engine.Engine show standard_conforming_strings
pandabi-backend | 2024-10-29 07:27:42,078 INFO sqlalchemy.engine.Engine [raw sql] ()
pandabi-backend | 2024-10-29 07:27:42,081 INFO sqlalchemy.engine.Engine BEGIN (implicit)
pandabi-backend | 2024-10-29 07:27:42,095 INFO sqlalchemy.engine.Engine SELECT anon_1.id, anon_1.email, anon_1.first_name, anon_1.created_at, anon_1.password, anon_1.verified, anon_1.last_name, anon_1.features, organization_1.id AS id_1, organization_1.name, organization_1.url, organization_1.is_default, organization_1.settings, organization_membership_1.id AS id_2, organization_membership_1.user_id, organization_membership_1.organization_id, organization_membership_1.role, organization_membership_1.verified AS verified_1
pandabi-backend | FROM (SELECT "user".id AS id, "user".email AS email, "user".first_name AS first_name, "user".created_at AS created_at, "user".password AS password, "user".verified AS verified, "user".last_name AS last_name, "user".features AS features
pandabi-backend | FROM "user"
pandabi-backend | LIMIT $1::INTEGER OFFSET $2::INTEGER) AS anon_1 LEFT OUTER JOIN organization_membership AS organization_membership_1 ON anon_1.id = organization_membership_1.user_id LEFT OUTER JOIN organization AS organization_1 ON organization_1.id = organization_membership_1.organization_id
pandabi-backend | 2024-10-29 07:27:42,095 INFO sqlalchemy.engine.Engine [generated in 0.00031s] (1, 0)
pandabi-backend | 2024-10-29 07:27:42,958 INFO sqlalchemy.engine.Engine COMMIT
pandabi-backend | 2024-10-29 07:27:42,963 INFO sqlalchemy.engine.Engine BEGIN (implicit)
pandabi-backend | 2024-10-29 07:27:42,968 INFO sqlalchemy.engine.Engine SELECT anon_1.id, anon_1.email, anon_1.first_name, anon_1.created_at, anon_1.password, anon_1.verified, anon_1.last_name, anon_1.features, organization_1.id AS id_1, organization_1.name, organization_1.url, organization_1.is_default, organization_1.settings, organization_membership_1.id AS id_2, organization_membership_1.user_id, organization_membership_1.organization_id, organization_membership_1.role, organization_membership_1.verified AS verified_1
pandabi-backend | FROM (SELECT "user".id AS id, "user".email AS email, "user".first_name AS first_name, "user".created_at AS created_at, "user".password AS password, "user".verified AS verified, "user".last_name AS last_name, "user".features AS features
pandabi-backend | FROM "user"
pandabi-backend | LIMIT $1::INTEGER OFFSET $2::INTEGER) AS anon_1 LEFT OUTER JOIN organization_membership AS organization_membership_1 ON anon_1.id = organization_membership_1.user_id LEFT OUTER JOIN organization AS organization_1 ON organization_1.id = organization_membership_1.organization_id
pandabi-backend | 2024-10-29 07:27:42,968 INFO sqlalchemy.engine.Engine [cached since 0.8735s ago] (1, 0)
pandabi-backend | 2024-10-29 07:27:43,088 INFO sqlalchemy.engine.Engine SELECT workspace.id, workspace.name, workspace.user_id, workspace.organization_id, workspace.slug, workspace.created_at
pandabi-backend | FROM workspace
pandabi-backend | LIMIT $1::INTEGER OFFSET $2::INTEGER
pandabi-backend | 2024-10-29 07:27:43,088 INFO sqlalchemy.engine.Engine [generated in 0.00027s] (1, 0)
pandabi-backend | 2024-10-29 07:27:43,204 INFO sqlalchemy.engine.Engine SELECT dataset_space.id, dataset_space.dataset_id, dataset_space.workspace_id
pandabi-backend | FROM dataset_space
pandabi-backend | WHERE dataset_space.workspace_id = $1::UUID
pandabi-backend | 2024-10-29 07:27:43,204 INFO sqlalchemy.engine.Engine [generated in 0.00024s] (UUID('f5bd8adb-0184-4f2e-a714-59c41710ce46'),)
pandabi-backend | 2024-10-29 07:27:43,362 INFO sqlalchemy.engine.Engine SELECT dataset.id, dataset.name, dataset.table_name, dataset.description, dataset.created_at, dataset.head, dataset.user_id, dataset.organization_id, dataset.connector_id, dataset.field_descriptions, dataset.filterable_columns, connector_1.id AS id_1, connector_1.type, connector_1.config, connector_1.created_at AS created_at_1, connector_1.user_id AS user_id_1
pandabi-backend | FROM dataset LEFT OUTER JOIN connector AS connector_1 ON connector_1.id = dataset.connector_id
pandabi-backend | WHERE dataset.id IN ($1::UUID, $2::UUID)
pandabi-backend | 2024-10-29 07:27:43,363 INFO sqlalchemy.engine.Engine [generated in 0.00116s] (UUID('7332f884-4fae-48b6-90a9-a7f60654d28e'), UUID('07acb194-4076-43e1-9caa-cabe5cb4487c'))
pandabi-backend | 2024-10-29 07:27:43,804 INFO sqlalchemy.engine.Engine COMMIT
pandabi-backend | INFO: Application startup complete.
pandabi-backend | 2024-10-29 07:28:32,311 INFO sqlalchemy.engine.Engine BEGIN (implicit)
pandabi-backend | 2024-10-29 07:28:32,337 INFO sqlalchemy.engine.Engine SELECT "user".id, "user".email, "user".first_name, "user".created_at, "user".password, "user".verified, "user".last_name, "user".features
pandabi-backend | FROM "user"
pandabi-backend | LIMIT $1::INTEGER OFFSET $2::INTEGER
pandabi-backend | 2024-10-29 07:28:32,339 INFO sqlalchemy.engine.Engine [generated in 0.00609s] (1, 0)
pandabi-backend | 2024-10-29 07:28:32,381 INFO sqlalchemy.engine.Engine SELECT organization_membership.user_id AS organization_membership_user_id, organization_membership.id AS organization_membership_id, organization_membership.organization_id AS organization_membership_organization_id, organization_membership.role AS organization_membership_role, organization_membership.verified AS organization_membership_verified, organization_1.id AS organization_1_id, organization_1.name AS organization_1_name, organization_1.url AS organization_1_url, organization_1.is_default AS organization_1_is_default, organization_1.settings AS organization_1_settings, user_1.id AS user_1_id, user_1.email AS user_1_email, user_1.first_name AS user_1_first_name, user_1.created_at AS user_1_created_at, user_1.password AS user_1_password, user_1.verified AS user_1_verified, user_1.last_name AS user_1_last_name, user_1.features AS user_1_features
pandabi-backend | FROM organization_membership LEFT OUTER JOIN organization AS organization_1 ON organization_1.id = organization_membership.organization_id LEFT OUTER JOIN "user" AS user_1 ON user_1.id = organization_membership.user_id
pandabi-backend | WHERE organization_membership.user_id IN ($1::UUID)
pandabi-backend | 2024-10-29 07:28:32,383 INFO sqlalchemy.engine.Engine [generated in 0.00217s] (UUID('c5061285-1f63-4ec0-b35e-b9193f153959'),)
pandabi-backend | 2024-10-29 07:28:32,415 INFO sqlalchemy.engine.Engine SELECT workspace.id, workspace.name, workspace.user_id, workspace.organization_id, workspace.slug, workspace.created_at
pandabi-backend | FROM workspace
pandabi-backend | WHERE workspace.organization_id = $1::UUID
pandabi-backend | 2024-10-29 07:28:32,415 INFO sqlalchemy.engine.Engine [generated in 0.00068s] (UUID('a9b7f1a5-a37b-4ab4-b941-34a0e406b58c'),)
pandabi-backend | INFO: 192.168.65.1:25662 - "GET /v1/users/me HTTP/1.1" 200 OK
pandabi-backend | 2024-10-29 07:28:32,439 INFO sqlalchemy.engine.Engine ROLLBACK
pandabi-backend | 2024-10-29 07:28:32,924 INFO sqlalchemy.engine.Engine BEGIN (implicit)
pandabi-backend | 2024-10-29 07:28:32,925 INFO sqlalchemy.engine.Engine SELECT "user".id, "user".email, "user".first_name, "user".created_at, "user".password, "user".verified, "user".last_name, "user".features
pandabi-backend | FROM "user"
pandabi-backend | LIMIT $1::INTEGER OFFSET $2::INTEGER
pandabi-backend | 2024-10-29 07:28:32,925 INFO sqlalchemy.engine.Engine [cached since 0.592s ago] (1, 0)
pandabi-backend | 2024-10-29 07:28:32,929 INFO sqlalchemy.engine.Engine SELECT organization_membership.user_id AS organization_membership_user_id, organization_membership.id AS organization_membership_id, organization_membership.organization_id AS organization_membership_organization_id, organization_membership.role AS organization_membership_role, organization_membership.verified AS organization_membership_verified, organization_1.id AS organization_1_id, organization_1.name AS organization_1_name, organization_1.url AS organization_1_url, organization_1.is_default AS organization_1_is_default, organization_1.settings AS organization_1_settings, user_1.id AS user_1_id, user_1.email AS user_1_email, user_1.first_name AS user_1_first_name, user_1.created_at AS user_1_created_at, user_1.password AS user_1_password, user_1.verified AS user_1_verified, user_1.last_name AS user_1_last_name, user_1.features AS user_1_features
pandabi-backend | FROM organization_membership LEFT OUTER JOIN organization AS organization_1 ON organization_1.id = organization_membership.organization_id LEFT OUTER JOIN "user" AS user_1 ON user_1.id = organization_membership.user_id
pandabi-backend | WHERE organization_membership.user_id IN ($1::UUID)
pandabi-backend | 2024-10-29 07:28:32,929 INFO sqlalchemy.engine.Engine [cached since 0.549s ago] (UUID('c5061285-1f63-4ec0-b35e-b9193f153959'),)
pandabi-backend | 2024-10-29 07:28:32,936 INFO sqlalchemy.engine.Engine SELECT workspace.id, workspace.name, workspace.user_id, workspace.organization_id, workspace.slug, workspace.created_at
pandabi-backend | FROM workspace
pandabi-backend | WHERE workspace.organization_id = $1::UUID
pandabi-backend | 2024-10-29 07:28:32,936 INFO sqlalchemy.engine.Engine [cached since 0.5217s ago] (UUID('a9b7f1a5-a37b-4ab4-b941-34a0e406b58c'),)
pandabi-backend | 2024-10-29 07:28:33,019 INFO sqlalchemy.engine.Engine SELECT user_conversation.id, user_conversation.workspace_id, user_conversation.user_id, user_conversation.created_at, user_conversation.valid
pandabi-backend | FROM user_conversation
pandabi-backend | WHERE user_conversation.user_id = $1::UUID AND user_conversation.valid = true AND user_conversation.workspace_id = $2::UUID ORDER BY user_conversation.created_at DESC
pandabi-backend | LIMIT $3::INTEGER OFFSET $4::INTEGER
pandabi-backend | 2024-10-29 07:28:33,021 INFO sqlalchemy.engine.Engine [generated in 0.00217s] (UUID('c5061285-1f63-4ec0-b35e-b9193f153959'), UUID('f5bd8adb-0184-4f2e-a714-59c41710ce46'), 25, 0)
pandabi-backend | 2024-10-29 07:28:33,121 INFO sqlalchemy.engine.Engine SELECT conversation_message.conversation_id AS conversation_message_conversation_id, conversation_message.id AS conversation_message_id, conversation_message.created_at AS conversation_message_created_at, conversation_message.query AS conversation_message_query
pandabi-backend | FROM conversation_message
pandabi-backend | WHERE conversation_message.conversation_id IN ($1::UUID, $2::UUID, $3::UUID, $4::UUID, $5::UUID, $6::UUID, $7::UUID, $8::UUID, $9::UUID, $10::UUID, $11::UUID, $12::UUID, $13::UUID, $14::UUID, $15::UUID, $16::UUID, $17::UUID, $18::UUID, $19::UUID, $20::UUID)
pandabi-backend | 2024-10-29 07:28:33,121 INFO sqlalchemy.engine.Engine [generated in 0.00103s] (UUID('651da233-f633-40a9-9ad5-3c5ed0f5311d'), UUID('8a29e246-d90d-4e17-9365-e1763818e788'), UUID('341fc0ae-5c05-4434-8e04-9fb1bf155d53'), UUID('0ccedc9b-9524-42ef-95a0-2968e9dc9b18'), UUID('af874567-7e56-40bc-96c8-a772cbb74e3a'), UUID('4090670d-f6d7-4172-85b0-fa14e861bd1d'), UUID('d3d41f49-e1f6-4e55-9cac-749e989c502b'), UUID('c0878a59-a169-4e4b-a26a-c1ca8715b483'), UUID('d30b0542-cdc6-4cbf-9e1c-4eebf399be50'), UUID('55ba3312-22fb-48b6-8f81-879aadcfb540'), UUID('33cfdc91-fec1-4a0b-9f01-d3da8085e30b'), UUID('f3a80520-6418-47f9-8200-e8244bc20ce8'), UUID('6dbb871b-59db-42c6-9f98-abaec1bda512'), UUID('0cb3d610-5214-4797-a8f0-9bccc915ffe6'), UUID('d1e20553-25d1-450e-9a94-6c4d12518378'), UUID('89598699-89a3-43e1-8908-0fb30a972fef'), UUID('eb287fff-4b91-49d7-a08e-44cd5197f09a'), UUID('306a35fc-0940-4387-9032-4d91f40be051'), UUID('b01dbc9a-37fa-448c-add0-dc920dc3c60b'), UUID('56e73670-4927-41a5-ba8b-36c834eef1a0'))
pandabi-backend | 2024-10-29 07:28:33,193 INFO sqlalchemy.engine.Engine SELECT count(user_conversation.id) AS count_1
pandabi-backend | FROM user_conversation
pandabi-backend | WHERE user_conversation.user_id = $1::UUID AND user_conversation.workspace_id = $2::UUID AND user_conversation.valid = true
pandabi-backend | 2024-10-29 07:28:33,193 INFO sqlalchemy.engine.Engine [generated in 0.00032s] (UUID('c5061285-1f63-4ec0-b35e-b9193f153959'), UUID('f5bd8adb-0184-4f2e-a714-59c41710ce46'))
pandabi-backend | INFO: 192.168.65.1:25662 - "GET /v1/conversations/?skip=0&limit=25 HTTP/1.1" 200 OK
pandabi-backend | 2024-10-29 07:28:33,217 INFO sqlalchemy.engine.Engine ROLLBACK
pandabi-backend | INFO: 192.168.65.1:38353 - "OPTIONS /v1/chat/ HTTP/1.1" 200 OK
pandabi-backend | 2024-10-29 07:29:12,323 INFO sqlalchemy.engine.Engine BEGIN (implicit)
pandabi-backend | 2024-10-29 07:29:12,324 INFO sqlalchemy.engine.Engine SELECT "user".id, "user".email, "user".first_name, "user".created_at, "user".password, "user".verified, "user".last_name, "user".features
pandabi-backend | FROM "user"
pandabi-backend | LIMIT $1::INTEGER OFFSET $2::INTEGER
pandabi-backend | 2024-10-29 07:29:12,324 INFO sqlalchemy.engine.Engine [cached since 39.89s ago] (1, 0)
pandabi-backend | 2024-10-29 07:29:12,380 INFO sqlalchemy.engine.Engine SELECT organization_membership.user_id AS organization_membership_user_id, organization_membership.id AS organization_membership_id, organization_membership.organization_id AS organization_membership_organization_id, organization_membership.role AS organization_membership_role, organization_membership.verified AS organization_membership_verified, organization_1.id AS organization_1_id, organization_1.name AS organization_1_name, organization_1.url AS organization_1_url, organization_1.is_default AS organization_1_is_default, organization_1.settings AS organization_1_settings, user_1.id AS user_1_id, user_1.email AS user_1_email, user_1.first_name AS user_1_first_name, user_1.created_at AS user_1_created_at, user_1.password AS user_1_password, user_1.verified AS user_1_verified, user_1.last_name AS user_1_last_name, user_1.features AS user_1_features
pandabi-backend | FROM organization_membership LEFT OUTER JOIN organization AS organization_1 ON organization_1.id = organization_membership.organization_id LEFT OUTER JOIN "user" AS user_1 ON user_1.id = organization_membership.user_id
pandabi-backend | WHERE organization_membership.user_id IN ($1::UUID)
pandabi-backend | 2024-10-29 07:29:12,380 INFO sqlalchemy.engine.Engine [cached since 39.9s ago] (UUID('c5061285-1f63-4ec0-b35e-b9193f153959'),)
pandabi-backend | 2024-10-29 07:29:12,395 INFO sqlalchemy.engine.Engine SELECT workspace.id, workspace.name, workspace.user_id, workspace.organization_id, workspace.slug, workspace.created_at
pandabi-backend | FROM workspace
pandabi-backend | WHERE workspace.organization_id = $1::UUID
pandabi-backend | 2024-10-29 07:29:12,395 INFO sqlalchemy.engine.Engine [cached since 39.88s ago] (UUID('a9b7f1a5-a37b-4ab4-b941-34a0e406b58c'),)
pandabi-backend | 2024-10-29 07:29:12,621 INFO sqlalchemy.engine.Engine SELECT dataset.id, dataset.name, dataset.table_name, dataset.description, dataset.created_at, dataset.head, dataset.user_id, dataset.organization_id, dataset.connector_id, dataset.field_descriptions, dataset.filterable_columns, connector_1.id AS id_1, connector_1.type, connector_1.config, connector_1.created_at AS created_at_1, connector_1.user_id AS user_id_1, dataset_space_1.id AS id_2, dataset_space_1.dataset_id, dataset_space_1.workspace_id
pandabi-backend | FROM dataset JOIN dataset_space ON dataset.id = dataset_space.dataset_id LEFT OUTER JOIN connector AS connector_1 ON connector_1.id = dataset.connector_id LEFT OUTER JOIN dataset_space AS dataset_space_1 ON dataset.id = dataset_space_1.dataset_id
pandabi-backend | WHERE dataset_space.workspace_id = $1::UUID
pandabi-backend | 2024-10-29 07:29:12,622 INFO sqlalchemy.engine.Engine [generated in 0.00036s] ('f5bd8adb-0184-4f2e-a714-59c41710ce46',)
pandabi-backend | 2024-10-29 07:29:12,786 INFO sqlalchemy.engine.Engine COMMIT
pandabi-backend | INFO: 192.168.65.1:38353 - "POST /v1/chat/ HTTP/1.1" 500 Internal Server Error
pandabi-backend | ERROR: Exception in ASGI application
pandabi-backend | Traceback (most recent call last):
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 407, in run_asgi
pandabi-backend | result = await app( # type: ignore[func-returns-value]
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 78, in call
pandabi-backend | return await self.app(scope, receive, send)
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/fastapi/applications.py", line 271, in call
pandabi-backend | await super().call(scope, receive, send)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/applications.py", line 118, in call
pandabi-backend | await self.middleware_stack(scope, receive, send)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/middleware/errors.py", line 184, in call
pandabi-backend | raise exc
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/middleware/errors.py", line 162, in call
pandabi-backend | await self.app(scope, receive, _send)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/middleware/cors.py", line 92, in call
pandabi-backend | await self.simple_response(scope, receive, send, request_headers=headers)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/middleware/cors.py", line 147, in simple_response
pandabi-backend | await self.app(scope, receive, send)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/middleware/authentication.py", line 48, in call
pandabi-backend | await self.app(scope, receive, send)
pandabi-backend | File "/app/core/fastapi/middlewares/sqlalchemy.py", line 19, in call
pandabi-backend | raise exception
pandabi-backend | File "/app/core/fastapi/middlewares/sqlalchemy.py", line 17, in call
pandabi-backend | await self.app(scope, receive, send)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 79, in call
pandabi-backend | raise exc
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 68, in call
pandabi-backend | await self.app(scope, receive, sender)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 21, in call
pandabi-backend | raise e
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call
pandabi-backend | await self.app(scope, receive, send)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/routing.py", line 706, in call
pandabi-backend | await route.handle(scope, receive, send)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/routing.py", line 276, in handle
pandabi-backend | await self.app(scope, receive, send)
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/starlette/routing.py", line 66, in app
pandabi-backend | response = await func(request)
pandabi-backend | ^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/fastapi/routing.py", line 237, in app
pandabi-backend | raw_response = await run_endpoint_function(
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/fastapi/routing.py", line 163, in run_endpoint_function
pandabi-backend | return await dependant.call(**values)
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/app/api/v1/chat/chat.py", line 20, in chat
pandabi-backend | response = await chat_controller.chat(user, chat_request)
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/app/core/database/transactional.py", line 40, in decorator
pandabi-backend | raise exception
pandabi-backend | File "/app/core/database/transactional.py", line 21, in decorator
pandabi-backend | result = await self._run_required(
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/app/core/database/transactional.py", line 47, in _run_required
pandabi-backend | result = await function(*args, **kwargs)
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/app/app/controllers/chat.py", line 99, in chat
pandabi-backend | agent = Agent(connectors, config=config)
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/pandasai/agent/agent.py", line 28, in init
pandabi-backend | super().init(
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/pandasai/agent/base.py", line 74, in init
pandabi-backend | self.config = self.get_config(config)
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/pandasai/agent/base.py", line 133, in get_config
pandabi-backend | config = Config(**config)
pandabi-backend | ^^^^^^^^^^^^^^^^
pandabi-backend | File "pydantic/main.py", line 339, in pydantic.main.BaseModel.init
pandabi-backend | File "pydantic/main.py", line 1074, in pydantic.main.validate_model
pandabi-backend | File "pydantic/fields.py", line 874, in pydantic.fields.ModelField.validate
pandabi-backend | File "pydantic/fields.py", line 1154, in pydantic.fields.ModelField._apply_validators
pandabi-backend | File "pydantic/class_validators.py", line 304, in pydantic.class_validators._generic_validator_cls.lambda4
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/pandasai/schemas/df_config.py", line 40, in validate_llm
pandabi-backend | return BambooLLM()
pandabi-backend | ^^^^^^^^^^^
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/pandasai/llm/bamboo_llm.py", line 14, in init
pandabi-backend | self._session = Session(endpoint_url=endpoint_url, api_key=api_key)
pandabi-backend | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pandabi-backend | File "/root/.cache/pypoetry/virtualenvs/pandasai-server-9TtSrW0h-py3.11/lib/python3.11/site-packages/pandasai/helpers/request.py", line 23, in init
pandabi-backend | raise PandasAIApiKeyError()
pandabi-backend | pandasai.exceptions.PandasAIApiKeyError: The api_key client option must be set either by passing api_key to the client or by setting the PANDASAI_API_KEY environment variable. To get the key follow below steps:
pandabi-backend | 1. Go to https://www.pandabi.ai and sign up
pandabi-backend | 2. From settings go to API keys and copy
pandabi-backend | 3. Set environment variable like os.environ['PANDASAI_API_KEY'] = '$2a$10$flb7....'
postgresql-1 | 2024-10-29 08:15:37.346 UTC [27] LOG: stats_timestamp 2024-10-29 08:15:37.734509+00 is later than collector's time 2024-10-29 08:15:37.320074+00 for database 0

[dosubot[bot]]

The issue you're encountering, where the log still calls BambooLLM instead of GoogleGemini, might be due to the validate_llm method in df_config.py. This method checks if the llm attribute is a valid instance of LLM or LangchainLLM. If not, it defaults to BambooLLM ^[1].

Here are a few things to check and try:

1. Ensure GoogleGemini is Correctly Imported and Used: Make sure that GoogleGemini is correctly imported in df_config.py and that it is a subclass of LLM or LangchainLLM. If GoogleGemini is not recognized as a valid LLM instance, the validator will default to BambooLLM.

2. Check the pandasai.json Configuration: Verify that the llm field in pandasai.json is correctly set to "GoogleGemini" and that the llm_options are properly configured. Ensure that the API key is correctly set and accessible.

3. Environment Variables: Ensure that the environment variable for the API key is correctly set. The error message suggests setting the PANDASAI_API_KEY environment variable.

4. Rebuild the Docker Image: If you are using Docker, make sure to rebuild the Docker image after making changes to the configuration files. This ensures that the changes are applied.

5. Debugging: Add some logging or print statements in the validate_llm method to see what value is being passed and why it might be defaulting to BambooLLM.

By ensuring that GoogleGemini is correctly recognized as a valid LLM and that the configuration is properly set, you should be able to resolve the issue.

To continue talking to Dosu, mention @dosu.