Freeze During Upload Step in Data Processing Script

[HyunjunA]

• Experiencing a Freeze at the Upload Stage

[jay-m-dev]

Please add the following information:
steps to reproduce
OS

[HyunjunA]

I renamed the .env.sample file to .env, updated the OPENAI_API_KEY with my own API key, and set the WEAVIATE_URL to http://mylocalIP:8080. I configured .env files in both the Frontend and Backend folders of the KRAGEN_Dashboard and initialized the config.json in the Backend using config.json.sample. Lastly, I executed the command docker-compose run kragen setup test.csv on my Mac.

[jay-m-dev]

I've experienced freezing, but so far, only when the WEAVIATE_URL is set to the wrong IP address. I'll add logs on the setup process (to get a better reading on this) when I work on #61

[jay-m-dev]

Found a related issue in the Weaviate Client Connection (see here).
Perhaps adding a timeout_config as explained here may work. Or we can also try using a different method to get a client as explained here.
Alternatively, we could just migrate to using the weaviate client v4 (issue #53). But resolving #53 may take some time, since the v4 API is very different from v3.