0.0.29
Here are some updates:
[x] We have added support for GPT-3.5 on the miner's side, which is now the default model.
It is utilized in three scenarios:
--miner.openai_summary_model
: OpenAI model used for summarizing content. Default: gpt-3.5-turbo-1106--miner.openai_query_model
: OpenAI model used for generating queries. Default: gpt-3.5-turbo-1106--miner.openai_fix_query_model
: OpenAI model used for fixing queries. Default: gpt-4-1106-preview
For more details, visit: https://github.com/surcyf123/smart-scrape/blob/main/docs/running_a_miner.md
You can use any OpenAI models, With the default Models you can reduce OpenAI cost 7-10 times.
[x] Updated the mockdataset class and added more synthetic data questions.
[x] Changed the synthetic data interval from 10 minutes to 30 minutes.
[x] Refactor code