Skip to content

0.0.29

Compare
Choose a tag to compare
@Chkhikvadze Chkhikvadze released this 27 Jan 11:22
· 1064 commits to main since this release

Here are some updates:
[x] We have added support for GPT-3.5 on the miner's side, which is now the default model.

It is utilized in three scenarios:

  • --miner.openai_summary_model: OpenAI model used for summarizing content. Default: gpt-3.5-turbo-1106
  • --miner.openai_query_model: OpenAI model used for generating queries. Default: gpt-3.5-turbo-1106
  • --miner.openai_fix_query_model: OpenAI model used for fixing queries. Default: gpt-4-1106-preview

For more details, visit: https://github.com/surcyf123/smart-scrape/blob/main/docs/running_a_miner.md

You can use any OpenAI models, With the default Models you can reduce OpenAI cost 7-10 times.

[x] Updated the mockdataset class and added more synthetic data questions.
[x] Changed the synthetic data interval from 10 minutes to 30 minutes.
[x] Refactor code