0.0.102

feat: log original relevance scores

0.0.58

fix: stream buffer issue

0.0.29

Here are some updates:
[x] We have added support for GPT-3.5 on the miner's side, which is now the default model.

It is utilized in three scenarios:

• --miner.openai_summary_model: OpenAI model used for summarizing content. Default: gpt-3.5-turbo-1106
• --miner.openai_query_model: OpenAI model used for generating queries. Default: gpt-3.5-turbo-1106
• --miner.openai_fix_query_model: OpenAI model used for fixing queries. Default: gpt-4-1106-preview

For more details, visit: https://github.com/surcyf123/smart-scrape/blob/main/docs/running_a_miner.md

You can use any OpenAI models, With the default Models you can reduce OpenAI cost 7-10 times.

[x] Updated the mockdataset class and added more synthetic data questions.
[x] Changed the synthetic data interval from 10 minutes to 30 minutes.
[x] Refactor code

0.0.25

Twitter API Improvements:

[x] The miner will not start if the TWITTER_BEARER_TOKEN, OPENAI_API_KEY, or WANDB_API_KEY have not been set.
[x] If, while running, the miner receives a 401 or 403 error from the Twitter API, it will stop working. In this case, you need to promptly address your API key issues to get your miner back on the network.
[x] If, while running, the miner receives a 400 Bad Request error from the Twitter API, it will attempt to fix the query and retrieve data again.
[x] If, while running, the miner receives 429, 502, 503, or 504 errors from the Twitter API, it will wait for 20 seconds and then make one more attempt to connect to the Twitter API.
[x] Update the retry attempt prompt and methods in the Twitter API.