[Backend] Query data from source API

[glenflorendo]

User Story

As a developer, I want to implement a temporary solution to query data directly from our source data API to unblock the development process while the data science team works on the data pipeline to our database. This solution should be efficient and maintainable, and it may become a standard implementation based on its performance.

Description

Currently, the data pipeline to our database is not yet completed, which is blocking the development of certain features that require access to data. To unblock the development process, we will implement a temporary solution to query data directly from our source data API. This solution will allow us to continue development while the data science team works on completing the data pipeline.

Acceptance Criteria

• Implement a data query mechanism to fetch data from the source data API.
• Ensure that the implementation is efficient and does not significantly impact application performance.
• Design the implementation to be easily replaceable once the data pipeline to the database is completed.
• Update the necessary components and modules to use the temporary data query implementation.
• Test the implementation to ensure that it works as expected and does not introduce regressions.

Technical References

Dataset Home Page
Dataset API Docs

Design References

[ExperimentsInHonesty]

@bennyv8 Hi Benny, we have not seen you in a while. Are you still working on this issue?