Handle long queries

[sudeephb]

Some metrics take too much time to be fetched(eg. ipmi-sel as reported on #62 ). We need to find a robust solution to handle this kind of issues. The solution may(or may not) involve

• increasing the prometheus scrape interval and timeout,
• implementing cache for long-running queries
• Running background checks to fetch metrics independently and write to a file/db, from where grafana-agent can read.

Note that the default prometheus scrape interval is 1m and scrape timeout is 10s.

[Pjack]

Partly solved in
canonical/hardware-observer-operator#282
canonical/hardware-observer-operator#193

With the recent enhancements, I’d like to close this ticket for now unless a specific issue arises again.
It's difficult to track the issue without a well-defined problem statement.

[syncronize-issues-to-jira]

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/SOLENG-994.

This message was autogenerated