Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add timescaledb to infrastructure #4716

Merged
merged 1 commit into from
Jun 30, 2024

Conversation

jonatas
Copy link

@jonatas jonatas commented May 15, 2024

It relates to the very beginning of #4642.

Talking to @simi, we agreed on adding a basic setup to infra and incrementally be adding the remaining features. Nothing new here, just a fragment of previous work.

The POC is also available for those that are curious on how it will work.

docker-compose.yml Outdated Show resolved Hide resolved
ports:
- "5432:5432"
timescale:
image: timescale/timescaledb-ha:pg16.2-ts2.14.2-all
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This image is 1.5GB @jonatas, isn't there any small one suitable for development + CI?

Copy link
Author

@jonatas jonatas Jun 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, there's a smaller one but does not contains the toolkit. Probably latest-pg16 already do the work. < 300MB.

Suggested change
image: timescale/timescaledb-ha:pg16.2-ts2.14.2-all
image: timescale/timescaledb:latest-pg16

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Link 404s, https://hub.docker.com/layers/timescale/timescaledb/latest-pg16. What's the toolkit useful for?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Toolkit can give extra flexibility in the components for statistics, containing several cool stuff like most of the hyperfunctions.

It allow us to use components like stats_agg that have some embeddings for several statistics, so you can extract stddev, average without recomputing everything. Percentile_agg do the same for distribution and allow you to get several discs without reprocessing. The coolest part is rollup that allows to merge this _agg objects and reuse pre-calculated data into bigger timeframes.

https://hub.docker.com/layers/timescale/timescaledb/latest-pg16/images/sha256-379dc1846318a812301a78e860f7af5f09fd391f8de798a4b477827174da8f96?context=explore

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm investigating if we have any light image that includes the toolkit, but we can also move without it and later just add it as a plus.

I updated it now and tested again 👍

@simi simi force-pushed the add-timescaledb-to-stack branch 2 times, most recently from 7b3f763 to 500297d Compare May 31, 2024 22:48
Copy link

codecov bot commented May 31, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.00%. Comparing base (e43259d) to head (ca68070).
Report is 62 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4716      +/-   ##
==========================================
- Coverage   97.00%   97.00%   -0.01%     
==========================================
  Files         397      406       +9     
  Lines        8428     8520      +92     
==========================================
+ Hits         8176     8265      +89     
- Misses        252      255       +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@simi simi force-pushed the add-timescaledb-to-stack branch 3 times, most recently from ecdb6da to e4289ae Compare June 1, 2024 11:38
db/downloads_schema.rb Outdated Show resolved Hide resolved
@jonatas jonatas force-pushed the add-timescaledb-to-stack branch from 4d0a7b3 to 6cf98a4 Compare June 7, 2024 13:27
@jonatas
Copy link
Author

jonatas commented Jun 7, 2024

After rebase github is showing the unrelated commits. Any thoughts how to fix it?

@simi
Copy link
Member

simi commented Jun 7, 2024

After rebase github is showing the unrelated commits. Any thoughts how to fix it?

I'll fix.

@simi simi force-pushed the add-timescaledb-to-stack branch from b2277fc to 00fb0ee Compare June 12, 2024 20:23
@simi
Copy link
Member

simi commented Jun 12, 2024

@jonatas fixed

@jonatas
Copy link
Author

jonatas commented Jun 13, 2024

Thanks a lot @simi! Anything else I can do from now? Happy to proceed with next PR 🤓

docker-compose.yml Outdated Show resolved Hide resolved
@simi simi force-pushed the add-timescaledb-to-stack branch from 00fb0ee to ca68070 Compare June 30, 2024 14:12
@simi simi enabled auto-merge (rebase) June 30, 2024 14:14
@simi simi merged commit e7faec5 into rubygems:master Jun 30, 2024
17 checks passed
@jonatas jonatas deleted the add-timescaledb-to-stack branch August 8, 2024 22:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

4 participants