Patch/update partition expiration sandbox #549
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Checklist
PR Structure
otherwise).
Thoroughness
What
Update the canvas sandbox retention period to 5 quarters (15 months). The original retention window was 6 months.
Why
6 month is not a big enough time window to perform adequate period over period metrics. The business has requested a larger retention window.
Known limitations
Canvas defaults to loading a full table into the workspace when creating a report. The user has to add filters after the initial load. It is possible that this retention window is too big and will timeout for any new development. If the window is too big, we will adjust to 9-12 months.
To recreate the tables, we will need to trigger a manual DAG run for the Create table dag, then rerun today's update day dag after the tables have been recreated