Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix test errors in source tables #20

Merged
merged 2 commits into from
Feb 15, 2024
Merged

Fix test errors in source tables #20

merged 2 commits into from
Feb 15, 2024

Conversation

chowbao
Copy link
Contributor

@chowbao chowbao commented Feb 15, 2024

Casting closed_at to datetime and fixing mismatching time data types

Copy link
Contributor

@sydneynotthecity sydneynotthecity left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Had a question but doesn't block the merge. I think we'll need to query processing closely after deploy to make sure we're not scanning too much data

models/sources/src_history_operations.yml Outdated Show resolved Hide resolved
Comment on lines 25 to 26
where: cast(closed_at as datetime) >= datetime_trunc(datetime_sub(current_datetime(), interval 2 day), day)
and cast(closed_at as datetime) < datetime_trunc(current_datetime(), day)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

might need to add the partition fields to this where clause otherwise it's gonna be expensive

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I'll look at these tables again. It should be based on the partitioned field

@chowbao chowbao merged commit 24a7213 into master Feb 15, 2024
@sydneynotthecity sydneynotthecity deleted the fix-test-errors branch February 15, 2024 20:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants