-
Notifications
You must be signed in to change notification settings - Fork 19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Updates to get dbt models running in prod #292
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good
@@ -24,7 +24,7 @@ | |||
default_args=get_default_dag_args(), | |||
start_date=datetime(2023, 1, 1, 0, 0), | |||
description="This DAG automates daily updates to partner tables in BigQuery.", | |||
schedule_interval="20 15 * * *", | |||
schedule_interval="0 13 * * *", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
note: MGI does not deliver the file until 16:00 UTC, so we'll be polling for a bit before the file shows up
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That should be fine. Seems like we were waiting then anyways lol.
Also the way the cross dependency function is written makes it weird cause it's hard coded to accept a minutes before offset
Update/Add variables to get dbt models working in prod