You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This DAG pulls euro ohlc pricing information from coingecko (it’s configurable but in general this is what its purpose is). There are currently cloud functions that do the same thing. These should be consolidated.
The preference is to move all these into cloud functions as there are a few bugs/inefficiencies with daily_euro_ohlc_dag
daily_euro_ohlc_dag:
Doesn’t deduplicate so there are multiples of the exact same timestamp and ohlc data
Uploads to GCS then uploads to BQ whereas the cloud functions directly upload to BQ
Does not use our API key to get around rate limiting from the given website (TBD: need to check if this is true)
The text was updated successfully, but these errors were encountered:
This DAG pulls euro ohlc pricing information from coingecko (it’s configurable but in general this is what its purpose is). There are currently cloud functions that do the same thing. These should be consolidated.
The preference is to move all these into cloud functions as there are a few bugs/inefficiencies with
daily_euro_ohlc_dag
daily_euro_ohlc_dag:
The text was updated successfully, but these errors were encountered: