Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Databases and Data warehouses Benchmark: Create connections for Full Refresh Overwrite #12355

Closed
noahkawasaki-airbyte opened this issue Apr 26, 2022 · 1 comment
Closed

Databases and Data warehouses Benchmark: Create connections for Full Refresh Overwrite #12355

noahkawasaki-airbyte opened this issue Apr 26, 2022 · 1 comment
Labels
area/databases area/warehouses connectors/destinations-warehouse connectors/sources-database from/connector-ops type/enhancement New feature or request

Comments

@noahkawasaki-airbyte
Copy link
Contributor

noahkawasaki-airbyte commented Apr 26, 2022 •
edited
Loading

Create the actual connections between sources/destinations for each benchmark dataset using full refresh. Use the octavia CLI to manage these connections in code. Say we have 3 benchmark datasets: small, medium, large. And two database sources: postgres and mysql. Two datawarehouses: snowflake and redshift.

We want these connections created

postgres - small - full refresh
postgres - medium - full refresh
postgres - large - full refresh
mysql - small - full refresh
mysql - medium - full refresh
mysql - large - full refresh

snowflake - small - overwrite
snowflake - medium - overwrite
snowflake - large - overwrite
redshift - small - overwrite
redshift - medium - overwrite
redshift - large - overwrite
@noahkawasaki-airbyte noahkawasaki-airbyte changed the title Databases and Data warehouses Benchmark: Create Full Refresh connections for sources and destinations Databases and Data warehouses Benchmark: Create Full Refresh Overwrite Connections Apr 26, 2022
Closed
@noahkawasaki-airbyte noahkawasaki-airbyte changed the title Databases and Data warehouses Benchmark: Create Full Refresh Overwrite Connections Databases and Data warehouses Benchmark: Create connections for Full Refresh Overwrite Apr 26, 2022
@grishick grishick added team/connectors-java and removed team/databases area/connectors Connector related issues labels Jun 30, 2022
@evantahler
Copy link
Contributor

Closing in favor of #15152

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/databases area/warehouses connectors/destinations-warehouse connectors/sources-database from/connector-ops type/enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@evantahler @grishick @noahkawasaki-airbyte