You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Apr 11, 2024. It is now read-only.
We can also have multiple file — good to have not a must-have feature
1. we can also have multiple files, if the table is having data in GBs.
2. what should be naming scheme: test.csv —> test_1.csv, test_2.csv
3. We can assume a default file_size_threshold, once reached we can split data into multiple file.
Describe the solution you'd like
Exporting a huge table into multiple smaller files allows users to effectively parallelise the transformation afterwards, using tools like Spark and Beam.
Please describe the feature you'd like to see
We can also have multiple file — good to have not a must-have feature
1. we can also have multiple files, if the table is having data in GBs.
2. what should be naming scheme: test.csv —> test_1.csv, test_2.csv
3. We can assume a default file_size_threshold, once reached we can split data into multiple file.
Describe the solution you'd like
Exporting a huge table into multiple smaller files allows users to effectively parallelise the transformation afterwards, using tools like Spark and Beam.
Additional context
More details at: notion doc
Acceptance Criteria
The text was updated successfully, but these errors were encountered: