Adds helper methods for record insertion to BQ table.#69

Closed

prashastia wants to merge 44 commits intoGoogleCloudDataproc:mainfrom prashastia:nightly-tests-unbounded-read-1

+1,643-1

Commits on Dec 18, 2023

Adds a new module for nightly tests.
prashastia
committed

Commits on Dec 19, 2023

Commits on Dec 20, 2023

Adds spotless:apply.
prashastia
committed

Commits on Dec 21, 2023

Commits on Dec 22, 2023

insert_dynamic_partitions.py A python script to insert partitions incrementally into the partitioned table. Used by the e2e unbounded source testing script.
prashastia
committed
Adds shell script that creates the asynchronously running unbounded job, Dynamically adds partitions and then kills the dataproc job.
prashastia
committed
Adds a new step in hte nightly job - the unbounded table read. Also adds the call to unbounded_table_read.sh via the common table_read.sh
prashastia
committed
Modifies yaml file to add unbounded table read step to be run during the e2e tests.
prashastia
committed
Attempts to fix the execution of unbounded table read.
prashastia
committed
Attempts to fix the execution of unbounded table read.
prashastia
committed
Attempts to fix the execution of unbounded table read.
prashastia
committed

Commits on Dec 23, 2023