Code

Simpler factory methods for Source#61

Code

Closed

prodriguezdefino wants to merge 142 commits intoGoogleCloudDataproc:mainGoogleCloudDataproc/flink-bigquery-connector:mainfrom prodriguezdefino:simplify-factory-methodsprodriguezdefino/flink-bigquery-connector:simplify-factory-methodsCopy head branch name to clipboard

+323-10

Commits

Commits on Jun 27, 2023

• cleaning up the main branch for new version.

  prodriguezdefino

  committed
  eb9dc8f

  Copy full SHA for eb9dc8f

• updates in ignore and readme files

  prodriguezdefino

  committed
  0695673

  Copy full SHA for 0695673

• prepping the pom addition, added parent's compliance tools

  prodriguezdefino

  committed
  e36cc44

  Copy full SHA for e36cc44

Commits on Jun 28, 2023

• adding parent pom and the connector impl project pom

  prodriguezdefino

  committed
  e167803

  Copy full SHA for e167803

• adding common functionalities

  prodriguezdefino

  committed
  8043378

  Copy full SHA for 8043378

• added the bigquery services wrapper and factories

  prodriguezdefino

  committed
  b455b4e

  Copy full SHA for b455b4e

• creates the split, its state and the enumerator state

  prodriguezdefino

  committed
  27cd837

  Copy full SHA for 27cd837

• added configs, split reader and split assignment impls

  prodriguezdefino

  committed
  4d4b60f

  Copy full SHA for 4d4b60f

• applying recommendations from sonartype-lift

  prodriguezdefino

  committed
  0567b58

  Copy full SHA for 0567b58

• adding the Datastream source implementation for BigQuery

  prodriguezdefino

  committed
  9006714

  Copy full SHA for 9006714

Commits on Jun 29, 2023

• added Table API implementation for BigQuery

  prodriguezdefino

  committed
  d5d95bf

  Copy full SHA for d5d95bf

• adding the example and shaded distro jar, fixes a NPE when the provided table is expired and no longer accessible.

  prodriguezdefino

  committed
  1263768

  Copy full SHA for 1263768

Commits on Jun 30, 2023

• added covertura analysis through open clover and improved few tests

  prodriguezdefino

  committed
  4e185bd

  Copy full SHA for 4e185bd

Commits on Jul 1, 2023

• fixes partition and row restriction orden for push downs

  prodriguezdefino

  committed
  4e63b02

  Copy full SHA for 4e63b02

Commits on Jul 2, 2023

• adds a test which make the storage read server stream iterator fail from time to time, the pipeline should be able to recover reading from the beginning of the split or the last checkpointed offset

  prodriguezdefino

  committed
  74d5b90

  Copy full SHA for 74d5b90

• renamed example's packages and pom's group id to the correct one

  prodriguezdefino

  committed
  aff1d6a

  Copy full SHA for aff1d6a

• resolve locally errors that occur in the split reader

  prodriguezdefino

  committed
  57d5a48

  Copy full SHA for 57d5a48

Commits on Jul 4, 2023

• added a read from query results example

  prodriguezdefino

  committed
  b16392f

  Copy full SHA for b16392f

Commits on Jul 6, 2023

• merge changes from master (previous pom deletion resolution)

  prodriguezdefino

  committed
  5743292

  Copy full SHA for 5743292

• fixing the package name for the schema namespace

  prodriguezdefino

  committed
  cab9115

  Copy full SHA for cab9115

Commits on Jul 10, 2023

• Merge branch 'common_code_source' into bq_services_wrappers

  prodriguezdefino

  committed
  3375d54

  Copy full SHA for 3375d54

Commits on Jul 11, 2023

• merged main branch and took care of few lift comments

  prodriguezdefino

  committed
  849f769

  Copy full SHA for 849f769

• Merge branch 'bq_services_wrappers' into source_splits

  prodriguezdefino

  committed
  fd70b95

  Copy full SHA for fd70b95

• merge from source_split

  prodriguezdefino

  committed
  0f18d14

  Copy full SHA for 0f18d14

• fixing lift recommendations and spotless

  prodriguezdefino

  committed
  6b08119

  Copy full SHA for 6b08119

• Merge branch 'split_assigner_and_reader' into source_functionality

  prodriguezdefino

  committed
  5973d26

  Copy full SHA for 5973d26

• Merge branch 'source_functionality' into table_api

  prodriguezdefino

  committed
  2d9635d

  Copy full SHA for 2d9635d

• Merge branch 'table_api' into add_example_and_shadedsqljar

  prodriguezdefino

  committed
  135beeb

  Copy full SHA for 135beeb

• merge from example and distro branch

  prodriguezdefino

  committed
  78aec3e

  Copy full SHA for 78aec3e

• fixes namespace error in test and spotless

  prodriguezdefino

  committed
  3ffb582

  Copy full SHA for 3ffb582

• Merge branch 'table_api' into add_example_and_shadedsqljar

  prodriguezdefino

  committed
  cc45b2f

  Copy full SHA for cc45b2f

• Merge branch 'add_example_and_shadedsqljar' into use_openclover_coverage

  prodriguezdefino

  committed
  3472934

  Copy full SHA for 3472934

• removed repeated mvn reference from command

  prodriguezdefino

  committed
  1dabd70

  Copy full SHA for 1dabd70

• Merge branch 'use_openclover_coverage' into partition_restriction_fixes

  prodriguezdefino

  committed
  27fa94a

  Copy full SHA for 27fa94a

• adds documentation to enum

  prodriguezdefino

  committed
  1d0dafa

  Copy full SHA for 1d0dafa

• Merge branch 'partition_restriction_fixes' into test_bqstoragereadapi_error

  prodriguezdefino

  committed
  289c31c

  Copy full SHA for 289c31c

• merge from test_bqstoragereadapi_error branch

  prodriguezdefino

  committed
  882816e

  Copy full SHA for 882816e

• Merge branch 'fix_artifact_groupid_name' into locally_retry_splitreadererror

  prodriguezdefino

  committed
  161f577

  Copy full SHA for 161f577

• fixes presubmit problem

  prodriguezdefino

  committed
  d55d12f

  Copy full SHA for d55d12f

• Merge branch 'locally_retry_splitreadererror' into query_example

  prodriguezdefino

  committed
  3ce56f0

  Copy full SHA for 3ce56f0

Commits on Jul 26, 2023

• initial work

  prodriguezdefino

  committed
  b3426f5

  Copy full SHA for b3426f5

Commits on Jul 27, 2023

• addressing comments from review

  prodriguezdefino

  committed
  f473d57

  Copy full SHA for f473d57

Commits on Aug 1, 2023

• continuing with refactor

  prodriguezdefino

  committed
  c9e22b3

  Copy full SHA for c9e22b3

• merge from main

  prodriguezdefino

  committed
  c178f83

  Copy full SHA for c178f83

• merge from master

  prodriguezdefino

  committed
  09eaaa4

  Copy full SHA for 09eaaa4

• Merge branch 'source_splits' into split_assigner_and_reader

  prodriguezdefino

  committed
  def3cc4

  Copy full SHA for def3cc4

• fixed type reference Int -> Long

  prodriguezdefino

  committed
  ceabb12

  Copy full SHA for ceabb12

Commits on Aug 2, 2023

• progress

  prodriguezdefino

  committed
  d48734f

  Copy full SHA for d48734f

Commits on Aug 3, 2023

• improved coverage

  prodriguezdefino

  committed
  4366aee

  Copy full SHA for 4366aee

• Merge branch 'split_assigner_and_reader' into source_functionality

  prodriguezdefino

  committed
  0dc8875

  Copy full SHA for 0dc8875

• Merge branch 'source_functionality' into table_api

  prodriguezdefino

  committed
  963c80b

  Copy full SHA for 963c80b

• Merge branch 'table_api' into add_example_and_shadedsqljar

  prodriguezdefino

  committed
  5206ef1

  Copy full SHA for 5206ef1

• Merge branch 'add_example_and_shadedsqljar' into use_openclover_coverage

  prodriguezdefino

  committed
  2b59a7c

  Copy full SHA for 2b59a7c

• Merge branch 'use_openclover_coverage' into partition_restriction_fixes

  prodriguezdefino

  committed
  4eb1137

  Copy full SHA for 4eb1137

• Merge branch 'partition_restriction_fixes' into test_bqstoragereadapi_error

  prodriguezdefino

  committed
  6db9dea

  Copy full SHA for 6db9dea

• Merge branch 'test_bqstoragereadapi_error' into fix_artifact_groupid_name

  prodriguezdefino

  committed
  237f798

  Copy full SHA for 237f798

• Merge branch 'fix_artifact_groupid_name' into locally_retry_splitreadererror

  prodriguezdefino

  committed
  8f12843

  Copy full SHA for 8f12843

• fixed reference Int -> Long

  prodriguezdefino

  committed
  6348b21

  Copy full SHA for 6348b21

• Merge branch 'fix_artifact_groupid_name' into query_example

  prodriguezdefino

  committed
  9913587

  Copy full SHA for 9913587

• Merge branch 'locally_retry_splitreadererror' into query_example

  prodriguezdefino

  committed
  5919fd8

  Copy full SHA for 5919fd8

• merged from previous branches

  prodriguezdefino

  committed
  1ad1eb1

  Copy full SHA for 1ad1eb1

• fix cloudbuild script merge

  prodriguezdefino

  committed
  ea506a1

  Copy full SHA for ea506a1

• Merge branch 'fix_artifact_groupid_name' into locally_retry_splitreadererror

  prodriguezdefino

  committed
  80cf344

  Copy full SHA for 80cf344

• Merge branch 'fix_artifact_groupid_name' into query_example

  prodriguezdefino

  committed
  1a80c5e

  Copy full SHA for 1a80c5e

• Merge branch 'fix_artifact_groupid_name' into partition_refactor

  prodriguezdefino

  committed
  9a97444

  Copy full SHA for 9a97444

• fix directory reference name for codecov

  prodriguezdefino

  committed
  12264bf

  Copy full SHA for 12264bf

Commits on Aug 4, 2023

• Merge branch 'fix_artifact_groupid_name' into locally_retry_splitreadererror

  prodriguezdefino

  committed
  67955dc

  Copy full SHA for 67955dc

• Merge branch 'fix_artifact_groupid_name' into query_example

  prodriguezdefino

  committed
  9eb78a0

  Copy full SHA for 9eb78a0

• Merge branch 'fix_artifact_groupid_name' into partition_refactor

  prodriguezdefino

  committed
  f1ee89e

  Copy full SHA for f1ee89e

• craated abstract split assigner and bounded version

  prodriguezdefino

  committed
  6ea14df

  Copy full SHA for 6ea14df

• progress

  prodriguezdefino

  committed
  ef743c9

  Copy full SHA for ef743c9

Commits on Aug 7, 2023

• first implementation of unbounded source for completed partitions

  prodriguezdefino

  committed
  bbe805b

  Copy full SHA for bbe805b

• only sync those collections that are actively added and removed from diff threads

  prodriguezdefino

  committed
  c2042fd

  Copy full SHA for c2042fd

Commits on Aug 8, 2023

• introduced notification of new splits to enumerator

  prodriguezdefino

  committed
  b52afaa

  Copy full SHA for b52afaa

• added observer capabilities to enumerator for new splits when on unbounded mode

  prodriguezdefino

  committed
  5beafab

  Copy full SHA for 5beafab

• spotless apply

  prodriguezdefino

  committed
  7fd6539

  Copy full SHA for 7fd6539

• added logs

  prodriguezdefino

  committed
  13b6cab

  Copy full SHA for 13b6cab

• merge from main

  prodriguezdefino

  committed
  1734bac

  Copy full SHA for 1734bac

• addressing comments from review

  prodriguezdefino

  committed
  e96ff59

  Copy full SHA for e96ff59

• Merge branch 'split_assigner_and_reader' into source_functionality

  prodriguezdefino

  committed
  3b78492

  Copy full SHA for 3b78492

• improved hashcode and equals readability

  prodriguezdefino

  committed
  c492f02

  Copy full SHA for c492f02

• Merge branch 'split_assigner_and_reader' into source_functionality

  prodriguezdefino

  committed
  6a05498

  Copy full SHA for 6a05498

• Merge branch 'source_functionality' into table_api

  prodriguezdefino

  committed
  820fb3b

  Copy full SHA for 820fb3b

• improve readibility for hashcode and equals

  prodriguezdefino

  committed
  dd5be94

  Copy full SHA for dd5be94

• Merge branch 'table_api' into add_example_and_shadedsqljar

  prodriguezdefino

  committed
  fbd07c6

  Copy full SHA for fbd07c6

• Merge branch 'add_example_and_shadedsqljar' into use_openclover_coverage

  prodriguezdefino

  committed
  a44b11d

  Copy full SHA for a44b11d

• Merge branch 'use_openclover_coverage' into partition_restriction_fixes

  prodriguezdefino

  committed
  156552f

  Copy full SHA for 156552f

• Merge branch 'partition_restriction_fixes' into test_bqstoragereadapi_error

  prodriguezdefino

  committed
  31559d5

  Copy full SHA for 31559d5

• Merge branch 'test_bqstoragereadapi_error' into fix_artifact_groupid_name

  prodriguezdefino

  committed
  53c514e

  Copy full SHA for 53c514e

• Merge branch 'fix_artifact_groupid_name' into locally_retry_splitreadererror

  prodriguezdefino

  committed
  656c831

  Copy full SHA for 656c831

• Merge branch 'locally_retry_splitreadererror' into query_example

  prodriguezdefino

  committed
  bc626cd

  Copy full SHA for bc626cd

• Merge branch 'query_example' into partition_refactor

  prodriguezdefino

  committed
  0ee8345

  Copy full SHA for 0ee8345

Commits on Aug 9, 2023

• merge from prevoius branch

  prodriguezdefino

  committed
  327dfd6

  Copy full SHA for 327dfd6

• partial work

  prodriguezdefino

  committed
  d3c71c7

  Copy full SHA for d3c71c7

• changed tests to use google-truth instead of junit or assertj assertion types

  prodriguezdefino

  committed
  9aae0af

  Copy full SHA for 9aae0af

• Merge branch 'split_assigner_and_reader' into source_functionality

  prodriguezdefino

  committed
  61e5644

  Copy full SHA for 61e5644

• added google-truth to tests

  prodriguezdefino

  committed
  517de82

  Copy full SHA for 517de82

• Merge branch 'source_functionality' into table_api

  prodriguezdefino

  committed
  d916a1c

  Copy full SHA for d916a1c

• added google-truth to tests

  prodriguezdefino

  committed
  11fce0d

  Copy full SHA for 11fce0d

Commits on Aug 10, 2023

• simplified partition discovery, improved logging

  prodriguezdefino

  committed
  62397e0

  Copy full SHA for 62397e0

• Merge branch 'table_api' into add_example_and_shadedsqljar

  prodriguezdefino

  committed
  099078e

  Copy full SHA for 099078e

• merge from previous branch

  prodriguezdefino

  committed
  40db3cb

  Copy full SHA for 40db3cb

• merge from previous branch

  prodriguezdefino

  committed
  8dbf958

  Copy full SHA for 8dbf958

• merge from previous branch

  prodriguezdefino

  committed
  d1c56d4

  Copy full SHA for d1c56d4

• Merge branch 'test_bqstoragereadapi_error' into fix_artifact_groupid_name

  prodriguezdefino

  committed
  12553a4

  Copy full SHA for 12553a4

• Merge branch 'fix_artifact_groupid_name' into locally_retry_splitreadererror

  prodriguezdefino

  committed
  bba0167

  Copy full SHA for bba0167

• Merge branch 'locally_retry_splitreadererror' into query_example

  prodriguezdefino

  committed
  c860c28

  Copy full SHA for c860c28

• Merge branch 'query_example' into partition_refactor

  prodriguezdefino

  committed
  62aafbc

  Copy full SHA for 62aafbc

• Merge branch 'partition_refactor' into unboundedsource_completepartitions

  prodriguezdefino

  committed
  3261811

  Copy full SHA for 3261811

Commits on Aug 11, 2023

• package refactor for assigners and added tests for them

  prodriguezdefino

  committed
  7d0f54b

  Copy full SHA for 7d0f54b

• tested concurrent collections for split assigner state

  prodriguezdefino

  committed
  062099f

  Copy full SHA for 062099f

Commits on Aug 19, 2023

• added window definition for streaming example

  prodriguezdefino

  committed
  9a9c9df

  Copy full SHA for 9a9c9df

Commits on Aug 21, 2023

• added an hybrid source example

  prodriguezdefino

  committed
  06b038e

  Copy full SHA for 06b038e

Commits on Aug 23, 2023

• unify non query examples

  prodriguezdefino

  committed
  cd4e71e

  Copy full SHA for cd4e71e

Commits on Oct 31, 2023

• merge from master after GoogleCloudDataproc#44

  prodriguezdefino

  committed
  9da7706

  Copy full SHA for 9da7706

• Merge branch 'source_functionality' into table_api

  prodriguezdefino

  committed
  a10470c

  Copy full SHA for a10470c

Commits on Nov 1, 2023

• removing guava dependency from file

  prodriguezdefino

  committed
  6b28a0c

  Copy full SHA for 6b28a0c

• merge from master

  prodriguezdefino

  committed
  7160ff9

  Copy full SHA for 7160ff9

Commits on Nov 2, 2023

• adding serializable autovalue annotation to avoid storing an Optional field since the dynamic table source and the source impl needs to store the read options as property and it becomes not seriali…

  Show description for 87780c5
  prodriguezdefino

  committed
  87780c5

  Copy full SHA for 87780c5

• addressing comments from review

  prodriguezdefino

  committed
  3f4d1be

  Copy full SHA for 3f4d1be

• addressed comments from review

  prodriguezdefino

  committed
  c8eb789

  Copy full SHA for c8eb789

• Merge branch 'table_api' into add_example_and_shadedsqljar

  prodriguezdefino

  committed
  fd79610

  Copy full SHA for fd79610

• merge from GoogleCloudDataproc#47

  prodriguezdefino

  committed
  8008260

  Copy full SHA for 8008260

• merge from GoogleCloudDataproc#48

  prodriguezdefino

  committed
  c923f31

  Copy full SHA for c923f31

Commits on Nov 3, 2023

• Merge branch 'partition_restriction_fixes' into test_bqstoragereadapi_error

  prodriguezdefino

  committed
  d135144

  Copy full SHA for d135144

• Merge branch 'test_bqstoragereadapi_error' into fix_artifact_groupid_name

  prodriguezdefino

  committed
  ad2e4e5

  Copy full SHA for ad2e4e5

• merge from previous branch

  prodriguezdefino

  committed
  ebe9014

  Copy full SHA for ebe9014

• partition list in 1024 chunks

  prodriguezdefino

  committed
  cce6567

  Copy full SHA for cce6567

• Merge branch 'table_api' into add_example_and_shadedsqljar

  prodriguezdefino

  committed
  f36f91f

  Copy full SHA for f36f91f

• Merge branch 'add_example_and_shadedsqljar' into use_openclover_coverage

  prodriguezdefino

  committed
  59472b7

  Copy full SHA for 59472b7

• Merge branch 'use_openclover_coverage' into partition_restriction_fixes

  prodriguezdefino

  committed
  3d994a2

  Copy full SHA for 3d994a2

• Merge branch 'partition_restriction_fixes' into test_bqstoragereadapi_error

  prodriguezdefino

  committed
  d9027ab

  Copy full SHA for d9027ab

• Merge branch 'test_bqstoragereadapi_error' into fix_artifact_groupid_name

  prodriguezdefino

  committed
  62c87f0

  Copy full SHA for 62c87f0

• Merge branch 'fix_artifact_groupid_name' into locally_retry_splitreadererror

  prodriguezdefino

  committed
  87fd326

  Copy full SHA for 87fd326

• Merge branch 'locally_retry_splitreadererror' into query_example

  prodriguezdefino

  committed
  0ba5ce1

  Copy full SHA for 0ba5ce1

• merge from previous branch

  prodriguezdefino

  committed
  44d21b1

  Copy full SHA for 44d21b1

• merge from previous branch

  prodriguezdefino

  committed
  421fdfb

  Copy full SHA for 421fdfb

• removed guava dependencies

  prodriguezdefino

  committed
  9c16ade

  Copy full SHA for 9c16ade

Commits on Nov 6, 2023

• removed references to isBlank() string method

  prodriguezdefino

  committed
  b421760

  Copy full SHA for b421760

• Merge branch 'unboundedsource_completepartitions' into remove_guava_direct_references

  prodriguezdefino

  committed
  0408929

  Copy full SHA for 0408929

Commits on Nov 7, 2023

• simpler factory methods for source

  prodriguezdefino

  committed
  8482023

  Copy full SHA for 8482023

Commits on Dec 11, 2023

• merge from main

  prodriguezdefino

  committed
  0621c33

  Copy full SHA for 0621c33