Google services including:
- Google Ads
- Google Cloud (GCP)
- Google Firebase
- Google LevelDB
- Google Marketing Platform
- Google Workspace (formerly Google Suite)
This is detailed commit list of changes for versions provider package: google.
For high-level changelog, see :doc:`package information including changelog <index>`.
Latest change: 2023-12-28
| Commit | Committed | Subject |
|---|---|---|
| 49ce3ed006 | 2023-12-28 | Remove backcompat code for stackdriver (#36442) |
| cba3ca7067 | 2023-12-28 | Remove remaining Airflow 2.5 backcompat code from GCS Task Handler (#36443) (#36457) |
| 127c0725b9 | 2023-12-27 | Revert "Remove remaining Airflow 2.5 backcompat code from GCS Task Handler (#36443)" (#36453) |
| 9e55f51a9f | 2023-12-27 | Remove unused '_parse_version' function (#36450) |
| 75faf1115d | 2023-12-27 | Remove remaining Airflow 2.5 backcompat code from GCS Task Handler (#36443) |
| 794ce730aa | 2023-12-26 | Revert "Remove remaining Airflow 2.5 backcompat code from Google Provider (#36366)" (#36440) |
Latest change: 2023-12-23
| Commit | Committed | Subject |
|---|---|---|
| b15d5578da | 2023-12-23 | Re-apply updated version numbers to 2nd wave of providers in December (#36380) |
| f5883d6e7b | 2023-12-23 | Prepare 2nd wave of providers in December (#36373) |
| 2c2763f806 | 2023-12-22 | Remove remaining Airflow 2.5 backcompat code from Google Provider (#36366) |
| 10c4c352f9 | 2023-12-20 | Minor fix to DataprocCreateClusterOperator operator docs. (#36322) |
| 881d88b4da | 2023-12-19 | Implement deferrable mode for BeamRunJavaPipelineOperator (#36122) |
| 5ab43d5541 | 2023-12-19 | Move KubernetesPodTrigger hook to a cached property (#36290) |
| d793fda391 | 2023-12-18 | Add ability to run streaming Job for BeamRunPythonPipelineOperator in non deferrable mode (#36108) |
| 92335417d8 | 2023-12-17 | Add use_glob to GCSObjectExistenceSensor (#34137) |
| e9ba37bb58 | 2023-12-17 | Add code snippet formatting in docstrings via Ruff (#36262) |
| ffb003a58e | 2023-12-17 | fix(bigquery.py): pass correct project_id to triggerer (#35200) |
| e83a98603e | 2023-12-14 | iterate through blobs before checking prefixes (#36202) |
| 4c73d613b1 | 2023-12-13 | Fix incompatibility with google-cloud-monitoring 2.18.0 (#36200) |
| 8fbacb8a5f | 2023-12-13 | Update 'retry' param typing in PubSubAsyncHook (#36198) |
| 64931b1a65 | 2023-12-12 | Prepare docs 1st wave of Providers December 2023 RC2 (#36190) |
| 47a9c8a4a4 | 2023-12-12 | Added Datascan Profiling (#35696) |
| 3dddfb4a4a | 2023-12-11 | Add overrides to template fields of Google Cloud Run Jobs Execute Operator (#36133) |
| fcd993b852 | 2023-12-11 | Upgrade to latest pre-commit plugins (#36163) |
| 343bac956b | 2023-12-11 | Review and mark found potential SSH security issues by bandit (#36162) |
| cd476acd8f | 2023-12-11 | Follow BaseHook connection fields method signature in child classes (#36086) |
| 8d0c5d9008 | 2023-12-09 | Change retry type for Google Dataflow Client to async one (#36141) |
| aba58adb83 | 2023-12-08 | Allow storage options to be passed (#35820) |
| 999b70178a | 2023-12-08 | Prepare docs 1st wave of Providers December 2023 (#36112) |
| d0918d77ee | 2023-12-07 | Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017) |
| ca20f07a16 | 2023-12-06 | GCP Secrets Backend Impersonation (#36072) |
| d0f4512ecb | 2023-12-04 | Fix DataprocSubmitJobOperator to retrieve failed job error message (#36053) |
| 86b1bd22d1 | 2023-12-01 | Fix CloudRunExecuteJobOperator not able to retrieve the Cloud Run job status in deferrable mode (#36012) |
| cf052dc64f | 2023-12-01 | Add feature to build "chicken-egg" packages from sources (#35890) |
| 5d74ffb320 | 2023-11-27 | Fix gcs listing - ensure blobs are loaded (#34919) |
| 99b68e2db2 | 2023-11-27 | Add OpenLineage support to GcsOperators - Delete, Transform and TimeSpanTransform (#35838) |
| 373d8a57b2 | 2023-11-25 | Deprecate 'CloudComposerEnvironmentSensor' in favor of 'CloudComposerCreateEnvironmentOperator' with defer mode (#35775) |
| e2a5dbf8b4 | 2023-11-25 | allow multiple elements in impersonation chain (#35694) |
| 770f16425c | 2023-11-25 | Add support for service account impersonation with computeEngineSSHHook (google provider) and IAP tunnel (#35136) |
Latest change: 2023-11-24
| Commit | Committed | Subject |
|---|---|---|
| 0b23d5601c | 2023-11-24 | Prepare docs 2nd wave of Providers November 2023 (#35836) |
| 72ba63e0b9 | 2023-11-22 | added Topic params for schema_settings and message_retention_duration. (#35767) |
| 2a06e278d2 | 2023-11-21 | Check attr on parent not self re TaskContextLogger set_context (#35780) |
| 1fae1a50e9 | 2023-11-21 | Add OpenLineage support to GCSToBigQueryOperator (#35778) |
| 9207e7d5e5 | 2023-11-20 | Remove usage of deprecated method from BigQueryToBigQueryOperator (#35605) |
| d8075cd04c | 2023-11-20 | Remove backcompat with Airflow 2.3/2.4 in providers (#35727) |
| 99534e47f3 | 2023-11-19 | Use reproducible builds for provider packages (#35693) |
| f30d5b8ec1 | 2023-11-19 | Restore delegate_to param in GoogleDiscoveryApiHook (#35728) |
| ed6fe240c3 | 2023-11-18 | Align documentation of 'MSSQLToGCSOperator' (#35715) |
| ce16963e9d | 2023-11-17 | Add OpenLineage support to BigQueryToGCSOperator (#35660) |
| b9f3a5392f | 2023-11-17 | Extend task context logging support for remote logging using GCP GCS (#32970) |
| 0c6fd5be86 | 2023-11-17 | Remove usage of deprecated methods from BigQueryCursor (#35606) |
| 99df205f42 | 2023-11-16 | Fix and reapply templates for provider documentation (#35686) |
| 08d15d06ba | 2023-11-16 | Add support for driver pool, instance flexibility policy, and min_num_instances for Dataproc (#34172) |
| a9ce7135ff | 2023-11-16 | Add "NON_PREEMPTIBLE" as a valid preemptibility type for Dataproc workers (#35669) |
| 054904bb9a | 2023-11-15 | Add ability to pass impersonation_chain to BigQuery triggers (#35629) |
| 9d5f726c8a | 2023-11-15 | Add a filter for local files in GoogleDisplayVideo360CreateQueryOperator (#35635) |
| 8fd5ac6530 | 2023-11-10 | Fix the logic of checking dataflow job state (#34785) |
Latest change: 2023-11-08
| Commit | Committed | Subject |
|---|---|---|
| 1b059c57d6 | 2023-11-08 | Prepare docs 1st wave of Providers November 2023 (#35537) |
| 64d1085cb9 | 2023-11-03 | Update Google Ads API version from v14 to v15 (#35295) |
| 63cc915cd3 | 2023-10-31 | Switch from Black to Ruff formatter (#35287) |
Latest change: 2023-10-28
| Commit | Committed | Subject |
|---|---|---|
| d1c58d86de | 2023-10-28 | Prepare docs 3rd wave of Providers October 2023 - FIX (#35233) |
| 3592ff4046 | 2023-10-28 | Prepare docs 3rd wave of Providers October 2023 (#35187) |
| 04e2fbd92b | 2023-10-27 | AIP-58: Add Airflow ObjectStore (AFS) (#34729) |
| acff4c79dc | 2023-10-26 | Make Dataprep system test self-sufficient (#34880) |
| 0bb56315e6 | 2023-10-25 | Added 'overrides' parameter to CloudRunExecuteJobOperator (#34874) |
| dd7ba3cae1 | 2023-10-19 | Pre-upgrade 'ruff==0.0.292' changes in providers (#35053) |
| 63f3712d2e | 2023-10-18 | Update gcs.py Create and List comment Examples (#35028) |
| b75f9e8806 | 2023-10-18 | Upgrade pre-commits (#35033) |
Latest change: 2023-10-18
| Commit | Committed | Subject |
|---|---|---|
| 39e611b43b | 2023-10-18 | Prepare docs 2nd wave of Providers in October 2023 (#35020) |
| f16906d13b | 2023-10-18 | Create operators for VertexAI Pipeline Job (#34915) |
| 86e27c7cd7 | 2023-10-18 | Fix cloud run operation timeout error (#34755) |
| e444bca140 | 2023-10-18 | Add links between documentation related to Google Cloud Storage (#34994) |
| 92204b36b0 | 2023-10-18 | Migrate legacy version of AI Platform Prediction to VertexAI (#34922) |
| 0b49f338b9 | 2023-10-16 | Cancel workflow in on_kill in DataprocInstantiate{Inline}WorkflowTemplateOperator (#34957) |
Latest change: 2023-10-13
| Commit | Committed | Subject |
|---|---|---|
| e9987d5059 | 2023-10-13 | Prepare docs 1st wave of Providers in October 2023 (#34916) |
| d27d0bb60b | 2023-10-13 | Refactor DataFusionInstanceLink usage (#34514) |
| 4dc2c40dfe | 2023-10-12 | Fix GCSToGoogleDriveOperator and gdrive system tests (#34545) |
| 0c8e30e43b | 2023-10-05 | Bump min airflow version of providers (#34728) |
| 99f320354b | 2023-10-04 | Refactor: consolidate import time in providers (#34402) |
| 7c440ca184 | 2023-10-03 | Fix typo in DataplexGetDataQualityScanResultOperator (#34681) |
| 562b98a622 | 2023-10-02 | Fix LookerHook serialize missing 1 argument error (#34678) |
| 7ebf4220c9 | 2023-09-28 | Refactor usage of str() in providers (#34320) |
| 07fe1d2a69 | 2023-09-27 | Refactor dedent nested loops (#34409) |
| 2b082f1e5a | 2023-09-27 | Use 'airflow.models.dag.DAG' in Google Provider examples (#34614) |
| 8bea45f37f | 2023-09-26 | Refactor multiple equals to contains in providers (#34441) |
| 20b7cfc395 | 2023-09-26 | respect soft_fail argument when exception is raised for google sensors (#34501) |
| 6a03870d1c | 2023-09-24 | improvement: introduce proejct_id in BigQueryIntervalCheckOperator (#34573) |
| f56acdad16 | 2023-09-22 | Deprecate Life Sciences Operator and Hook (#34549) |
| 659d94f0ae | 2023-09-21 | Use 'airflow.exceptions.AirflowException' in providers (#34511) |
| d20c32f6b7 | 2023-09-20 | Refactor: reduce some conditions in providers (#34440) |
| a6fcd69fe5 | 2023-09-15 | Fix Dataform system tests (#34329) |
| 8ecd576de1 | 2023-09-14 | Refactor shorter defaults in providers (#34347) |
| 013c95bfe6 | 2023-09-14 | Update Vertex AI system tests (#34364) |
Latest change: 2023-09-14
| Commit | Committed | Subject |
|---|---|---|
| 7574e16e75 | 2023-09-14 | Prepare docs for Sep 2023 2nd wave of Providers (#34360) |
| b042042086 | 2023-09-14 | Remove unnecessary call to keys() method on dictionaries (#34260) |
| 05036e619c | 2023-09-13 | Refactor: Think positively in providers (#34279) |
| 3fa9d46ec7 | 2023-09-12 | Refactor: Simplify code in providers/google (#33229) |
| 4dcdc34996 | 2023-09-11 | Add explicit support of stream (realtime) pipelines for CloudDataFusionStartPipelineOperator (#34271) |
| 94d07908a2 | 2023-09-11 | Refactor: Simplify comparisons (#34181) |
| 0110b22a60 | 2023-09-11 | Fix 'ComputeEngineInsertInstanceOperator' doesn't respect jinja-templated instance name when given in body argument (#34171) |
| 050a47add8 | 2023-09-11 | Add 'expected_terminal_state' parameter to Dataflow operators (#34217) |
| 25d463c3e3 | 2023-09-11 | Deprecate AutoMLTrainModelOperator for NL (#34212) |
| db38a6fc66 | 2023-09-11 | GKEPodHook ignores gcp_conn_id parameter. (#34194) |
| 38ecd4c4da | 2023-09-10 | Bump min common-sql provider version for Google provider (#34257) |
| c5ec7cd294 | 2023-09-10 | Simplify to bool(...) (#34258) |
| bf9769bebf | 2023-09-09 | Make Google Dataform operators templated_fields more consistent (#34187) |
| 774125ae25 | 2023-09-09 | fix: BigQuery job error message (#34208) |
Latest change: 2023-09-08
| Commit | Committed | Subject |
|---|---|---|
| 21990ed894 | 2023-09-08 | Prepare docs for 09 2023 - 1st wave of Providers (#34201) |
| ff23a30e5b | 2023-09-07 | fix(providers/google-marketing-platform): respect soft_fail argument when exception is raised (#34165) |
| 9c66132af6 | 2023-09-07 | fix: docstring in endpoint_service.py (#34135) |
| 9079093291 | 2023-09-07 | Consolidate importing of os.path.* (#34060) |
| a7310f9c91 | 2023-09-05 | Refactor regex in providers (#33898) |
| c88e746494 | 2023-09-04 | Dynamic setting up of artifact versinos for Datafusion pipelines (#34068) |
| ba59f3475c | 2023-09-04 | Add deferrable mode to Dataplex DataQuality. (#33954) |
| 4f20b0f442 | 2023-09-03 | Move the try outside the loop when this is possible in Google provider (#33976) |
| d757f6a3af | 2023-09-03 | Fix BigQueryValueCheckOperator deferrable mode optimisation (#34018) |
| fa5e54c4c5 | 2023-09-03 | Combine similar if logics in providers (#33987) |
| 47bd5dd0e1 | 2023-09-03 | Remove useless string join from providers (#33968) |
| b7f84e913b | 2023-09-02 | Update Azure fileshare hook to use azure-storage-file-share instead of azure-storage-file (#33904) |
| 875387afa5 | 2023-09-01 | Refactor unneeded jumps in providers (#33833) |
| 04e9b0bd78 | 2023-09-01 | fix google CHANGELOG.rst (#34007) |
| ff7dcf4e82 | 2023-09-01 | replace loop by any when looking for a positive value in providers (#33984) |
| a9bbb430fc | 2023-09-01 | Replace try - except pass by contextlib.suppress in providers (#33980) |
| 5d60c742a7 | 2023-09-01 | Fix Google 10.7.0 changelog (#33953) |
| 0a5e2281e0 | 2023-08-31 | Remove some useless try/except from providers code (#33967) |
| 55976af32e | 2023-08-31 | Replace sequence concatination by unpacking in Airflow providers (#33933) |
| 3b86842120 | 2023-08-31 | Remove a deprecated option from 'BigQueryHook.get_pandas_df' (#33819) |
| a35c0d42cc | 2023-08-30 | replace unnecessary dict comprehension by dict() in providers (#33857) |
| eaf34718a4 | 2023-08-30 | Fix Cloud Worflows system test (#33386) |
| d361761dee | 2023-08-30 | Early delete a Dataproc cluster if started in the ERROR state. (#33668) |
| 075afe5a2a | 2023-08-30 | allow impersonation_chain to be set on Google Cloud connection (#33715) |
| 3b3650e87d | 2023-08-29 | fix entry in Google provider CHANGELOG.rst (#33890) |
| 2663b177a6 | 2023-08-28 | Generate Python API docs for Google ADS (#33814) |
| 6802d4136f | 2023-08-27 | Improve modules import in google provider by move some of them into a type-checking block (#33783) |
| 6d182beec6 | 2023-08-26 | Use a single statement with multiple contexts instead of nested statements in providers (#33768) |
| b11525702c | 2023-08-26 | Use literal dict instead of calling dict() in providers (#33761) |
| 353b1482d3 | 2023-08-26 | remove unnecessary and rewrite it using list in providers (#33763) |
| 784e0ef04b | 2023-08-26 | Refactor: Simplify a few loops (#33736) |
| 3d01919a30 | 2023-08-26 | Avoid blocking event loop when using DataFusionAsyncHook by replacing sleep by asyncio.sleep (#33756) |
| 2a00f18ebb | 2023-08-26 | E731: replace lambda by a def method in Airflow providers (#33757) |
| c90eec9365 | 2023-08-26 | Use f-string instead of in Airflow providers (#33752) |
Latest change: 2023-08-26
| Commit | Committed | Subject |
|---|---|---|
| c077d19060 | 2023-08-26 | Prepare docs for Aug 2023 3rd wave of Providers (#33730) |
| 94c8291629 | 2023-08-25 | Refactor: Use f-strings (#33734) |
| ba0bab0114 | 2023-08-25 | Refactor: Use random.choices (#33631) |
| 66d0222947 | 2023-08-25 | Add CloudRunHook and operators (#33067) |
| 96efcfb830 | 2023-08-24 | Further improvements for provider verification (#33670) |
| 85acbb4ae9 | 2023-08-24 | Refactor: Remove useless str() calls (#33629) |
| 1953648fda | 2023-08-24 | Refactor: lists and paths in dev (#33626) |
| 4154cc04ce | 2023-08-24 | Do not create lists we don't need (#33519) |
| 94f70d8184 | 2023-08-23 | Replace strftime with f-strings where nicer (#33455) |
| 92474db6a5 | 2023-08-23 | Refactor: Better percentage formatting (#33595) |
| a54c2424df | 2023-08-23 | Fix typos (double words and it's/its) (#33623) |
| 08fa814533 | 2023-08-21 | Add missing template fields to DataformCreateCompilationResultOperator (#33585) |
| c8de9a5f68 | 2023-08-21 | Adding Support for Google Cloud's Data Pipelines Run Operator (#32846) |
| 46fa5a2743 | 2023-08-21 | Fix BigQueryCreateExternalTableOperator when using a foramt different to CSV (#33540) |
| 3157002eeb | 2023-08-19 | Fix DataplexDataQualityJobStatusSensor and add unit tests (#33440) |
| 533afb5128 | 2023-08-19 | Add parameter sftp_prefetch to SFTPToGCSOperator (#33274) |
| c6a014a370 | 2023-08-18 | Add 'CloudBatchHook' and operators (#32606) |
| ea8519c055 | 2023-08-18 | Avoid importing pandas and numpy in runtime and module level (#33483) |
| 8e88eb8fa7 | 2023-08-17 | Consolidate import and usage of pandas (#33480) |
| bfe08a79db | 2023-08-16 | Import utc from datetime and normalize its import (#33450) |
| 843a3b8c3e | 2023-08-16 | Fix system test example_cloud_storage_transfer_service_aws (#33429) |
| a1e42f6626 | 2023-08-14 | Enable D205 Support (#33398) |
| b4102ce0b5 | 2023-08-14 | Update Error details for Generic Error Code (#32847) |
| a2a0d05345 | 2023-08-14 | Add Source Code and Testing for Google Cloud's Data Pipelines Create Operator (#32843) |
| dfb2403ec4 | 2023-08-14 | Add Dataplex Data Quality operators. (#32256) |
| 7e79997594 | 2023-08-11 | D205 Support - Providers - Final Pass (#33303) |
Latest change: 2023-08-09
| Commit | Committed | Subject |
|---|---|---|
| f82acc1579 | 2023-08-09 | Prepare docs for RC3 providers (google) (#33253) |
| e1af008711 | 2023-08-09 | make 'sql' a cached property in 'BigQueryInsertJobOperator' (#33218) |
| e43206eb2e | 2023-08-08 | refactor(providers.google): use module level __getattr__ for DATAPROC_JOB_LOG_LINK to DATAPROC_JOB_LINK and add deprecation warning (#33189) |
| 8f27d3ff47 | 2023-08-08 | Prepare docs for RC2 providers (google, redis) (#33185) |
| 15ede4a1a1 | 2023-08-07 | Fix DataflowStartSqlJobOperator system test (#32823) |
| 9736143468 | 2023-08-07 | Add a new parameter to SQL operators to specify conn id field (#30784) |
| 0e076dceaf | 2023-08-07 | Fix catching 409 error (#33173) |
| 8997b5e95f | 2023-08-07 | Alias 'DATAPROC_JOB_LOG_LINK' to 'DATAPROC_JOB_LINK' (#33148) |
| 60677b0ba3 | 2023-08-05 | Prepare docs for Aug 2023 1st wave of Providers (#33128) |
| e10aa6ae6a | 2023-08-04 | openlineage, bigquery: add openlineage method support for BigQueryExecuteQueryOperator (#31293) |
| e3d82c6be0 | 2023-08-04 | Get rid of Python2 numeric relics (#33050) |
| 1ea7ae809b | 2023-08-03 | Refactor of links in Dataproc. (#31895) |
| d9121a7b9e | 2023-08-02 | Fix 'DataFusionAsyncHook' catch 404 (#32855) |
| 0c894dbb24 | 2023-08-02 | Handle multiple connections using exceptions (#32365) |
| 915f9e4060 | 2023-07-31 | Add GCS Requester Pays bucket support to GCSToS3Operator (#32760) |
| f9cddf332d | 2023-07-31 | openlineage,gcs: use proper name for openlineage methods (#32956) |
| ce5eebd004 | 2023-07-31 | Fix system test for MetastoreHivePartitionSensor (#32861) |
| c422920c6e | 2023-07-31 | Add system test and docs for CloudDataTransferServiceGCSToGCSOperator (#32960) |
Latest change: 2023-07-29
| Commit | Committed | Subject |
|---|---|---|
| d06b7af69a | 2023-07-29 | Prepare docs for July 2023 3rd wave of Providers (#32875) |
| 81b85ebcbd | 2023-07-29 | Fix 'BigQueryInsertJobOperator' not exiting deferred state (#31591) |
| 9d68492f87 | 2023-07-27 | misc: update MLEngine system tests (#32881) |
| b73366799d | 2023-07-27 | openlineage, gcs: add openlineage methods for GcsToGcsOperator (#31350) |
| 583f407c54 | 2023-07-26 | Fixup docstring for deprecated DataprocSubmitSparkJobOperator and refactoring system tests (#32743) |
| 4c2ef99772 | 2023-07-26 | Add Spot Instances support with Dataproc Operators (#31644) |
| 82e6226738 | 2023-07-23 | Fix Datafusion system tests (#32749) |
| 0fbb05a459 | 2023-07-21 | Fixup system test for DataprocSubmitJobOperator (SparkSQL job) (#32745) |
| fbeddc3017 | 2023-07-21 | Fixup docstring for deprecated DataprocSubmitPigJobOperator (#32739) |
| 440c9eb2b4 | 2023-07-21 | Fixup system test for DataprocSubmitJobOperator (PySpark job) (#32740) |
| 49921763eb | 2023-07-21 | Migrate system test for PostgresToGCSOperator to new design AIP-47 (#32641) |
| 978adb309a | 2023-07-21 | Install sqlalchemy-spanner package into Google provider (#31925) |
| 99b8a90346 | 2023-07-20 | Filtering and ordering results of DataprocListBatchesOperator (#32500) |
| 3c14753b03 | 2023-07-20 | Fix BigQueryGetDataOperator where project_id is not being respected in deferrable mode (#32488) |
| e8287734cb | 2023-07-20 | Fixup docstring for deprecated DataprocSubmitHiveJobOperator (#32723) |
| 8b7ae76026 | 2023-07-20 | Fixup docs and optimize system test for DataprocSubmitJobOperator (Hadoop job) (#32722) |
| 848c69a194 | 2023-07-20 | Refresh GKE OAuth2 tokens (#32673) |
| 60c49ab2df | 2023-07-19 | Add more accurate typing for DbApiHook.run method (#31846) |
| e01323635a | 2023-07-13 | Add deprecation info to the providers modules and classes docstring (#32536) |
Latest change: 2023-07-12
| Commit | Committed | Subject |
|---|---|---|
| e7f59a913e | 2023-07-12 | Prepare docs for July 2023 2nd wave of Providers (#32566) |
| 2ad91a7808 | 2023-07-11 | Bugfix GCSToGCSOperator when copy files to folder without wildcard (#32486) |
| 86c6cc9a9a | 2023-07-11 | Combine 8 into 1 (#29462) |
| 3a8da4b55b | 2023-07-11 | Allow a destination folder to be provided (#31885) |
| 0f73647bda | 2023-07-08 | D205 Support - Provider: Google (#32356) |
| e70bee00cd | 2023-07-08 | Fix 'cache_control' parameter of upload function in 'GCSHook' (#32440) |
| 257136786c | 2023-07-08 | Moves 'AzureBlobStorageToGCSOperator' from Azure to Google provider (#32306) |
| 723eb7d453 | 2023-07-07 | Give better link to job configuration docs in BigQueryInsertJobOperator (#31736) |
| 6c854dcb16 | 2023-07-07 | Migrating Google AutoML example_dags to sys tests (#32368) |
| 53d9421905 | 2023-07-07 | build(pre-commit): check deferrable default value (#32370) |
| 2d690de110 | 2023-07-07 | Fix BigQuery transfer operators to respect project_id arguments (#32232) |
| e7587b3369 | 2023-07-06 | Fix the gcp_gcs_delete_objects on empty list (#32383) |
| becfb3c64f | 2023-07-06 | Fix endless loop of defer in cloud_build (#32387) |
| e4757d6dfa | 2023-07-06 | Fix GCSToGCSOperator copy without wildcard and exact_match=True (#32376) |
Latest change: 2023-07-06
| Commit | Committed | Subject |
|---|---|---|
| 225e3041d2 | 2023-07-06 | Prepare docs for July 2023 wave of Providers (RC2) (#32381) |
| 3878fe6fab | 2023-07-05 | Remove spurious headers for provider changelogs (#32373) |
| cb4927a018 | 2023-07-05 | Prepare docs for July 2023 wave of Providers (#32298) |
| f8593503cb | 2023-07-05 | Add default_deferrable config (#31712) |
| d6e254db68 | 2023-06-30 | Deprecate 'delimiter' param and source object's wildcards in GCS, introduce 'match_glob' param. (#31261) |
| dd937e51fe | 2023-06-30 | Add 'on_finish_action' to 'KubernetesPodOperator' (#30718) |
| c0eaa9b25d | 2023-06-29 | Add deferrable mode to CloudSQLExportInstanceOperator (#30852) |
| f3f69bf1e0 | 2023-06-29 | Refactor GKECreateClusterOperator's body validation (#31923) |
| 7d2ec76c72 | 2023-06-29 | Make the deferrable version of DataprocCreateBatchOperator handle a batch_id that already exists (#32216) |
| 09d4718d3a | 2023-06-27 | Improve provider documentation and README structure (#32125) |
| b156db3a70 | 2023-06-23 | Adding 'src_fmt_configs' to the list of template fields. (#32097) |
| 59d64d8f2e | 2023-06-22 | [Issue-32069] Fix name format in the batch requests (#32070) |
| fd116cc196 | 2023-06-22 | Google provider docstring improvements (#31731) |
| 8f41584777 | 2023-06-21 | Optimize deferrable mode execution for 'BigQueryValueCheckOperator' (#31872) |
| fe7a1aa096 | 2023-06-21 | Switch Google Ads API version from v13 to v14 (#32028) |
| 43fa157e51 | 2023-06-20 | Fix 'BigQueryInsertJobOperator' error handling in deferrable mode (#32034) |
| 2a79fb74fd | 2023-06-20 | Fix 'BIGQUERY_JOB_DETAILS_LINK_FMT' in 'BigQueryConsoleLink' (#31953) |
Latest change: 2023-06-20
| Commit | Committed | Subject |
|---|---|---|
| 79bcc2e668 | 2023-06-20 | Prepare RC1 docs for June 2023 wave of Providers (#32001) |
| 8b146152d6 | 2023-06-20 | Add note about dropping Python 3.7 for providers (#32015) |
| f2ebc292fe | 2023-06-19 | Provide missing project id and creds for TabularDataset (#31991) |
| 66299338eb | 2023-06-18 | add a return when the event is yielded in a loop to stop the execution (#31985) |
| e6960f1ad6 | 2023-06-15 | Revert "Fix 'BIGQUERY_JOB_DETAILS_LINK_FMT' in 'BigQueryConsoleLink' (#31457)" (#31935) |
| c7072c0490 | 2023-06-15 | Fix 'BIGQUERY_JOB_DETAILS_LINK_FMT' in 'BigQueryConsoleLink' (#31457) |
| a81ac70b33 | 2023-06-15 | Add deferrable mode to PubsubPullSensor (#31284) |
| b502e665d6 | 2023-06-14 | Add a new param to set parquet row group size in 'BaseSQLToGCSOperator' (#31831) |
| 810d46776a | 2023-06-11 | Implement MetastoreHivePartitionSensor (#31016) |
| 233663046d | 2023-06-08 | Add 'cacheControl' field to google cloud storage (#31338) |
| ba3665f76a | 2023-06-08 | Bigquery: fix links for already existing tables and datasets. (#31589) |
| fbeb01cb17 | 2023-06-07 | Replace unicodecsv with standard csv library (#31693) |
| d91861d3bd | 2023-06-07 | Optimize deferrable mode (#31758) |
| 9e268e13b1 | 2023-06-07 | Replace spelling directive with spelling:word-list (#31752) |
| 36ffbee4aa | 2023-06-05 | Add D400 pydocstyle check - Google provider only (#31422) |
| 495ae23d45 | 2023-06-05 | Optimize deferrable mode execution for 'DataprocSubmitJobOperator' (#31317) |
| 86b5ba2802 | 2023-06-04 | Remove return statement after yield from triggers class (#31703) |
| dc5bf3fd02 | 2023-06-02 | Add discoverability for triggers in provider.yaml (#31576) |
| 47c2023df2 | 2023-05-31 | Add 'preserveAsciiControlCharacters' to 'src_fmt_configs' (#31643) |
| e3ec1ac72e | 2023-05-30 | Add support for credential configuation file auth to Google Secrets Manager secrets backend (#31597) |
| 9fa75aaf7a | 2023-05-29 | Remove Python 3.7 support (#30963) |
| ef40148170 | 2023-05-26 | Add credential configuration file support to Google Cloud Hook (#31548) |
| 22e44ab9f2 | 2023-05-26 | FIPS environments: Mark uses of md5 as "not-used-for-security" (#31171) |
| 5ae9728db7 | 2023-05-25 | Add deferrable mode to 'GCSUploadSessionCompleteSensor' (#31081) |
| 28f2e70916 | 2023-05-25 | Optimize deferrable mode execution for 'BigQueryInsertJobOperator' (#31249) |
| 769e204d53 | 2023-05-24 | Add append_job_name parameter in DataflowStartFlexTemplateOperator (#31511) |
Latest change: 2023-05-24
| Commit | Committed | Subject |
|---|---|---|
| d745cee3db | 2023-05-24 | Prepare adhoc wave of Providers (#31478) |
| c082aec089 | 2023-05-23 | Fix accessing a GKE cluster through the private endpoint in 'GKEStartPodOperator' (#31391) |
| 0d6e626b05 | 2023-05-22 | Fix 'BigQueryGetDataOperator''s query job bugs in deferrable mode (#31433) |
Latest change: 2023-05-19
| Commit | Committed | Subject |
|---|---|---|
| 45548b9451 | 2023-05-19 | Prepare RC2 docs for May 2023 wave of Providers (#31416) |
| 54f1fb0574 | 2023-05-19 | Docstring improvements (#31375) |
| cfe759dc59 | 2023-05-19 | Switch default Google ads to v13 (#31382) |
| abea189022 | 2023-05-18 | Use '__version__' in providers not 'version' (#31393) |
| db8cbf6ab5 | 2023-05-18 | Add get_namespace to GKEPodHook (#31397) |
| f5aed58d9f | 2023-05-18 | Fixing circular import error in providers caused by airflow version check (#31379) |
| d677a263be | 2023-05-18 | Switch to google ads v13 (#31369) |
| 28d1bf8dfc | 2023-05-18 | Update SDKs for google provider package (#30067) |
| d9ff55cf6d | 2023-05-16 | Prepare docs for May 2023 wave of Providers (#31252) |
| cf1e26b046 | 2023-05-16 | Add BigQueryToPostgresOperator (#30658) |
| d9f70dffd1 | 2023-05-16 | Add CloudBuild build id log (#30516) |
| caeca2d143 | 2023-05-15 | Add protocol to define methods relied upon by KubernetesPodOperator (#31298) |
| d3a2dbe028 | 2023-05-15 | GKEPodHook needs to have all methods KPO calls (#31266) |
| fb6c501124 | 2023-05-13 | Add flag apply_gcs_prefix to S3ToGCSOperator (b/245077385) (#31127) |
| a66edcbb2c | 2023-05-13 | 'CreateBatchPredictionJobOperator' Add batch_size param for Vertex AI BatchPredictionJob objects (#31118) |
| d1fe67184d | 2023-05-12 | Add 'use_legacy_sql' param to 'BigQueryGetDataOperator' (#31190) |
| b8f73768ec | 2023-05-09 | Add 'as_dict' param to 'BigQueryGetDataOperator' (#30887) |
| e68d4a7764 | 2023-05-08 | implement gcs_schema_object for BigQueryCreateExternalTableOperator (#30961) |
| 810b5d4da4 | 2023-05-08 | 'DataflowTemplatedJobStartOperator' fix overwriting of location with default value, when a region is provided. (#31082) |
| ac46902154 | 2023-05-04 | Move TaskInstanceKey to a separate file (#31033) |
| 0a30706aa7 | 2023-05-03 | Use 'AirflowProviderDeprecationWarning' in providers (#30975) |
| eef5bc7f16 | 2023-05-03 | Add full automation for min Airflow version for providers (#30994) |
| b0a40bb812 | 2023-04-30 | Optimize deferred execution mode (#30946) |
| a7eb32a5b2 | 2023-04-30 | Bump minimum Airflow version in providers (#30917) |
| f89d7b9848 | 2023-04-28 | Poke once before defer for GCSObjectsWithPrefixExistenceSensor (#30939) |
| a3741e0e02 | 2023-04-28 | Optimize deferrable mode execution (#30920) |
| 0d95acef1d | 2023-04-28 | Add deferrable mode to DataprocInstantiateInlineWorkflowTemplateOperator (#30878) |
| 3a5b583c91 | 2023-04-27 | Optimize deferrable mode in 'GCSObjectExistenceSensor' (#30901) |
| eed5d5b7cc | 2023-04-27 | Add deferrable mode to 'GCSObjectsWithPrefixExistenceSensor' (#30618) |
| 48c9625c70 | 2023-04-24 | Add 'priority' parameter to BigQueryHook (#30655) |
| 9409446097 | 2023-04-24 | Add cli cmd to list the provider trigger info (#30822) |
| 432697d90c | 2023-04-23 | allow multiple prefixes in gcs delete/list hooks and operators (#30815) |
| c499b6beb2 | 2023-04-22 | Small refactors in ClusterGenerator of dataproc (#30714) |
| c585ad51c5 | 2023-04-22 | Upgrade ruff to 0.0.262 (#30809) |
| 676a95b220 | 2023-04-22 | Fix removed delegate_to parameter in deferrable GCS sensor (#30810) |
| 9e49d91a0a | 2023-04-22 | Add deferrable mode to 'GCSObjectUpdateSensor' (#30579) |
Latest change: 2023-04-21
| Commit | Committed | Subject |
|---|---|---|
| e46ce78b66 | 2023-04-21 | Prepare docs for adhoc release of providers (#30787) |
| fbc1382514 | 2023-04-21 | remove delegate_to from GCP operators and hooks (#30748) |
| b48f959ae9 | 2023-04-21 | Update DataprocCreateCluster operator to use 'label' parameter properly (#30741) |
| da2749cae5 | 2023-04-15 | Update Google Campaign Manager360 operators to use API v4 (#30598) |
| 4eab616e9f | 2023-04-15 | add missing project_id in BigQueryGetDataOperator (#30651) |
| 57c09e59ee | 2023-04-14 | Display Video 360 cleanup v1 API usage (#30577) |
Latest change: 2023-04-12
| Commit | Committed | Subject |
|---|---|---|
| 0f3b6579cb | 2023-04-12 | Prepare docs for RC2 of provider wave (#30606) |
| 874ea9588e | 2023-04-09 | Prepare docs for ad hoc release of Providers (#30545) |
| 71db47a73d | 2023-04-09 | Update DV360 operators to use API v2 (#30326) |
| 3d2c96e3f5 | 2023-04-08 | Add deferrable mode to GKEStartPodOperator (#29266) |
| 4703f9a0e5 | 2023-04-08 | BigQueryHook list_rows/get_datasets_list can return iterator (#30543) |
| d9896fd96e | 2023-04-08 | Fix dynamic imports in google ads vendored in library (#30544) |
| d23a3bbed8 | 2023-04-04 | Add mechanism to suspend providers (#30422) |
| 2ba1e63c37 | 2023-04-04 | Fix cloud build async credentials (#30441) |
| cc6fd5c0d9 | 2023-04-03 | Small quotation fix (#30448) |
Latest change: 2023-04-02
| Commit | Committed | Subject |
|---|---|---|
| 55dbf1ff1f | 2023-04-02 | Prepare docs for April 2023 wave of Providers (#30378) |
| 25048fa6b2 | 2023-04-01 | Switch to using vendored-in google ads. (#30410) |
| 2e65c70e99 | 2023-04-01 | Merging of the google ads vendored-in code. (#30399) |
| 540a076801 | 2023-03-30 | merge BigQueryTableExistenceAsyncSensor into BigQueryTableExistenceSensor (#30235) |
| 29eba167ea | 2023-03-22 | Merge BigQueryTableExistencePartitionAsyncSensor into BigQueryTableExistencePartitionSensor (#30231) |
| 79a2fa7db9 | 2023-03-21 | Merge GCSObjectExistenceAsyncSensor logic to GCSObjectExistenceSensor (#30014) |
| af4627fec9 | 2023-03-20 | fix setting project_id for gs to bq and bq to gs (#30053) |
| 75fd5e8c54 | 2023-03-16 | Add missing 'poll_interval' in Bigquery operator (#30132) |
| 5a3be7256b | 2023-03-15 | Handling project location param on async BigQuery dts trigger (#29786) |
| a6715805c7 | 2023-03-14 | Add poll_interval param in BigQueryInsertJobOperator (#30091) |
| 57fb80cff0 | 2023-03-14 | Support CloudDataTransferServiceJobStatusSensor without specifying a project_id (#30035) |
| def1f89e70 | 2023-03-10 | Fix location on cloud build operators (#29937) |
| 599c587e26 | 2023-03-10 | Add 'job_id' to 'BigQueryToGCSOperator' templated_fields (#30006) |
| c3867781e0 | 2023-03-08 | adding trigger info to provider yaml (#29950) |
| b6392ae5fd | 2023-03-07 | Support deleting the local log files when using remote logging (#29772) |
| 464ab1b7ca | 2023-03-05 | Wait insert_job result in normal mode (#29925) |
| f55b9576b1 | 2023-03-05 | 'GoogleDriveHook': Fixing log message + adding more verbose documentation (#29694) |
| 035ad26d79 | 2023-03-04 | Add "BOOLEAN" to type_map of MSSQLToGCSOperator, fix incorrect bit->int type conversion by specifying BIT fields explicitly (#29902) |
| 5a632f78eb | 2023-03-04 | Google Cloud Providers - Fix _MethodDefault deepcopy failure (#29518) |
| 971039454a | 2023-03-04 | Align cncf provider file names with AIP-21 (#29905) |
| 864ff2e3ce | 2023-03-04 | Remove unnecessary upper constraints from google provider (#29915) |
Latest change: 2023-03-03
| Commit | Committed | Subject |
|---|---|---|
| fcd3c0149f | 2023-03-03 | Prepare docs for 03/2023 wave of Providers (#29878) |
| 3fc9461654 | 2023-03-03 | Add 'CloudSQLCloneInstanceOperator' (#29726) |
| 47ab0ca629 | 2023-03-03 | Move help message to the google auth code (#29888) |
| 972fca2253 | 2023-02-28 | Fix 'NoneType' object is not subscriptable. (#29820) |
| ec844eaa0a | 2023-02-27 | Add deferrable mode to BigQueryTablePartitionExistenceSensor. (#29735) |
| a5adb87ab4 | 2023-02-26 | Add a new param for BigQuery operators to support additional actions when resource exists (#29394) |
| 1e7c064560 | 2023-02-25 | Google Cloud Providers - Introduce GoogleCloudBaseOperator (#29680) |
| ad08f66228 | 2023-02-22 | Remove <2.0.0 limit on google-cloud-bigtable (#29644) |
| dba390e323 | 2023-02-22 | Fix and augment 'check-for-inclusive-language' CI check (#29549) |
| f51742d20b | 2023-02-21 | Don't push secret in XCOM in BigQueryCreateDataTransferOperator (#29348) |
| 3dbcf99d20 | 2023-02-21 | Update google cloud dlp package and adjust hook and operators (#29234) |
| 6ef5ba9104 | 2023-02-20 | Refactor Dataproc Trigger (#29364) |
| 7e3a9fc858 | 2023-02-20 | Dataproc batches (#29136) |
| 1677d80e65 | 2023-02-20 | Add deferrable mode to DataprocInstantiateWorkflowTemplateOperator (#28618) |
Latest change: 2023-02-18
| Commit | Committed | Subject |
|---|---|---|
| 470fdaea27 | 2023-02-18 | Prepare docs for 02 2023 midmonth wave of Providers (#29589) |
| f37772adfd | 2023-02-18 | 'GoogleDriveHook': Add folder_id param to upload_file (#29477) |
| 28126c12fb | 2023-02-14 | Add defer mode to GKECreateClusterOperator and GKEDeleteClusterOperator (#28406) |
| 32c571e592 | 2023-02-14 | Move cloud_sql_binary_path from connection to Hook (#29499) |
| 41fade2d21 | 2023-02-13 | Upgrade Mypy to 1.0 (#29468) |
| 5e6f8eb4d5 | 2023-02-13 | Check that cloud sql provider version is valid (#29497) |
| f9e9d23457 | 2023-02-11 | Restore trigger logging (#29482) |
| 7ee1a56244 | 2023-02-11 | Add documentation for BigQuery transfer operators (#29466) |
| 60d4bcd1d1 | 2023-02-10 | Revert "Enable individual trigger logging (#27758)" (#29472) |
| 6c1eeb5839 | 2023-02-11 | Revert "Upgrade mypy to 0.991 (#28926)" (#29470) |
| 6ae0a80cba | 2023-02-11 | Upgrade mypy to 0.991 (#28926) |
Latest change: 2023-02-08
| Commit | Committed | Subject |
|---|---|---|
| ce6ae2457e | 2023-02-08 | Prepare docs for Feb 2023 wave of Providers (#29379) |
| 1b18a501fe | 2023-02-03 | Enable individual trigger logging (#27758) |
| 872df121e2 | 2023-02-03 | Add deferrable capability to existing ''DataprocDeleteClusterOperator'' (#29349) |
| 094d6bf01b | 2023-01-30 | Add deferrable mode to dataflow operators (#27776) |
| 9d9351728c | 2023-01-30 | Add deferrable mode to DataprocCreateBatchOperator (#28457) |
| 9fd80130e2 | 2023-01-25 | Add deferrable mode to DataprocCreateClusterOperator and DataprocUpdateClusterOperator (#28529) |
| 02bebf897b | 2023-01-25 | Add deferrable mode to MLEngineStartTrainingJobOperator (#27405) |
| cf90a1a567 | 2023-01-25 | Keyfile dict can be dict not str (#29135) |
| b4c50dadd3 | 2023-01-24 | GCSTaskHandler may use remote log conn id (#29117) |
| b2825e1185 | 2023-01-24 | Fix GoogleDriveHook writing files to trashed folders on upload v2 (#29119) |
| be0e35321f | 2023-01-24 | fix Google provider CHANGELOG.rst (#29122) |
| 3374fdfcbd | 2023-01-23 | Deprecate 'delegate_to' param in GCP operators and update docs (#29088) |
| 7e2493e3c8 | 2023-01-23 | fix Google provider CHANGELOG.rst (#29114) |
| 90e6277da6 | 2023-01-23 | Auto ML assets (#25466) |
| e926bb9bb0 | 2023-01-20 | Add deferrable mode to DataFusionStartPipelineOperator (#28690) |
| 5fcdd321c5 | 2023-01-20 | Add deferrable mode for Big Query Transfer operator (#27833) |
| 5350be2194 | 2023-01-19 | Add support for write_on_empty in BaseSQLToGCSOperator (#28959) |
| dc3a3c7c52 | 2023-01-16 | Add DataprocCancelOperationOperator (#28456) |
Latest change: 2023-01-14
| Commit | Committed | Subject |
|---|---|---|
| 911b708ffd | 2023-01-14 | Prepare docs for Jan 2023 mid-month wave of Providers (#28929) |
| ce858a5d71 | 2023-01-12 | Switch to ruff for faster static checks (#28893) |
| f1eb2f1af4 | 2023-01-12 | 'BigQueryCreateExternalTableOperator' fix field delimiter not working with csv (#28856) |
| a337e6209a | 2023-01-11 | Fix using private _get_credentials instead of public get_credentials (#28588) |
| 284cd52989 | 2023-01-10 | Add deferrable ''GCSObjectExistenceSensorAsync'' (#28763) |
| 35a8ffc55a | 2023-01-10 | Support partition_columns in BaseSQLToGCSOperator (#28677) |
| c0b2fcff24 | 2023-01-09 | assign "datasetReference" attribute to dataset_reference dict. by default if not already set in create_empty_dataset method of bigquery hook (#28782) |
| 71306b31f1 | 2023-01-09 | Fix'GoogleCampaignManagerReportSensor' with 'QUEUED' status (#28735) |
| c67f4af667 | 2023-01-09 | Fix BigQueryColumnCheckOperator runtime error (#28796) |
Latest change: 2023-01-02
| Commit | Committed | Subject |
|---|---|---|
| 5246c009c5 | 2023-01-02 | Prepare docs for Jan 2023 wave of Providers (#28651) |
| fec1460eb7 | 2023-01-01 | Push job_id in xcom for dataproc submit job op (#28639) |
| 0fae6a0c9e | 2022-12-28 | Add table_resource to template fields for BigQueryCreateEmptyTableOperator (#28235) |
| d7f5f6d737 | 2022-12-24 | GCSToBigQueryOperator allows autodetect None and infers schema (#28564) |
| 034039beb2 | 2022-12-24 | Remove 'pylint' messages control instructions (#28555) |
| 8fb7be2fb5 | 2022-12-22 | Set bigquery ''use_legacy_sql'' param in job config correctly (#28522) |
| 23264fb820 | 2022-12-21 | Fix for issue with reading schema fields for JSON files in GCSToBigQueryOperator (#28284) |
| 7950fb9711 | 2022-12-21 | Remove deprecated AIPlatformConsoleLinkk from google/provider.yaml (#28449) |
| 820f5a9374 | 2022-12-20 | Use object instead of array in config.yml for config template (#28417) |
| 9eacf607be | 2022-12-20 | Fix GCSToBigQueryOperator not respecting schema_obj (#28444) |
| bdf3175e96 | 2022-12-06 | Improve memory usage in Dataproc deferrable operators (#28117) |
| 3fef462838 | 2022-12-06 | Fix GCSToGCSOperator copying list of objects without wildcard (#28111) |
| 2d663df055 | 2022-12-04 | Fix: re-enable use of parameters in gcs_to_bq which had been disabled (#27961) |
| 5cdff50557 | 2022-12-04 | Add retry param in GCSObjectExistenceSensor (#27943) |
| 8f98bfeb53 | 2022-12-03 | Add preserveAsciiControlCharacters to src_fmt_configs (#27679) |
| 4a3a429658 | 2022-12-03 | [misc] Get rid of 'pass' statement in conditions (#27775) |
| 6b3bb3c3e9 | 2022-12-03 | Change log level to DEBUG when secret not found for google secret manager (#27856) |
| 527b948856 | 2022-12-03 | [misc] Replace XOR '^' conditions by 'exactly_one' helper in providers (#27858) |
| c931d88893 | 2022-12-03 | Add deferrable mode to CloudBuildCreateBuildOperator (#27783) |
Latest change: 2022-11-26
| Commit | Committed | Subject |
|---|---|---|
| 25bdbc8e67 | 2022-11-26 | Updated docs for RC3 wave of providers (#27937) |
| f0820e8d9e | 2022-11-25 | Add Export Format to Template Fields in BigQueryToGCSOperator (#27910) |
| 2e20e9f7eb | 2022-11-24 | Prepare for follow-up relase for November providers (#27774) |
| 80c327bd3b | 2022-11-24 | Bump common.sql provider to 1.3.1 (#27888) |
| bc0063af99 | 2022-11-16 | Fix to read location parameter properly in BigQueryToBigQueryOperator (#27661) |
| 0cb6450d6d | 2022-11-16 | Persist DataprocLink for workflow operators regardless of job status (#26986) |
| ddbc758540 | 2022-11-16 | Deferrable mode for BigQueryToGCSOperator (#27683) |
Latest change: 2022-11-15
| Commit | Committed | Subject |
|---|---|---|
| 12c3c39d1a | 2022-11-15 | pRepare docs for November 2022 wave of Providers (#27613) |
| 00af5c007e | 2022-11-14 | Replace urlparse with urlsplit (#27389) |
| 1059de6294 | 2022-11-11 | Dataform operators, links, update system tests and docs (#27144) |
| 3aed495f50 | 2022-11-11 | Rename hook bigquery function '_bq_cast' to 'bq_cast' (#27543) |
| e8ab8ccc0e | 2022-11-11 | Add backward compatibility with old versions of Apache Beam (#27263) |
| 59e3198f7e | 2022-11-10 | Change dataprep system tests assets (#26488) |
| 98a9c574e3 | 2022-11-08 | set project_id and location when canceling BigQuery job (#27521) |
| a691ab56a6 | 2022-11-08 | Add new Compute Engine Operators and fix system tests (#25608) |
| 199359bb38 | 2022-11-07 | Use non-deprecated method for on_kill in BigQueryHook (#27547) |
| 7297892558 | 2022-11-07 | Remove unnecessary newlines around single arg in signature (#27525) |
| 5cd78cf425 | 2022-11-06 | Upgrade dependencies in order to avoid backtracking (#27531) |
| 332c01d6e0 | 2022-10-31 | Allow values in WorkflowsCreateExecutionOperator execution argument to be dicts (#27361) |
| 50d217a129 | 2022-10-31 | DataflowStopJobOperator Operator (#27033) |
| eb8c0cf0d2 | 2022-10-31 | Migration of System Tests: Cloud Composer (AIP-47) (#27227) |
| 528ecbbc00 | 2022-10-31 | Rewrite system tests for ML Engine service (#26915) |
| bcb026bf7c | 2022-10-31 | use the proper key to retrieve the dataflow job_id (#27336) |
| 42841f70d5 | 2022-10-31 | Migration of System Tests: Cloud BigQuery Data Transfer (AIP-47) (#27312) |
| 1447158e69 | 2022-10-31 | Typecast biquery job response col value (#27236) |
| 95e5675714 | 2022-10-31 | Migration of System Tests: Dataplex (AIP-47) (#26989) |
| 124fb3948d | 2022-10-31 | Add deferrable mode to GCPToBigQueryOperator + tests (#27052) |
| 7a7c5f8fc4 | 2022-10-31 | Add system tests for Vertex AI operators in new approach (#27053) |
| 4e55d7fa2b | 2022-10-31 | Migration of System Tests: Cloud Vision Operators (AIP-47) (#26963) |
| 896479d1a0 | 2022-10-31 | Google Drive to local - system tests migrations (AIP-47) (#26798) |
| 3d5f34cb0f | 2022-10-28 | Allow and prefer non-prefixed extra fields for dataprep hook (#27039) |
| 04f674c13b | 2022-10-27 | Migrate Bigtable operators system tests according to AIP-47 (#26911) |
| 58d61826a3 | 2022-10-27 | Migrate Dataproc Metastore system tests according to AIP-47 (#26858) |
| 9ab1a6a3e7 | 2022-10-27 | Update old style typing (#26872) |
| 87eb46bbc6 | 2022-10-26 | Common sql bugfixes and improvements (#26761) |
| 7653c61df8 | 2022-10-26 | Make GSheetsHook return an empty list when there are no values (#27261) |
| 78b8ea2f22 | 2022-10-24 | Move min airflow version to 2.3.0 for all providers (#27196) |
| 2a34dc9e84 | 2022-10-23 | Enable string normalization in python formatting - providers (#27205) |
| 58378cfd42 | 2022-10-23 | Cloud ML Engine operators assets (AIP-47) (#26836) |
| de9633f93a | 2022-10-22 | Update google hooks to prefer non-prefixed extra fields (#27023) |
| b54a2de8c7 | 2022-10-09 | Local filesystem to Google Drive Operator - system tests migration (AIP-47) (#26797) |
| b4cef6da21 | 2022-10-09 | SFTP to Google Cloud Storage Transfer system tests migration (AIP-47) (#26799) |
| 6f0b600293 | 2022-10-09 | Fix delay in Dataproc CreateBatch operator (#26126) |
| 2f326a6c03 | 2022-10-06 | Remove <2 limit on google-cloud-storage (#26922) |
| a67bcf3eca | 2022-10-06 | Allow for the overriding of stringify_dict for json/jsonb column data type in Postgres #26875 (#26876) |
Latest change: 2022-10-04
| Commit | Committed | Subject |
|---|---|---|
| 403ed7163f | 2022-10-04 | Add docs for Google/Slack RC providers (#26860) |
| fa0cb363b8 | 2022-10-01 | Correcting the transfer config name. (#25719) |
| cee610ae5c | 2022-10-01 | Fix parsing of optional 'mode' field in BigQuery Result Schema (#26786) |
| b7203cd36e | 2022-10-01 | Fix MaxID logic for GCSToBigQueryOperator (#26768) |
| f8db64c35c | 2022-09-28 | Update docs for September Provider's release (#26731) |
| dce27557eb | 2022-09-28 | Fix GCS sensor system tests failing with DebugExecutor (#26742) |
| 26f94c5370 | 2022-09-26 | Cloud Data Loss Prevention Operators assets (#26618) |
| 01ac40af75 | 2022-09-22 | Update gcs.py (#26570) |
| e61d823f18 | 2022-09-21 | Cloud Storage Transfer Operators assets & system tests migration (AIP-47) (#26072) |
| a60e3b9317 | 2022-09-21 | Migrate Data Loss Prevention system tests according to AIP-47 (#26060) |
| c4256ca1a0 | 2022-09-21 | Add BigQuery Column and Table Check Operators (#26368) |
| 4c33f6bcf5 | 2022-09-20 | Merge deferrable BigQuery operators to exisitng one (#26433) |
| 8e98b1c6df | 2022-09-20 | Google Drive to Google Cloud Storage Transfer Operator - system tests migration (AIP-47) (#26487) |
| e315900396 | 2022-09-20 | specifying project id when calling wait_for_operation in delete/create cluster (#26418) |
| 6045f7ad69 | 2022-09-19 | Cloud Functions Operators assets & system tests migration (AIP-47) (#26073) |
| 1f7b296227 | 2022-09-18 | Auto tail file logs in Web UI (#26169) |
| 07fe356de0 | 2022-09-18 | GCSToBigQueryOperator Resolve 'max_id_key' job retrieval and xcom return (#26285) |
| b4f8a069f0 | 2022-09-18 | Allow for the overriding of 'stringify_dict' for json export format on BaseSQLToGCSOperator (#26277) |
| 706a618014 | 2022-09-18 | Append GoogleLink base in the link class (#26057) |
| 97b144fbed | 2022-09-18 | Fix JSONDecodeError in Datafusion operators (#26202) |
| 9444d9789b | 2022-09-14 | Work around pyupgrade edge cases (#26384) |
| d67ac5932d | 2022-09-14 | Apply PEP-563 (Postponed Evaluation of Annotations) to core airflow (#26290) |
| 06acf40a43 | 2022-09-13 | Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289) |
| 23ad7e292a | 2022-09-10 | Cloud Video Intelligence Operators assets & system tests migration (AIP-47) (#26132) |
| 3a539ff663 | 2022-09-09 | Life Science assets & system tests migration (AIP-47) (#25548) |
| 5066844513 | 2022-09-09 | D400 first line should end with period batch02 (#25268) |
| f938cd4fc8 | 2022-09-08 | Add deferrable big query operators and sensors (#26156) |
| 8cac96918b | 2022-09-07 | GCSToBigQueryOperator allow for schema_object in alternate GCS Bucket (#26190) |
| 12cbc0f1dd | 2022-09-07 | Don't throw an exception when a BQ cusor job has no schema (#26096) |
| 8acdc2a834 | 2022-08-30 | Replace SQL with Common SQL in pre commit (#26058) |
| 1d06374194 | 2022-08-30 | Hook into Mypy to get rid of those cast() (#26023) |
| da8f133053 | 2022-08-29 | Use AsyncClient for Composer Operators in deferrable mode (#25951) |
| 1ed014647e | 2022-08-29 | Add 'output' property to MappedOperator (#25604) |
| d4eb60712d | 2022-08-27 | Use project_id to get authenticated client (#25984) |
| 4c3fb1ff2b | 2022-08-27 | Google Cloud Tasks Sensor for queue being empty (#25622) |
| c81178063a | 2022-08-27 | Cloud Build assets & system tests migration (AIP-47) (#25895) |
| 62a46c1e18 | 2022-08-27 | Added append_job_name parameter to DataflowTemplatedJobStartOperator (#25746) |
| 15b49add28 | 2022-08-23 | Sql to GSC operators update docs for parquet format (#25878) |
| 25a9ae3b2e | 2022-08-23 | Limit Google Protobuf for compatibility with biggtable client (#25886) |
| ecf0460b7d | 2022-08-22 | Dataproc submit job operator async (#25302) |
| fc6dfa338a | 2022-08-20 | Support project_id argument in BigQueryGetDataOperator (#25782) |
| 6e66dd7776 | 2022-08-19 | Make GoogleBaseHook credentials functions public (#25785) |
| 6e41c7eb33 | 2022-08-16 | Fixed never ending loop to in CreateWorkflowInvocation (#25737) |
| 6c5b0776c0 | 2022-08-14 | Adding a parameter for exclusion of trashed files in GoogleDriveHook (#25675) |
| 1b412c9cbe | 2022-08-10 | Consolidate to one 'schedule' param (#25410) |
Latest change: 2022-08-10
| Commit | Committed | Subject |
|---|---|---|
| e5ac6c7cfb | 2022-08-10 | Prepare docs for new providers release (August 2022) (#25618) |
| 2e2d4bffd5 | 2022-08-09 | Dataform operators (#25587) |
| c8c4a42723 | 2022-08-08 | Fix GCSListObjectsOperator docstring (#25614) |
| 029e3ae96f | 2022-08-05 | Remove deprecated modules (#25543) |
| 7d2c2ee879 | 2022-08-04 | add description method in BigQueryCursor class (#25366) |
| e84d753015 | 2022-08-04 | Fix BigQueryInsertJobOperator cancel_on_kill (#25342) |
| 803c0e252f | 2022-08-03 | Fix BaseSQLToGCSOperator approx_max_file_size_bytes (#25469) |
| faf3c4fe47 | 2022-08-02 | Fix PostgresToGCSOperat bool dtype (#25475) |
| c8cacad4d6 | 2022-08-02 | Migrate Google example trino_to_gcs to new design AIP-47 (#25420) |
| d2900022a2 | 2022-08-02 | Migrate Google example automl_nl_text_extraction to new design AIP-47 (#25418) |
| acab8f52dd | 2022-07-29 | Move all "old" SQL operators to common.sql providers (#25350) |
| f6b48ac6df | 2022-07-28 | Memorystore assets & system tests migration (AIP-47) (#25361) |
| f4b93cc097 | 2022-07-28 | Translate system tests migration (AIP-47) (#25340) |
| a8e4519815 | 2022-07-28 | Fix Vertex AI Custom Job training issue (#25367) |
| 5d4abbd58c | 2022-07-27 | Deprecate hql parameters and synchronize DBApiHook method APIs (#25299) |
| 8bc147192c | 2022-07-27 | Fix Flask Login user setting for Flask 2.2 and Flask-Login 0.6.2 (#25318) |
| 28db8c10b2 | 2022-07-26 | Migrate Google example life_sciences to new design AIP-47 (#25264) |
| 10c9a3697a | 2022-07-26 | Migrate Google example natural_language to new design AIP-47 (#25262) |
| b288bf4da4 | 2022-07-26 | Delete redundant system test bigquery_to_bigquery (#25261) |
| c8af0592c0 | 2022-07-26 | Improve taskflow type hints with ParamSpec (#25173) |
| df00436569 | 2022-07-22 | Unify DbApiHook.run() method with the methods which override it (#23971) |
| 66b3ca1d28 | 2022-07-21 | Migrate Google example bigquery_to_mssql to new design AIP-47 (#25174) |
| 9644451676 | 2022-07-19 | Migrate Google example compute_igm to new design AIP-47 (#25132) |
| 3a80b36ed9 | 2022-07-19 | Migrate Google example automl_vision to new design AIP-47 (#25152) |
| c0ce8a8375 | 2022-07-18 | Migrate Google example gcs_to_sftp to new design AIP-47 (#25107) |
| e32e9c5880 | 2022-07-18 | Bump typing-extensions and mypy for ParamSpec (#25088) |
| 4473b27d08 | 2022-07-16 | Migrate Google campaign manager example to new design AIP-47 (#25069) |
| 9b7e4a7324 | 2022-07-16 | Migrate Google analytics example to new design AIP-47 (#25006) |
| 77626b7fc8 | 2022-07-13 | Add project_id as a templated variable in two BQ operators (#24768) |
Latest change: 2022-07-13
| Commit | Committed | Subject |
|---|---|---|
| d2459a241b | 2022-07-13 | Add documentation for July 2022 Provider's release (#25030) |
| 93992f2361 | 2022-07-12 | PubSub assets & system tests migration (AIP-47) (#24867) |
| a13c51e224 | 2022-07-12 | Migrate Google sheets example to new design AIP-47 (#24975) |
| a038b52b5a | 2022-07-12 | Migrate Google ads example to new design AIP-47 (#24941) |
| c618da444e | 2022-07-12 | Modify BigQueryCreateExternalTableOperator to use updated hook function (#24363) |
| 626d9db290 | 2022-07-12 | Migrate Google example gcs_to_gdrive to new design AIP-47 (#24949) |
| fb51e04cfd | 2022-07-12 | Migrate Google firestore example to new design AIP-47 (#24830) |
| b777514253 | 2022-07-12 | Add handling state of existing Dataproc batch (#24924) |
| acaa0635c8 | 2022-07-08 | Automatically detect if non-lazy logging interpolation is used (#24910) |
| fb7162418e | 2022-07-07 | Add links for Google Kubernetes Engine operators (#24786) |
| 46bbfdade0 | 2022-07-07 | Move all SQL classes to common-sql provider (#24836) |
| 80b6754746 | 2022-07-06 | Migrate Google example sql_to_sheets to new design AIP-47 (#24814) |
| 3b35325840 | 2022-07-06 | Add test_connection method to 'GoogleBaseHook' (#24682) |
| 96b01a8012 | 2022-07-05 | Remove "bad characters" from our codebase (#24841) |
| 9227d56e68 | 2022-07-04 | Datacatalog assets & system tests migration (AIP-47) (#24600) |
| fe13eae3bf | 2022-07-04 | perf(BigQuery): pass table_id as str type (#23141) |
| 37ea530cb7 | 2022-07-04 | Migrate Google example DAG mssql_to_gcs to new design AIP-47 (#24541) |
| 46ac083f7e | 2022-07-01 | Align Black and blacken-docs configs (#24785) |
| 0de31bd73a | 2022-06-29 | Move provider dependencies to inside provider folders (#24672) |
| 45b11d4ed1 | 2022-06-29 | Use our yaml util in all providers (#24720) |
| 510a6bab45 | 2022-06-28 | Remove 'hook-class-names' from provider.yaml (#24702) |
| 7a7ca50160 | 2022-06-28 | Migrate Google example DAG s3_to_gcs to new design AIP-47 (#24641) |
| abb304c92f | 2022-06-25 | Migrate Google example DAG bigquery_transfer to new design AIP-47 (#24543) |
| ded22eb5b6 | 2022-06-24 | Add gcp_conn_id argument to GoogleDriveToLocalOperator (#24622) |
| e2f19505bf | 2022-06-22 | Upgrade FAB to 4.1.1 (#24399) |
| 9c59831ee7 | 2022-06-21 | Update providers to use functools compat for ''cached_property'' (#24582) |
| 88ddf65708 | 2022-06-20 | Migrate Google example DAG oracle_to_gcs to new design AIP-47 (#24542) |
| 32fc4be502 | 2022-06-20 | Migrate Google example DAG mysql_to_gcs to new design AIP-47 (#24540) |
| a35f342833 | 2022-06-20 | Migrate Google search_ads DAG to new design AIP-47 (#24298) |
| e7a1c50d62 | 2022-06-20 | GCSDeleteObjectsOperator empty prefix bug fix (#24353) |
| dd35fdaf35 | 2022-06-20 | Migrate Google gcs_to_sheets DAG to new design AIP-47 (#24501) |
| 0561c1aac4 | 2022-06-19 | Add DeprecationWarning for column_transformations parameter in AutoML (#24467) |
Latest change: 2022-06-15
| Commit | Committed | Subject |
|---|---|---|
| 952a5ea8d8 | 2022-06-15 | Update release docs for Google and Oracle providers (#24461) |
| ce50d3731a | 2022-06-15 | Use insert_job in the BigQueryToGCPOpertor and adjust links (#24416) |
| 2a084ee8d7 | 2022-06-14 | Update Oracle library to latest version (#24311) |
| 69c46252dd | 2022-06-14 | fix typo in google provider additional extras (#24431) |
| 08b675cf66 | 2022-06-13 | Fix links to sources for examples (#24386) |
| 94257f48f4 | 2022-06-13 | Expose SQL to GCS Metadata (#24382) |
| 8e0bddaea6 | 2022-06-12 | Deprecate remaining occurrences of 'bigquery_conn_id' in favor of 'gcp_conn_id' (#24376) |
| 6eb60f816c | 2022-06-12 | Migrate Google calendar example DAG to new design AIP-47 (#24333) |
| bc3fc8c9fc | 2022-06-12 | Migrate Google azure_fileshare example DAG to new design AIP-47 (#24349) |
| 6ab02b69a0 | 2022-06-12 | Remove bigquery example already migrated to AIP-47 (#24379) |
| cb90ca7afb | 2022-06-12 | Migrate Google sheets example DAG to new design AIP-47 (#24351) |
Latest change: 2022-06-09
| Commit | Committed | Subject |
|---|---|---|
| dcdcf3a2b8 | 2022-06-09 | Update release notes for RC2 release of Providers for May 2022 (#24307) |
| 047a6162b0 | 2022-06-08 | Workaround job race bug on biguery to gcs transfer (#24330) |
| 717a7588bc | 2022-06-07 | Update package description to remove double min-airflow specification (#24292) |
| b1ad017cee | 2022-06-07 | pydocstyle D202 added (#24221) |
| aeabe994b3 | 2022-06-07 | Prepare docs for May 2022 provider's release (#24231) |
| c3a9ef1ada | 2022-06-07 | AIP-47 - Migrate google leveldb DAGs to new design ##22447 (#24233) |
| c23826915d | 2022-06-07 | Apply per-run log templates to log handlers (#24153) |
| 80c1ce76e1 | 2022-06-06 | Cloud Storage assets & StorageLink update (#23865) |
| ec84ffe71c | 2022-06-06 | Fix GCSToGCSOperator cannot copy a single file/folder without copying other files/folders with that prefix (#24039) |
| 027b707d21 | 2022-06-05 | Add explanatory note for contributors about updating Changelog (#24229) |
| 55fd02a389 | 2022-06-04 | Add key_secret_project_id parameter which specifies a project with KeyFile (#23930) |
| 90233bc7cb | 2022-06-04 | Added impersonation_chain for DataflowStartFlexTemplateOperator and DataflowStartSqlJobOperator (#24046) |
| c01a5a50b4 | 2022-06-04 | Fix BigQuery system tests (#24013) |
| a597a76e8f | 2022-06-03 | fix BigQueryInsertJobOperator (#24165) |
| e13b15946e | 2022-06-03 | Workflows assets & system tests migration (AIP-47) (#24105) |
| 368f292ca1 | 2022-06-03 | Update credentials when using ADC in Compute Engine (#23773) |
| 96e8fb4a07 | 2022-06-01 | Fix the link to google workplace (#24080) |
| 3dd7b1ddba | 2022-06-01 | set color to operators in cloud_sql.py (#24000) |
| 841ed27101 | 2022-06-01 | Spanner assets & system tests migration (AIP-47) (#23957) |
| fedab9d64a | 2022-06-01 | Remove hack from BigQuery DTS hook (#23887) |
| e58985598f | 2022-05-30 | Ensure @contextmanager decorates generator func (#23103) |
| 92ddcf4ac6 | 2022-05-27 | Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873) |
| ec6761a5c0 | 2022-05-23 | Clean up f-strings in logging calls (#23597) |
| 65f3b18fc1 | 2022-05-22 | Sql to gcs with exclude columns (#23695) |
| a43e98d050 | 2022-05-22 | Fix DataprocJobBaseOperator not being compatible with dotted names (#23439). (#23791) |
| 5bfacf81c6 | 2022-05-20 | [Issue#22846] allow option to encode or not encode UUID when uploading from Cassandra to GCS (#23766) |
| f60fa98a2e | 2022-05-19 | Cloud SQL assets & system tests migration (AIP-47) (#23583) |
| d3b0880286 | 2022-05-17 | Speech To Text assets & system tests migration (AIP-47) (#23643) |
| 3bf9a1df38 | 2022-05-16 | Add fields to CLOUD_SQL_EXPORT_VALIDATION. (#23724) |
| bc0dcddfb5 | 2022-05-12 | Migrate Dataproc to new system tests design (#22777) |
Latest change: 2022-05-12
| Commit | Committed | Subject |
|---|---|---|
| 75c60923e0 | 2022-05-12 | Prepare provider documentation 2022.05.11 (#23631) |
| cd49a8b9f6 | 2022-05-11 | [FEATURE] google provider - BigQueryInsertJobOperator log query (#23648) |
| 60a1d9d191 | 2022-05-10 | [FEATURE] google provider - split GkeStartPodOperator execute (#23518) |
| 74557e41e3 | 2022-05-10 | Add exportContext.offload flag to CLOUD_SQL_EXPORT_VALIDATION. (#23614) |
| 428a439953 | 2022-05-09 | Clean up in-line f-string concatenation (#23591) |
| 766726f2e3 | 2022-05-09 | Fix 'PostgresToGCSOperator' does not allow nested JSON (#23063) |
| 82c244f9c7 | 2022-05-08 | Fix GCSToGCSOperator ignores replace parameter when there is no wildcard (#23340) |
| 627b5698ec | 2022-05-04 | Add Stackdriver assets and migrate system tests to AIP-47 (#23320) |
| 3977e1798d | 2022-05-04 | CloudTasks assets & system tests migration (AIP-47) (#23282) |
| dfe0f75938 | 2022-05-04 | TextToSpeech assets & system tests migration (AIP-47) (#23247) |
| 2d109401b3 | 2022-05-04 | Bump pre-commit hook versions (#22887) |
| 427e14b763 | 2022-05-03 | Fix code-snippets in google provider (#23438) |
| fa0cc7cec7 | 2022-05-02 | Cleanup Google provider CHANGELOG.rst (#23390) |
| 3f6d5eef42 | 2022-05-01 | 'DataprocHook': Remove deprecated function 'submit' (#23389) |
| 511d0ee256 | 2022-04-30 | Bigquery assets (#23165) |
| 3f9845095e | 2022-04-29 | Remove redundant docstring in 'BigQueryUpdateTableSchemaOperator' (#23349) |
| 0fcdc5e1fb | 2022-04-29 | 'S3ToGCSOperator': Remove 'dest_gcs_conn_id' (#23348) |
| 05ccfd42f2 | 2022-04-29 | Dataproc: Remove default value of 'region' (#23350) |
| 359dc58207 | 2022-04-29 | Google provider: Remove 'bigquery_conn_id', 'google_cloud_storage_conn_id' (#23326) |
| c82b3b9466 | 2022-04-28 | 'GCSFileTransformOperator': New templated fields 'source_object', 'destination_object' (#23328) |
| 9449a107f0 | 2022-04-28 | 'DatastoreHook': Remove 'datastore_conn_id' (#23323) |
| 1f32603549 | 2022-04-28 | update processor to fix broken download URLs (#23299) |
| 8a7b61a8e4 | 2022-04-28 | Migrate gcs to new system tests design (#22778) |
| 72e2ea68a1 | 2022-04-27 | 'CloudBuildCreateBuildOperator': Remove deprecated 'body' parameter (#23263) |
| 6cf0176f2a | 2022-04-27 | Remove deprecated parameters from PubSub operators: (#23261) |
| 4d9c55c9d9 | 2022-04-27 | Remove deprecated parameters from BigQueryHook: (#23269) |
| 915b0c689e | 2022-04-27 | add missing docstring in 'BigQueryHook.create_empty_table' (#23270) |
| 710eb6f3e6 | 2022-04-26 | * 'CloudDatastoreImportEntitiesOperator' : Remove 'xcom_push'. Please use 'BaseOperator.do_xcom_push' (#23252) |
| 2d569fdaf0 | 2022-04-26 | Create links for Biqtable operators (#23164) |
| 434ab5a03c | 2022-04-26 | 'BigtableCreateInstanceOperator' & 'BigtableHook.create_instance' Remove 'replica_cluster_id', 'replica_cluster_zone'. (#23251) |
| 5ca1f3bf70 | 2022-04-26 | Dataproc : remove 'location' in favor of 'region' (#23250) |
| 1416ac4195 | 2022-04-26 | 'PubSubPullSensor': Remove 'project' and 'return_immediately' (#23231) |
| 06dfc2536c | 2022-04-26 | Remove deprecated 'params' from google operators (#23230) |
| 37a7b27242 | 2022-04-26 | 'LookerStartPdtBuildOperator', 'LookerCheckPdtBuildSensor' : fix empty materialization id handling (#23025) |
| 967140e6c3 | 2022-04-25 | Add location support to BigQueryDataTransferServiceTransferRunSensor. |
| d6094e58ba | 2022-04-25 | Fix static checks |
| 22ea28f23e | 2022-04-25 | Remove run_in_gke_cluster flag |
| c46d04eb2d | 2022-04-25 | Create system test for K8s and dataproc operators |
| 35cbc89c3a | 2022-04-25 | Create Dataproc operators for GKE |
| 27ad3b7827 | 2022-04-25 | Remove 'GCSObjectsWtihPrefixExistenceSensor' |
| 544d658921 | 2022-04-25 | Change CloudDatastoreExportEntitiesLink to StorageLink |
| b3cc2f5d10 | 2022-04-25 | Fix pre-commit check |
| 43ded6c877 | 2022-04-25 | Add links for Cloud Datastore operators |
| de65a5cc5a | 2022-04-25 | Support serviceAccount attr for dataflow in the Apache beam |
| 76dc7375b2 | 2022-04-25 | Migrate Datastore system tests to new design (AIP-47) |
| 0373fb0247 | 2022-04-25 | 'GoogleDriveToGCSOperator': Remove 'destination_bucket' and 'destination_object' |
| 6b459995b2 | 2022-04-25 | Add the format of Vertex Endpoint ID to the docstrings |
| 27af0b7ebe | 2022-04-25 | Add the new parameter to the docstring |
| 48abf571be | 2022-04-25 | Add 'endpoint_id' arg to 'google.cloud.operators.vertex_ai.CreateEndpointOperator' |
| 8b6b0848a3 | 2022-04-23 | Use new Breese for building, pulling and verifying the images. (#23104) |
| 07a13bb708 | 2022-04-21 | Change ComputeSSH to throw provider import error instead paramiko (#23035) |
| c36bcc4c06 | 2022-04-15 | Upgrade to support Google Ads v10 (#22965) |
| ea1ae1963e | 2022-04-14 | Fix cancel_on_kill after execution timeout for DataprocSubmitJobOperator (#22955) |
| 9a623e94cb | 2022-04-13 | migrate system test gcs_to_bigquery into new design (#22753) |
| aa317d92ea | 2022-04-13 | Fix select * query xcom push for BigQueryGetDataOperator (#22936) |
| 27b3e31178 | 2022-04-11 | implements #22859 - Add .sql as templatable extension (#22920) |
| 03e1c9b152 | 2022-04-11 | MSSQLToGCSOperator fails: datetime is not JSON Serializable (#22882) |
| 6933022e94 | 2022-04-10 | Fix new MyPy errors in main (#22884) |
| 6aa65a38e0 | 2022-04-08 | Add example DAG for demonstrating usage of GCS sensors (#22808) |
Latest change: 2022-04-07
| Commit | Committed | Subject |
|---|---|---|
| 56ab82ed7a | 2022-04-07 | Prepare mid-April provider documentation. (#22819) |
| 838cf401b9 | 2022-04-06 | Fail ''LocalFilesystemToGCSOperator'' if src does not exist (#22772) |
| 99b0211d50 | 2022-04-04 | Modify transfer operators to handle more data (#22495) |
| f9e18472c0 | 2022-04-04 | Add autodetect arg in BQCreateExternalTable Operator (#22710) |
| 327eab3e26 | 2022-03-31 | Add links for BigQuery Data Transfer (#22280) |
| 02976bef88 | 2022-03-27 | Refactor: BigQuery to GCS Operator (#22506) |
| 719135ade0 | 2022-03-27 | Remove references to deprecated operators/params in PubSub operators (#22519) |
| ca4b8d1744 | 2022-03-27 | Create Endpoint and Model Service, Batch Prediction and Hyperparameter Tuning Jobs operators for Vertex AI service (#22088) |
| 388723950d | 2022-03-27 | PostgresToGoogleCloudStorageOperator - BigQuery schema type for time zone naive fields (#22536) |
| c063fc688c | 2022-03-25 | Update black precommit (#22521) |
| 3c7cd47319 | 2022-03-25 | New design of system tests (#22311) |
| 7ab45d41d6 | 2022-03-24 | Update secrets backends to use get_conn_value instead of get_conn_uri (#22348) |
| d231e9b448 | 2022-03-24 | Remove coerce_datetime usage from GCSTimeSpanFileTransformOperator (#22501) |
| 82a26c0591 | 2022-03-24 | Fix the docstrings (#22497) |
| 38fde2ea79 | 2022-03-23 | Fix 'download_media' url in 'GoogleDisplayVideo360SDFtoGCSOperator' (#22479) |
| 0f0a1a7d22 | 2022-03-23 | Fix to 'CloudBuildRunBuildTriggerOperator' fails to find build id. (#22419) |
Latest change: 2022-03-22
| Commit | Committed | Subject |
|---|---|---|
| d7dbfb7e26 | 2022-03-22 | Add documentation for bugfix release of Providers (#22383) |
| 7b851edc91 | 2022-03-21 | Add 'LocalFilesystemToGoogleDriveOperator' (#22219) |
| 14e6b657c2 | 2022-03-21 | Add timeout and retry to the BigQueryInsertJobOperator (#22395) |
| a3ffbee7c9 | 2022-03-20 | Fix skipping non-GCS located jars (#22302) |
| 88402038ca | 2022-03-19 | Add dataflow_default_options to templated_fields (#22367) |
| 6448b2458c | 2022-03-15 | [FIX] typo doc of gcs operator (#22290) |
Latest change: 2022-03-14
| Commit | Committed | Subject |
|---|---|---|
| 16adc035b1 | 2022-03-14 | Add documentation for Classifier release for March 2022 (#22226) |
| 87c1246b79 | 2022-03-14 | Add Dataplex operators (#20377) |
| c1ab8e2d7b | 2022-03-14 | Protect against accidental misuse of XCom.get_value() (#22244) |
| c108f264ab | 2022-03-13 | Change the default 'chunk_size' to a clear representation & add documentation (#22222) |
| 45435399fe | 2022-03-13 | Support Uploading Bigger Files to Google Drive (#22179) |
| 42a891d605 | 2022-03-13 | Update ''GKEDeleteClusterOperator', ''GKECreateClusterOperator'' docstrings (#22212) |
| d08284ed25 | 2022-03-11 | `` Add map_index to XCom model and interface (#22112)`` |
| 828d1cba4d | 2022-03-10 | Add support for ARM platform (#22127) |
| 4ac771c316 | 2022-03-09 | Fix spelling (#22107) |
| dd0724fdd2 | 2022-03-08 | Add guide for DataprocInstantiateInlineWorkflowTemplateOperator (#22062) |
| dfd9805a23 | 2022-03-08 | Use yaml safe load (#22091) |
| eba9703751 | 2022-03-08 | Revert "Use yaml safe load (#22085)" (#22089) |
| 7f4935bab3 | 2022-03-08 | Use yaml safe load (#22085) |
| a11d831e3f | 2022-03-07 | Allow for uploading metadata with GCS Hook Upload (#22058) |
Latest change: 2022-03-07
| Commit | Committed | Subject |
|---|---|---|
| f5b96315fe | 2022-03-07 | Add documentation for Feb Providers release (#22056) |
| 6db9b0029b | 2022-03-07 | Add Looker PDT operators (#20882) |
| 9020b3a89d | 2022-03-06 | Add autodetect arg to external table creation in GCSToBigQueryOperator (#21944) |
| a0e2ebaa27 | 2022-03-02 | Unpin 'google-cloud-memcache' (#21912) |
| 84ed747db8 | 2022-03-02 | Unpin ''pandas-gbq'' and remove unused code (#21915) |
| fb6b2d1fee | 2022-03-01 | Make project_id argument optional in all dataproc operators (#21866) |
| 08575ddd8a | 2022-03-01 | Change BaseOperatorLink interface to take a ti_key, not a datetime (#21798) |
| 6ca118dff1 | 2022-03-01 | Allow templates in more DataprocUpdateClusterOperator fields (#21865) |
| 0c55ca2cda | 2022-02-28 | Suppress hook warnings from the Bigquery transfers (#20119) |
| 73eb24f25c | 2022-02-24 | Fix bigquery_dts parameter docstring typo (#21786) |
| 3b4c26eb3a | 2022-02-23 | Add Dataproc assets/links (#21756) |
| 6061cc4219 | 2022-02-20 | Add Auto ML operators for Vertex AI service (#21470) |
| 295efd36ea | 2022-02-17 | Dataflow Assets (#21639) |
| af2c047320 | 2022-02-16 | Add GoogleCalendarToGCSOperator (#20769) |
| 1b568d73e1 | 2022-02-15 | Extract ClientInfo to module level (#21554) |
| dc03000de8 | 2022-02-15 | Datafusion assets (#21518) |
| 56365b102c | 2022-02-15 | Dataproc metastore assets (#21267) |
| 6692e9191d | 2022-02-15 | Normalize *_conn_id parameters in BigQuery sensors (#21430) |
| 2eb10565b2 | 2022-02-15 | Fixed PostgresToGCSOperator fail on empty resultset for use_server_side_cursor=True (#21307) |
| da1e6578e0 | 2022-02-15 | Fix multi query scenario in bigquery example DAG (#21575) |
Latest change: 2022-02-14
| Commit | Committed | Subject |
|---|---|---|
| 28378d867a | 2022-02-14 | Add documentation for RC3 release of providers for Jan 2022 (#21553) |
| 6bb0857df9 | 2022-02-13 | (providers_google) add a location check in bigquery (#19571) |
| 6579648af2 | 2022-02-13 | Fix bigquery-hook when no engine_kwargs are passed |
| da485da29a | 2022-02-13 | Add support for BeamGoPipelineOperator (#20386) |
| 05a883b35e | 2022-02-11 | Google Cloud Composer opearators (#21251) |
| 833087f4f9 | 2022-02-10 | Enable asynchronous job submission in BigQuery hook (#21385) |
| 51aff276ca | 2022-02-10 | Optionally raise an error if source file does not exist in GCSToGCSOperator (#21391) |
| 07fe9e8c6a | 2022-02-09 | Never set DagRun.state to State.NONE (#21263) |
| 0a3ff43d41 | 2022-02-08 | Add pre-commit check for docstring param types (#21398) |
| d94fa37830 | 2022-02-08 | Fixed changelog for January 2022 (delayed) provider's release (#21439) |
| e973740208 | 2022-02-08 | Create CustomJob and Datasets operators for Vertex AI service (#21253) |
| 34d63fabc0 | 2022-02-08 | Fix BigQueryDataTransferServiceHook.get_transfer_run() request parameter (#21293) |
| 6b88d432d9 | 2022-02-06 | Support to upload file to Google Shared Drive (#21319) |
| 1a77bc6481 | 2022-02-06 | :bug: (BigQueryHook) fix compatibility with sqlalchemy engine (#19508) |
| 6c3a67d4fc | 2022-02-05 | Add documentation for January 2021 providers release (#21257) |
| 39e395f981 | 2022-02-04 | Add more SQL template fields renderers (#21237) |
| e840acf8d1 | 2022-02-04 | Fix BigQuery system test (#21320) |
| ddb5246bd1 | 2022-02-03 | Refactor operator links to not create ad hoc TaskInstances (#21285) |
| 1d4b709e20 | 2022-01-28 | Revert "Create CustomJob and Datasets operators for Vertex AI service (#20077)" (#21203) |
| 48d44b885b | 2022-01-28 | Cloudsql import links fix. (#21199) |
| 640c0b6763 | 2022-01-28 | Create CustomJob and Datasets operators for Vertex AI service (#20077) |
| cb73053211 | 2022-01-27 | Add optional features in providers. (#21074) |
| 60aa518ebf | 2022-01-26 | batch as templated field in DataprocCreateBatchOperator (#20905) |
| 623163f16a | 2022-01-25 | Extend dataproc example dag (#21091) |
| 86ef016eab | 2022-01-23 | Make timeout Optional for wait_for_operation (#20981) |
| 506efb6fa3 | 2022-01-21 | Squelch more deprecation warnings (#21003) |
| 372849486c | 2022-01-21 | Fix last google provider MyPy errors (#21010) |
| 73c0d241d8 | 2022-01-21 | Remove a few stray ':type's in docs (#21014) |
| 602abe8394 | 2022-01-20 | Remove ':type' lines now sphinx-autoapi supports typehints (#20951) |
| b8526abc2c | 2022-01-19 | Add encoding parameter to 'GCSToLocalFilesystemOperator' to fix #20901 (#20919) |
| 58452f97db | 2022-01-03 | Add hook for integrating with Google Calendar (#20542) |
Latest change: 2021-12-31
| Commit | Committed | Subject |
|---|---|---|
| f77417eb0d | 2021-12-31 | Fix K8S changelog to be PyPI-compatible (#20614) |
| 97496ba2b4 | 2021-12-31 | Update documentation for provider December 2021 release (#20523) |
| a22d5bd076 | 2021-12-31 | Fix mypy errors in Google Cloud provider (#20611) |
| 4233ebe5ce | 2021-12-31 | Fix setting of project ID in ''provide_authorized_gcloud'' (#20428) |
| 83f8e178ba | 2021-12-31 | Even more typing in operators (template_fields/ext) (#20608) |
| 746ee587da | 2021-12-31 | Delete pods by default in KubernetesPodOperator (#20575) |
| 41dbe2c4fc | 2021-12-30 | Fix mypy errors in google/cloud/operators/stackdriver (#20601) |
| dda688776c | 2021-12-30 | Fix Google mlengine MyPy errors (#20569) |
| d56e7b56bb | 2021-12-30 | Fix template_fields type to have MyPy friendly Sequence type (#20571) |
| bd9e8cef26 | 2021-12-30 | Fix Google Mypy Dataproc errors (#20570) |
| a6e60ce25d | 2021-12-30 | Change download_video parameter to resourceName (#20528) |
| af4a2b0240 | 2021-12-30 | Fix big query to mssql/mysql transfer issues (#20001) |
| a0821235fb | 2021-12-30 | Use typed Context EVERYWHERE (#20565) |
| da88ed1943 | 2021-12-29 | Fix MyPy errors in Google Cloud (again) (#20469) |
| 3a480f5ff4 | 2021-12-29 | Fix passing the gzip compression parameter on sftp_to_gcs. (#20553) |
| bfd6d45cec | 2021-12-29 | switch to follow_redirects on httpx.get call in CloudSQL provider (#20239) |
| 7d4d38b546 | 2021-12-29 | avoid deprecation warnings in BigQuery transfer operators (#20502) |
| b7086f9815 | 2021-12-28 | Use Python3.7+ syntax in pyupgrade (#20501) |
| a4622e19fa | 2021-12-22 | Support regional GKE cluster (#18966) |
| 2ffdcf4b41 | 2021-12-21 | Fixes docstring for PubSubCreateSubscriptionOperator (#20237) |
| d4c4f9e09e | 2021-12-21 | Fix mypy errors for google.cloud_build (#20234) |
| c6dbb3f885 | 2021-12-21 | Fix MyPy for Google Bigquery (#20329) |
| ed604b62f3 | 2021-12-18 | Fix remaining MyPy errors in Google Provider (#20358) |
| 17404f1f10 | 2021-12-16 | Move source_objects datatype check out of GCSToBigQueryOperator.__init__ (#20347) |
| 174681911f | 2021-12-16 | Fix MyPy Errors for dataproc package (#20327) |
| 2fb5e1d0ec | 2021-12-15 | Fix cached_property MyPy declaration and related MyPy errors (#20226) |
| 21b8661886 | 2021-12-15 | Fix missing get_backup method for Dataproc Metastore (#20326) |
| cdaa9a2529 | 2021-12-15 | Fix MyPy errors for google.cloud.tasks (#20233) |
| 43efde6230 | 2021-12-15 | Fix MyPy Errors for Apache Beam (and Dataflow) provider. (#20301) |
| c4b3694101 | 2021-12-15 | Fix MyPy errors in leveldb (#20222) |
| 1570519a97 | 2021-12-14 | Fix MyPy errors for google.cloud.transfers (#20229) |
| 632bd0133e | 2021-12-13 | Fix MyPY errors for google.cloud.example_dags (#20232) |
| 644051abcb | 2021-12-13 | Fix MyPy errors for google/marketing_platform and suite (#20227) |
| a208463802 | 2021-12-13 | Organize S3 Classes in Amazon Provider (#20167) |
| 98514cc159 | 2021-12-13 | Add optional location to bigquery data transfer service (#15088) (#20221) |
| 1f662571b2 | 2021-12-12 | Fix MyPy errors in google.cloud.sensors (#20228) |
| 22341b90da | 2021-12-11 | Add Google Cloud Tasks how-to documentation (#20145) |
| e9262752dc | 2021-12-11 | Finalised Datastore documentation (#20138) |
| fa96b09395 | 2021-12-09 | Update Sphinx and Sphinx-AutoAPI (#20079) |
| ed8b63ba24 | 2021-12-08 | Providers facebook hook multiple account (#19377) |
| 50bf536656 | 2021-12-08 | Remove deprecated method call (blob.download_as_string) (#20091) |
| 564fe635bd | 2021-12-06 | Added example DAG for MSSQL to Google Cloud Storage (GCS) (#19873) |
| cb082d361a | 2021-12-02 | Remove deprecated template_fields from GoogleDriveToGCSOperator (#19991) |
| 6977c47572 | 2021-12-01 | BigQueryHook fix typo in run_load doc string (#19924) |
| f6dca1fa5e | 2021-12-01 | Update doc reference links (#19909) |
Latest change: 2021-11-30
| Commit | Committed | Subject |
|---|---|---|
| 853576d901 | 2021-11-30 | Update documentation for November 2021 provider's release (#19882) |
| fb478c00cd | 2021-11-28 | Move 'bucket_name' validation out of '__init__' in Google Marketing Platform operators (#19383) |
| e9e530979a | 2021-11-28 | Update 'default_args' value in example_functions DAG from str to int (#19865) |
| bf68b9a846 | 2021-11-26 | Create dataproc serverless spark batches operator (#19248) |
| a192cecf6b | 2021-11-26 | updates pipeline_timeout CloudDataFusionStartPipelineOperator (#18773) |
| eb163c81d1 | 2021-11-25 | Fix GCS system tests (#19227) |
| 744d11bdb2 | 2021-11-25 | Clean up ''default_args'' usage in docs (#19803) |
| 0b2e1a8744 | 2021-11-22 | Added wait mechanizm to the DataprocJobSensor to avoid 509 errors when Job is not available (#19740) |
| 3336bb6c3c | 2021-11-19 | Fix badly merged impersonation in GKEPodOperator (#19696) |
| 952ef908bc | 2021-11-19 | Support impersonation_chain parameter in the GKEStartPodOperator (#19518) |
| 853c16465a | 2021-11-18 | Clean-up of google cloud example dags - batch 3 (#19664) |
| 355dec8fea | 2021-11-17 | Misc. documentation typos and language improvements (#19599) |
| b9d31cd449 | 2021-11-17 | Cleanup dynamic 'start_date' use for miscellaneous Google example DAGs (#19400) |
| daf234bd5e | 2021-11-16 | Remove reference to deprecated operator in example_dataproc (#19619) |
| 48f228cf9e | 2021-11-15 | #16691 Providing more information in docs for DataprocCreateCluster operator migration (#19446) |
| 6ef44b6a50 | 2021-11-15 | Clean-up of google cloud example dags - batch 2 (#19527) |
| dc0159e7e4 | 2021-11-14 | Add support in GCP connection for reading key from Secret Manager (#19164) |
| 4212c49324 | 2021-11-14 | Update Azure modules to comply with AIP-21 (#19431) |
| aa2cb5545f | 2021-11-12 | Remove remaining 'pylint: disable' comments (#19541) |
| c8dc0311da | 2021-11-08 | Fix Cloud SQL system tests (#19014) |
| 26ad55beb0 | 2021-11-08 | Add dataproc metastore operators (#18945) |
| 9efb989d19 | 2021-11-07 | Clean-up of google cloud example dags (#19436) |
| f421409b4d | 2021-11-05 | Fix typos in warnings, docstrings, exceptions (#19424) |
| a3c9956f79 | 2021-10-30 | Add support of 'path' parameter for GCloud Storage Transfer Service operators (#17446) |
Latest change: 2021-10-29
| Commit | Committed | Subject |
|---|---|---|
| d9567eb106 | 2021-10-29 | Prepare documentation for October Provider's release (#19321) |
| 55abc2f620 | 2021-10-28 | Support query timeout as an argument in CassandraToGCSOperator (#18927) |
| e4aa377da7 | 2021-10-28 | Update BigQueryCreateExternalTableOperator doc and parameters (#18676) |
| 20847fdbf8 | 2021-10-27 | Add value to "namespaceId" of query (#19163) |
| 3c08c025c5 | 2021-10-27 | Move validation of templated input params to run after the context init (#19048) |
| eba1b68b30 | 2021-10-27 | Update dataflow.py (#19231) |
| 7ecf29f70d | 2021-10-26 | Fix hard-coded /tmp directory in CloudSQL Hook (#19229) |
| 726a1517ec | 2021-10-26 | Fix bug in Dataflow hook when no jobs are returned (#18981) |
| d9192a55ba | 2021-10-22 | Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052) |
| 4fae04a471 | 2021-10-21 | Upgrade the Dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879) |
| 0e95b57772 | 2021-10-19 | Google provider catch invalid secret name (#18790) |
| 86a2a19ad2 | 2021-10-17 | More f-strings (#18855) |
| a418fd96f7 | 2021-10-17 | Use google cloud credentials when executing beam command in subprocess (#18992) |
| 5c3e453820 | 2021-10-15 | Fix BigQueryToMsSqlOperator documentation (#18995) |
| 406b38b2e3 | 2021-10-15 | Replace default api_version of FacebookAdsReportToGcsOperator (#18996) |
| 1571f80546 | 2021-10-14 | Add pre-commit hook for common misspelling check in files (#18964) |
| 20df60de24 | 2021-10-07 | Dataflow Operators - use project and location from job in on_kill method. (#18699) |
| 86bf2a29ba | 2021-10-04 | Simplify strings previously split across lines (#18679) |
Latest change: 2021-09-30
| Commit | Committed | Subject |
|---|---|---|
| 840ea3efb9 | 2021-09-30 | Update documentation for September providers release (#18613) |
| 9279c44c91 | 2021-09-29 | Fix part of Google system tests (#18494) |
| 2fadf3c3cf | 2021-09-27 | Fix kubernetes engine system test (#18548) |
| a458fcc573 | 2021-09-27 | Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278) |
| 97d6892318 | 2021-09-25 | Rename AzureDataLakeStorage to ADLS (#18493) |
| a5439eee72 | 2021-09-23 | Add index to the dataset name to have separate dataset for each example DAG (#18459) |
| 18d7e1e227 | 2021-09-21 | Fix BigQuery system test (#18373) |
| e25eea052f | 2021-09-19 | Inclusive Language (#18349) |
| 7458f1e786 | 2021-09-18 | Remove check for at least one schema in GCSToBigquery (#18150) |
| 2474f8922d | 2021-09-13 | Migrate Google Cloud Build from Discovery API to Python SDK (#18184) |
| 8ae2bb9bfa | 2021-09-13 | Fix error when create external table using table resource (#17998) |
| 9140ad8d8f | 2021-09-11 | Use parameters instead of params (#18143) |
| 3d4bfdcbb9 | 2021-09-10 | Add missing __init__.py files for some test packages (#18142) |
| cfb602a33d | 2021-09-10 | Fix ''BigQuery'' data extraction in ''BigQueryToMySqlOperator'' (#18073) |
| 2fd3f27ebd | 2021-09-10 | Make next_dagrun_info take a data interval (#18088) |
| 944dcfbb91 | 2021-09-07 | Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719) |
| bfad233b91 | 2021-09-06 | Fix providers tests in main branch with eager upgrades (#18040) |
| 21348c194d | 2021-09-03 | fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006) |
| 9a0c10ba3f | 2021-09-01 | deduplicate running jobs on BigQueryInsertJobOperator (#17496) |
| fe34582fc2 | 2021-09-01 | New google operator: SQLToGoogleSheetsOperator (#17887) |
| 500780651c | 2021-08-31 | Add possibility to run DAGs from system tests and see DAGs logs (#17868) |
Latest change: 2021-08-30
| Commit | Committed | Subject |
|---|---|---|
| 0a68588479 | 2021-08-30 | Add August 2021 Provider's documentation (#17890) |
| b5da846dd1 | 2021-08-30 | Fix missing Data Fusion sensor integration (#17914) |
| 07405e6df4 | 2021-08-30 | [AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787) |
| 42e13e1a5a | 2021-08-30 | Remove all deprecation warnings in providers (#17900) |
| aa5952e58c | 2021-08-27 | Gcp ai hyperparameter tuning (#17790) |
| 87769db98f | 2021-08-27 | Allow omission of 'initial_node_count' if 'node_pools' is specified (#17820) |
| be75dcd39c | 2021-08-23 | Update description about the new ''connection-types'' provider meta-data |
| d04aa13526 | 2021-08-20 | [Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137) |
| 76ed2a49c6 | 2021-08-19 | Import Hooks lazily individually in providers manager (#17682) |
| b68d1935f9 | 2021-08-19 | Add error check for config_file parameter in GKEStartPodOperator (#17700) |
| 29aab6434f | 2021-08-17 | Adds secrets backend/logging/auth information to provider yaml (#17625) |
| b06d528603 | 2021-08-11 | Don't cache Google Secret Manager client (#17539) |
| 67cbb0f181 | 2021-08-02 | Enable specifying dictionary paths in 'template_fields_renderers' (#17321) |
| c384f9b0f5 | 2021-07-29 | GCP Secret Manager error handling for missing credentials (#17264) |
Latest change: 2021-07-26
| Commit | Committed | Subject |
|---|---|---|
| 87f408b1e7 | 2021-07-26 | Prepares docs for Rc2 release of July providers (#17116) |
| 448e50bd23 | 2021-07-26 | Updating Google Cloud example DAGs to use XComArgs (#16875) |
| aaf44ccace | 2021-07-26 | Updating miscellaneous Google example DAGs to use XComArgs (#16876) |
| d01cc945dd | 2021-07-26 | Fixes several failing tests after broken main (#17222) |
| babc4250f3 | 2021-07-26 | Fixes statich check failures (#17218) |
| 5d2224795b | 2021-07-25 | Google Ads Hook: Support newer versions of the google-ads library (#17160) |
| 966b250199 | 2021-07-25 | Fix GCStoGCS operator with replace diabled and existing destination object (#16991) |
| 763919d415 | 2021-07-25 | Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162) |
| 81bd40933e | 2021-07-23 | [CASSANDRA-16814] Fix cassandra to gcs type inconsistency. (#17183) |
| 026ffe65d4 | 2021-07-19 | fix: dataprocpysparkjob project_id as self.project_id (#17075) |
| d02ded65ea | 2021-07-15 | Fixed wrongly escaped characters in amazon's changelog (#17020) |
| b916b75079 | 2021-07-15 | Prepare documentation for July release of providers. (#17015) |
| a3f5c93806 | 2021-07-13 | Update alias for field_mask in Google Memmcache (#16975) |
| b0f7f91fe2 | 2021-07-07 | Standardise dataproc location param to region (#16034) |
| 866a601b76 | 2021-06-28 | Removes pylint from our toolchain (#16682) |
Latest change: 2021-06-18
| Commit | Committed | Subject |
|---|---|---|
| bbc627a3da | 2021-06-18 | Prepares documentation for rc2 release of Providers (#16501) |
| cbf8001d76 | 2021-06-16 | Synchronizes updated changelog after buggfix release (#16464) |
| 8a9c337838 | 2021-06-15 | Remove class references in changelogs (#16454) |
| 1fba5402bb | 2021-06-15 | More documentation update for June providers release (#16405) |
| 3c5cc42e13 | 2021-06-14 | Fix deprecation warnings location in google provider (#16403) |
| b272f9cec9 | 2021-06-13 | fix: ensure datetime-related values fully compatible with MySQL and BigQuery (#15026) |
| 7f8f75eb80 | 2021-06-12 | Add BigQueryToMsSqlOperator (#15422) |
| 0c80a7d411 | 2021-06-11 | Fixes AzureFileShare connection extras (#16388) |
| 9c94b72d44 | 2021-06-07 | Updated documentation for June 2021 provider release (#16294) |
| 1e647029e4 | 2021-06-01 | Rename the main branch of the Airflow repo to be 'main' (#16149) |
| 99d1535287 | 2021-05-31 | Fix: GCS To BigQuery source_object (#16160) |
| e1137523d4 | 2021-05-30 | Fix: Unnecessary downloads in ''GCSToLocalFilesystemOperator'' (#16171) |
| 904709d34f | 2021-05-27 | Check synctatic correctness for code-snippets (#16005) |
| 86768859c6 | 2021-05-26 | Fix bigquery type error when export format is parquet (#16027) |
| 6ae9aeec3f | 2021-05-26 | pass wait_for_done parameter down to _DataflowJobsController (#15541) |
| 476d0f6e3d | 2021-05-22 | Bump pyupgrade v2.13.0 to v2.18.1 (#15991) |
| aa4713e43f | 2021-05-21 | Use api version only in GoogleAdsHook not operators (#15266) |
| 76a80bb17c | 2021-05-19 | Move plyvel to google provider extra (#15812) |
| bb115da0b7 | 2021-05-17 | Get rid of requests as core dependency (#15781) |
| 9c8391a13f | 2021-05-10 | Fix spelling (#15699) |
| 3711a29e5e | 2021-05-09 | Fix argument ordering and type of bucket and object (#15738) |
| a01567c471 | 2021-05-08 | Fix sql_to_gcs docstring lint error (#15730) |
| f3fada9101 | 2021-05-07 | Add short description to BaseSQLToGCSOperator docstring (#15728) |
| 37681bca00 | 2021-05-07 | Auto-apply apply_default decorator (#15667) |
| b8c0fde38a | 2021-05-07 | Add extra links for google dataproc (#10343) |
| 3b4fdd0a7a | 2021-05-06 | add oracle connection link (#15632) |
| cf6324e43b | 2021-05-04 | Implement BigQuery Table Schema Update Operator (#15367) |
| 0f97a3970d | 2021-05-04 | Rename example bucket names to use INVALID BUCKET NAME by default (#15651) |
Latest change: 2021-05-01
| Commit | Committed | Subject |
|---|---|---|
| 807ad32ce5 | 2021-05-01 | Prepares provider release after PIP 21 compatibility (#15576) |
| 814e471d13 | 2021-04-29 | Update pre-commit checks (#15583) |
| bf2b48174a | 2021-04-27 | Add Connection Documentation for Providers (#15499) |
| 4b031d39e1 | 2021-04-27 | Make Airflow code Pylint 2.8 compatible (#15534) |
| e229f3541d | 2021-04-27 | Use Pip 21.* to install airflow officially (#15513) |
| 71c673e427 | 2021-04-22 | Update Docstrings of Modules with Missing Params (#15391) |
| 3b9a91806e | 2021-04-22 | Bugfix: Fix rendering of ''object_name'' in ''GCSToLocalFilesystemOperator'' (#15487) |
| c5e302030d | 2021-04-21 | Fix typo in DataprocCreateClusterOperator (#15462) |
| 42a1ca8aab | 2021-04-20 | Fixes wrongly specified path for leveldb hook (#15453) |
| 6da36bad2c | 2021-04-18 | [Airflow-15245] - passing custom image family name to the DataProcClusterCreateoperator (#15250) |
| f649905606 | 2021-04-15 | fix docstring typos (#15392) |
| 7bf69edca0 | 2021-04-08 | Fix typo in a docstring (#15276) |
Latest change: 2021-04-06
| Commit | Committed | Subject |
|---|---|---|
| 042be2e4e0 | 2021-04-06 | Updated documentation for provider packages before April release (#15236) |
| eae22cec9c | 2021-04-06 | Adds 'Trino' provider (with lower memory footprint for tests) (#15187) |
| e49722859b | 2021-04-05 | Updates 3.6 limits for latest versions of a few libraries (#15209) |
| 1d641d8f11 | 2021-04-01 | update remaining old import paths of operators (#15127) |
| 099c490cff | 2021-03-28 | Override project in dataprocSubmitJobOperator (#14981) |
| 5379698892 | 2021-03-27 | Improve docstrings for various modules (#15047) |
| a7ca1b3b0b | 2021-03-26 | Fix Sphinx Issues with Docstrings (#14968) |
| a7e144bec8 | 2021-03-23 | Google Dataflow Hook to handle no Job Type (#14914) |
| 72ea841b4b | 2021-03-22 | GCS to BigQuery Transfer Operator with Labels and Description parameter (#14881) |
| e172bd0e16 | 2021-03-22 | Update docstrings to adhere to sphinx standards (#14918) |
| 68e4c4dcb0 | 2021-03-20 | Remove Backport Providers (#14886) |
| ddc9133d36 | 2021-03-15 | Add GCS timespan transform operator (#13996) |
| 943baff670 | 2021-03-10 | Add job labels to bigquery check operators. (#14685) |
| 6dc24c95e3 | 2021-03-07 | Fix grammar and remove duplicate words (#14647) |
| e7bb17aeb8 | 2021-03-06 | Use built-in 'cached_property' on Python 3.8 where possible (#14606) |
| 7daebefd15 | 2021-03-05 | Use libyaml C library when available. (#14577) |
| 35c9a90292 | 2021-03-01 | Add Google leveldb hook and operator (#13109) (#14105) |
Latest change: 2021-02-27
| Commit | Committed | Subject |
|---|---|---|
| 589d6dec92 | 2021-02-27 | Prepare to release the next wave of providers: (#14487) |
| 50a1504c52 | 2021-02-27 | Fix spellings (#14483) |
| bfef559cf6 | 2021-02-27 | Corrects order of argument in docstring in GCSHook.download method (#14497) |
| 33214d9326 | 2021-02-26 | Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677) |
| c281979982 | 2021-02-23 | Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033) |
| ca35bd7f7f | 2021-02-21 | By default PIP will install all packages in .local folder (#14125) |
| a7e4266d67 | 2021-02-21 | Refactor GoogleDriveToGCSOperator to use common methods (#14276) |
| 1ab406663e | 2021-02-16 | Add GoogleDriveToLocalOperator (#14191) |
| 59c94c679e | 2021-02-13 | Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026) |
| e31b27d593 | 2021-02-13 | Add materialized view support for BigQuery (#14201) |
| e3bcaa3ba3 | 2021-02-12 | Correct typo in GCSObjectsWtihPrefixExistenceSensor (#14179) |
| 7faa2d978c | 2021-02-10 | Add BigQueryUpdateTableOperator (#14149) |
| 1da6972165 | 2021-02-10 | Fixes to dataproc operators and hook (#14086) |
| 02288cf2ba | 2021-02-10 | Add param to CloudDataTransferServiceOperator (#14118) |
| 7d38645472 | 2021-02-09 | #9803 fix bug in copy operation without wildcard (#13919) |
| b0c382426c | 2021-02-07 | Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982) |
| 5d7d46bb33 | 2021-02-05 | Improve GCSToSFTPOperator paths handling (#11284) |
| 10343ec29f | 2021-02-05 | Corrections in docs and tools after releasing provider RCs (#14082) |
Latest change: 2021-02-04
| Commit | Committed | Subject |
|---|---|---|
| 88bdcfa0df | 2021-02-04 | Prepare to release a new wave of providers. (#14013) |
| 1872d8719d | 2021-02-03 | Add Apache Beam operators (#12814) |
| 0e8c77b93a | 2021-02-03 | Support google-cloud-logging' >=2.0.0 (#13801) |
| 833e338323 | 2021-02-02 | Fix four bugs in StackdriverTaskHandler (#13784) |
| d2efb33239 | 2021-02-02 | Support google-cloud-monitoring>=2.0.0 (#13769) |
| ac2f72c98d | 2021-02-01 | Implement provider versioning tools (#13767) |
| 823741cfea | 2021-01-28 | Improve GCS system test envs (#13946) |
| 6d6588fe2b | 2021-01-28 | Add Google Cloud Workflows Operators (#13366) |
| 810c15ed85 | 2021-01-27 | Fix and improve GCP BigTable hook and system test (#13896) |
| 6616617331 | 2021-01-27 | Add env variables to PubSub example dag (#13794) |
| f473ca7130 | 2021-01-24 | Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851) |
| a9ac2b040b | 2021-01-23 | Switch to f-strings using flynt. (#13732) |
| 9592be88e5 | 2021-01-22 | Fix Google Spanner example dag (#13842) |
| af52fdb511 | 2021-01-22 | Improve environment variables in GCP Dataflow system test (#13841) |
| e7946f1cb7 | 2021-01-22 | Improve environment variables in GCP Datafusion system test (#13837) |
| 61c1d6ec6c | 2021-01-22 | Improve environment variables in GCP Memorystore system test (#13833) |
| 202f66093a | 2021-01-22 | Improve environment variables in GCP Lifeciences system test (#13834) |
| 70bf307f38 | 2021-01-21 | Add How To Guide for Dataflow (#13461) |
| 3fd5ef3555 | 2021-01-21 | Add missing logos for integrations (#13717) |
| 309788e5e2 | 2021-01-18 | Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256) |
| 7ec858c452 | 2021-01-17 | updated Google DV360 Hook to fix SDF issue (#13703) |
| ef8617ec9d | 2021-01-14 | Support google-cloud-tasks>=2.0.0 (#13347) |
| 189af54043 | 2021-01-13 | Add system tests for Stackdriver operators (#13644) |
| a6f999b62e | 2021-01-11 | Support google-cloud-automl >=2.1.0 (#13505) |
| 947dbb73bb | 2021-01-11 | Support google-cloud-datacatalog>=3.0.0 (#13534) |
| 2fb68342b0 | 2021-01-07 | Replace deprecated module and operator in example_tasks.py (#13527) |
| 003584bbf1 | 2021-01-05 | Fix failing backport packages test (#13497) |
| 7d1ea4cb10 | 2021-01-05 | Replace deprecated module and operator in example_tasks.py (#13473) |
| c7d75ad887 | 2021-01-05 | Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482) |
| feb84057d3 | 2021-01-04 | Support google-cloud-datacatalog 3.0.0 (#13224) |
| 3a3e739981 | 2021-01-04 | Fix insert_all method of BigQueryHook to support tables without schema (#13138) |
| c33d2c06b6 | 2021-01-02 | Fix another pylint c-extension-no-member (#13438) |
| f6518dd6a1 | 2021-01-02 | Generalize MLEngineStartTrainingJobOperator to custom images (#13318) |
| 9de7127083 | 2020-12-31 | Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337) |
| 406181d64a | 2020-12-31 | Add Parquet data type to BaseSQLToGCSOperator (#13359) |
| 295d66f914 | 2020-12-30 | Fix Grammar in PIP warning (#13380) |
| 13a9747bf1 | 2020-12-28 | Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341) |
| 04ec45f045 | 2020-12-28 | Add DataprocCreateWorkflowTemplateOperator (#13338) |
| 1f712219fa | 2020-12-28 | Support google-cloud-tasks>=2.0.0 (#13334) |
| f4745c8ce1 | 2020-12-26 | Fix typo in example (#13321) |
| e9d65bd458 | 2020-12-24 | Decode Remote Google Logs (#13115) |
| e7aeacf335 | 2020-12-24 | Add OracleToGCS Transfer (#13246) |
| 323084e97d | 2020-12-24 | Add timeout option to gcs hook methods. (#13156) |
| 0b626c8042 | 2020-12-22 | Support google-cloud-redis>=2.0.0 (#13117) |
| 9042a58553 | 2020-12-22 | Add more operators to example DAGs for Cloud Tasks (#13235) |
| 8c00ec89b9 | 2020-12-22 | Support google-cloud-pubsub>=2.0.0 (#13127) |
| b26b0df5b0 | 2020-12-22 | Update compatibility with google-cloud-kms>=2.0 (#13124) |
| 9a1d3820d6 | 2020-12-22 | Support google-cloud-datacatalog>=1.0.0 (#13097) |
| f95b1c9c95 | 2020-12-21 | Add regional support to dataproc workflow template operators (#12907) |
| 6cf76d7ac0 | 2020-12-18 | Fix typo in pip upgrade command :( (#13148) |
| 23f27c1b1c | 2020-12-18 | Add system tests for CloudKMSHook (#13122) |
| cddbf81b12 | 2020-12-17 | Fix Google BigQueryHook method get_schema() (#13136) |
| 1259c712a4 | 2020-12-17 | Update compatibility with google-cloud-os-login>=2.0.0 (#13126) |
| bcf77586ef | 2020-12-16 | Fix Data Catalog operators (#13096) |
| 5090fb0c89 | 2020-12-15 | Add script to generate integrations.json (#13073) |
| b4b9cf5597 | 2020-12-14 | Check for missing references to operator guides (#13059) |
| 1c1ef7ee69 | 2020-12-14 | Add project_id to client inside BigQuery hook update_table method (#13018) |
Latest change: 2020-12-09
| Commit | Committed | Subject |
|---|---|---|
| 32971a1a2d | 2020-12-09 | Updates providers versions to 1.0.0 (#12955) |
| b40dffa085 | 2020-12-08 | Rename remaing modules to match AIP-21 (#12917) |
| 9b39f24780 | 2020-12-08 | Add support for dynamic connection form fields per provider (#12558) |
| 1dcd3e13fd | 2020-12-05 | Add support for extra links coming from the providers (#12472) |
| 2037303eef | 2020-11-29 | Adds support for Connection/Hook discovery from providers (#12466) |
| 02d94349be | 2020-11-29 | Don't use time.time() or timezone.utcnow() for duration calculations (#12353) |
| 76bcd08dca | 2020-11-28 | Added '@apply_defaults' decorator. (#12620) |
| e1ebfa68b1 | 2020-11-27 | Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249) |
| 3fa51f94d7 | 2020-11-24 | Add check for duplicates in provider.yaml files (#12578) |
| c34ef853c8 | 2020-11-20 | Separate out documentation building per provider (#12444) |
| 9e3b2c554d | 2020-11-19 | GCP Secrets Optional Lookup (#12360) |
| 0080354502 | 2020-11-18 | Update provider READMEs for 1.0.0b2 batch release (#12449) |
| 7ca0b6f121 | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438) |
| 8d09506464 | 2020-11-18 | Fix download method in GCSToBigQueryOperator (#12442) |
| 2c0920fba5 | 2020-11-17 | Adds mechanism for provider package discovery. (#12383) |
| 2cda2f2a0a | 2020-11-17 | Add missing pre-commit definition - provider-yamls (#12393) |
| 80a957f142 | 2020-11-17 | Add Dataflow sensors - job metrics (#12039) |
| ae7cb4a1e2 | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
| 917e6c4424 | 2020-11-16 | Add provide_file_and_upload to GCSHook (#12310) |
| cfa4ecfeb0 | 2020-11-15 | Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726) |
| 6889a333cf | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
| 7825e8f590 | 2020-11-13 | Docs installation improvements (#12304) |
| 32b59f8350 | 2020-11-12 | Fixes the sending of an empty list to BigQuery 'list_rows' (#12307) |
| 250436d962 | 2020-11-10 | Fix spelling in Python files (#12230) |
| 502ba309ea | 2020-11-10 | Enable Markdownlint rule - MD022/blanks-around-headings (#12225) |
| dd2095f4a8 | 2020-11-10 | Simplify string expressions & Use f-string (#12216) |
| f37c6e6fce | 2020-11-10 | Add Compute Engine SSH hook (#9879) |
| 85a18e13d9 | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
| 59eb5de78c | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
| 61feb6ec45 | 2020-11-09 | Provider's readmes generated for elasticsearch and google packages (#12194) |
| b2a28d1590 | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
| fcb6b00efe | 2020-11-08 | Add authentication to AWS with Google credentials (#12079) |
| 2ef3b7ef8c | 2020-11-08 | Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172) |
| 0caec9fd32 | 2020-11-06 | Dataflow - add waiting for successful job cancel (#11501) |
| cf9437d79f | 2020-11-06 | Simplify string expressions (#12123) |
| 91a64db505 | 2020-11-04 | Format all files (without excepions) by black (#12091) |
| fd3db778e7 | 2020-11-04 | Add server side cursor support for postgres to GCS operator (#11793) |
| f1f1940261 | 2020-11-04 | Add DataflowStartSQLQuery operator (#8553) |
| 41bf172c1d | 2020-11-04 | Simplify string expressions (#12093) |
| 5f5244b74d | 2020-11-04 | Add template fields renderers to Biguery and Dataproc operators (#12067) |
| 4e8f9cc8d0 | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
| 8c42cf1b00 | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
| 45ae145c25 | 2020-11-03 | Log BigQuery job id in insert method of BigQueryHook (#12056) |
| e324b37a67 | 2020-11-03 | Add job name and progress logs to Cloud Storage Transfer Hook (#12014) |
| 6071fdd584 | 2020-11-02 | Improve handling server errors in DataprocSubmitJobOperator (#11947) |
| 2f703df12d | 2020-10-30 | Add SalesforceToGcsOperator (#10760) |
| e5713e00b3 | 2020-10-29 | Add drain option when canceling Dataflow pipelines (#11374) |
| 37eaac3c5d | 2020-10-29 | The PRs which are not approved run subset of tests (#11828) |
| 79cb771992 | 2020-10-28 | Fixing re pattern and changing to use a single character class. (#11857) |
| 5a439e84eb | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
| 240c7d4d72 | 2020-10-26 | Google Memcached hooks - improve protobuf messages handling (#11743) |
| 8afdb6ac6a | 2020-10-26 | Fix spellings (#11825) |
| 872b1566a1 | 2020-10-25 | Generated backport providers readmes/setup for 2020.10.29 (#11826) |
| 6ce855af11 | 2020-10-24 | Fix spelling (#11821) |
| 4830687453 | 2020-10-24 | Use Python 3 style super classes (#11806) |
| 727c739afb | 2020-10-22 | Improve Cloud Memorystore for Redis example (#11735) |
| 1da8379c91 | 2020-10-22 | Fix static checks after merging #10121 (#11737) |
| 91503308c7 | 2020-10-22 | Add Google Cloud Memorystore Memcached Operators (#10121) |
| 950c16d0b0 | 2020-10-21 | Retry requests in case of error in Google ML Engine Hook (#11712) |
| 2bfc53b5eb | 2020-10-21 | Fix doc errors in google provider files. (#11713) |
| 53e6062105 | 2020-10-21 | Enforce strict rules for yamllint (#11709) |
| 349b0811c3 | 2020-10-20 | Add D200 pydocstyle check (#11688) |
| 2d854c3505 | 2020-10-19 | Add service_account to Google ML Engine operator (#11619) |
| 46a121fb7b | 2020-10-18 | docs: Update Bigquery clustering docstrings (#11232) |
| 49c58147fe | 2020-10-18 | Strict type checking for provider Google (#11609) |
| 0823d46a7f | 2020-10-16 | Add type annotations for AWS operators and hooks (#11434) |
| 3c10ca6504 | 2020-10-16 | Add DataflowStartFlexTemplateOperator (#8550) |
| 8865d14df4 | 2020-10-16 | Strict type checking for provider google cloud (#11548) |
| 16e7129719 | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
| 06141d6d01 | 2020-10-12 | Google cloud operator strict type check (#11450) |
| d305876bee | 2020-10-12 | Remove redundant None provided as default to dict.get() (#11448) |
| 1845cd11b7 | 2020-10-11 | Strict type check for google ads and cloud hooks (#11390) |
| bd204bb91b | 2020-10-11 | Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409) |
| 75071831ba | 2020-10-10 | Remove redundant parentheses from Python files (#10967) |
| 8baf657fc2 | 2020-10-09 | Fix regression in DataflowTemplatedJobStartOperator (#11167) |
| b0fcf67559 | 2020-10-07 | Add AzureFileShareToGCSOperator (#10991) |
| 47b05a87f0 | 2020-10-07 | Improve handling of job_id in BigQuery operators (#11287) |
| 0a0e1af800 | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
| ca4238eb4d | 2020-10-02 | Fixed month in backport packages to October (#11242) |
| 5220e4c384 | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
| cb52fb0ae1 | 2020-09-27 | Add example DAG and system test for MySQLToGCSOperator (#10990) |
| 99accec29d | 2020-09-25 | Fix incorrect Usage of Optional[str] & Optional[int] (#11141) |
| e3f96ce7a8 | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
| daf8f31080 | 2020-09-23 | Add template fields renderers for better UI rendering (#11061) |
| f3e87c5030 | 2020-09-22 | Add D202 pydocstyle check (#11032) |
| cb979f9f21 | 2020-09-22 | Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024) |
| 76545bb3d6 | 2020-09-16 | Add example dag and system test for S3ToGCSOperator (#10951) |
| 22c631625f | 2020-09-16 | Fix more docs spellings (#10965) |
| 12a652f534 | 2020-09-13 | Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869) |
| 41a62735ed | 2020-09-11 | Add on_kill method to BigQueryInsertJobOperator (#10866) |
| 3e91da56e8 | 2020-09-11 | fix typo in firebase/example_filestore DAG (#10875) |
| 68cc7273bf | 2020-09-10 | Add on_kill method to DataprocSubmitJobOperator (#10847) |
| f920957214 | 2020-09-10 | Fix and remove some more typos from spelling_wordlist.txt (#10845) |
| 9549274d11 | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
| 078bfaf60a | 2020-09-08 | Extract missing gcs_to_local example DAG from gcs example (#10767) |
| 10ce31127f | 2020-09-08 | Deprecate using global as the default region in Google Dataproc operators and hooks (#10772) |
| f14f379716 | 2020-09-07 | [AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773) |
| c8ee455685 | 2020-09-07 | Refactor DataprocCreateCluster operator to use simpler interface (#10403) |
| ece685b5b8 | 2020-09-05 | Asynchronous execution of Dataproc jobs with a Sensor (#10673) |
| 6e3d7b63d3 | 2020-09-04 | Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578) |
| 804548d58f | 2020-09-01 | Add Dataprep operators (#10304) |
| 11c00bc820 | 2020-08-30 | Fix typos: duplicated "the" (#10647) |
| 2ca615cffe | 2020-08-29 | Update Google Cloud branding (#10642) |
| 1b533f617e | 2020-08-28 | Fix broken master - DLP (#10635) |
| 5ae82a56da | 2020-08-28 | Fix Google DLP example and improve ops idempotency (#10608) |
| 3867f76625 | 2020-08-28 | Update Google Cloud branding (#10615) |
| 91ff31ad10 | 2020-08-27 | Documentation for Google Cloud Data Loss Prevention (#8201) (#9651) |
| fdd9b6f65b | 2020-08-25 | Enable Black on Providers Packages (#10543) |
| d760265452 | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
| d1bce91bb2 | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
| 866701c801 | 2020-08-25 | Fix typo in "Cloud" (#10534) |
| 47265e7b58 | 2020-08-24 | Fix typo in PostgresHook (#10529) |
| 3696c34c28 | 2020-08-24 | Fix typo in the word "release" (#10528) |
| 2f2d8dbfaf | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
| 3734876d98 | 2020-08-24 | Implement impersonation in google operators (#10052) |
| b0598b5351 | 2020-08-24 | Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475) |
| ee7ca128a1 | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
| 515cc72c99 | 2020-08-22 | Fix typo in timed_out (#10459) |
| 7c206a82a6 | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
| 88c7d2e526 | 2020-08-21 | Dataflow operators don't not always create a virtualenv (#10373) |
| 083c3c129b | 2020-08-18 | Simplified GCSTaskHandler configuration (#10365) |
| 1ae5bdf23e | 2020-08-17 | Add test for GCSTaskHandler (#9600) (#9861) |
| e195a980bc | 2020-08-16 | Add type annotations for mlengine_operator_utils (#10297) |
| 382c1011b6 | 2020-08-16 | Add Bigtable Update Instance Hook/Operator (#10340) |
| bfa5a8d5f1 | 2020-08-15 | CI: Fix failing docs-build (#10342) |
| be46d20fb4 | 2020-08-15 | Improve idempotency of BigQueryInsertJobOperator (#9590) |
| 47387a69e6 | 2020-08-14 | Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326) |
| 2f0613b0c2 | 2020-08-13 | Implement Google BigQuery Table Partition Sensor (#10218) |
| f6734b3b85 | 2020-08-12 | Enable Sphinx spellcheck for doc generation (#10280) |
| 8f8db8959e | 2020-08-12 | DbApiHook: Support kwargs in get_pandas_df (#9730) |
| ef088314f8 | 2020-08-09 | Added DataprepGetJobsForJobGroupOperator (#10246) |
| b43f90abf4 | 2020-08-09 | Fix various typos in the repo (#10263) |
| c29533888f | 2020-08-08 | Add labels param to Google MLEngine Operators (#10222) |
| cdec301254 | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
| eff0f03210 | 2020-08-06 | `` Update guide for Google Cloud Secret Manager Backend (#10172)`` |
| 24c8e4c2d6 | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
| 010322692e | 2020-08-06 | Improve handling Dataproc cluster creation with ERROR state (#9593) |
| 1437cb7495 | 2020-08-04 | Add correct signatures for operators in google provider package (#10144) |
| 6efa1b9cb7 | 2020-08-03 | Add additional Cloud Datastore operators (#10032) |
| 27020f8e58 | 2020-08-03 | Add try clause to DataFusionHook.wait_for_pipeline_state (#10031) |
| 4e3799fec4 | 2020-08-02 | [AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117) |
| 85c56b1737 | 2020-08-02 | Add missing params to GCP Pub/Sub creation_subscription (#10106) |
| b79466c12f | 2020-08-02 | Fix sensor not providing arguments for GCSHook (#10074) |
| 4ee35d0279 | 2020-08-02 | Fix hook not passing gcp_conn_id to base class (#10075) |
| aeea71274d | 2020-08-02 | Remove 'args' parameter from provider operator constructors (#10097) |
| 4c84661adb | 2020-07-31 | Split Display Video 360 example into smaler DAGs (#10077) |
| 59cbff0874 | 2020-07-29 | Fix docstrings in BigQueryGetDataOperator (#10042) |
| 81b87d48ed | 2020-07-27 | Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996) |
| 7d24b088cd | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
| 8b10a4b35e | 2020-07-25 | Stop using start_date in default_args in example_dags (#9982) |
| ef98edf4da | 2020-07-23 | Add more information about using GoogleAdsHook (#9951) |
| 33f0cd2657 | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
| 39a0288a47 | 2020-07-22 | Add Google Authentication for experimental API (#9848) |
| c2db0dfeb1 | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
| c4244e18bb | 2020-07-22 | Fix calling 'get_client' in BigQueryHook.table_exists (#9916) |
| 5eacc16420 | 2020-07-22 | Add support for impersonation in GCP hooks (#9915) |
| 1cfdebf5f8 | 2020-07-21 | Fix insert_job method of BigQueryHook (#9899) |
| c8c52e69c8 | 2020-07-21 | Remove type hint causing DeprecationWarning in Firestore operators (#9819) |
| eb6f1d1cf0 | 2020-07-16 | Fix typo in datafusion operator (#9859) |
| b01d95ec22 | 2020-07-15 | Change DAG.clear to take dag_run_state (#9824) |
| 6d65c15d15 | 2020-07-15 | Add guide for AI Platform (previously Machine Learning Engine) Operators (#9798) |
| 770de53eb5 | 2020-07-15 | BigQueryTableExistenceSensor needs to specify keyword arguments (#9832) |
| 2d8dbacdf6 | 2020-07-15 | Add CloudVisionDeleteReferenceImageOperator (#9698) |
| 9f017951b9 | 2020-07-15 | Add Google Deployment Manager Hook (#9159) |
| ed5004cca7 | 2020-07-14 | Allow 'replace' flag in gcs_to_gcs operator. (#9667) |
| 553bb7af7c | 2020-07-13 | Keep functions signatures in decorators (#9786) |
| 68925904e4 | 2020-07-13 | Add multiple file upload functionality to GCS hook (#8849) |
| 1de78e8f97 | 2020-07-12 | Add Google Stackdriver link (#9765) |
| 092d33f298 | 2020-07-11 | Fix StackdriverTaskHandler + add system tests (#9761) |
| b2305660f0 | 2020-07-09 | Update example DAG for AI Platform operators (#9727) |
| 23f80f34ad | 2020-07-08 | Move gcs & wasb task handlers to their respective provider packages (#9714) |
| 44d4ae809c | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
| a79e2d4c4a | 2020-07-06 | Move provider's log task handlers to the provider package (#9604) |
| cd3d9d9340 | 2020-07-02 | Fix using .json template extension in GMP operators (#9566) |
| 4799af30ee | 2020-06-30 | Extend BigQuery example with include clause (#9572) |
| e33f1a12d7 | 2020-06-30 | Add template_ext to BigQueryInsertJobOperator (#9568) |
| 40add26d45 | 2020-06-29 | Remove almost all references to airflow.contrib (#9559) |
| c420dbd6e1 | 2020-06-27 | Bump Pylint to 2.5.3 (#9294) |
| 0051c89cba | 2020-06-26 | nitpick fix (#9527) |
| 87fdbd0708 | 2020-06-25 | Use literal syntax instead of function calls to create data structure (#9516) |
| 7256f4caa2 | 2020-06-22 | Pylint fixes and deprecation of rare used methods in Connection (#9419) |
| e13a14c873 | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
| 5b680e27e8 | 2020-06-19 | Don't use connection to store task handler credentials (#9381) |
| d0e7db4024 | 2020-06-19 | Fixed release number for fresh release (#9408) |
| 416334e2ec | 2020-06-19 | Properly propagated warnings in operators (#9348) |
| 12af6a0800 | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
| c7e5bce57f | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
| 4e09c64423 | 2020-06-18 | Adds GCP Secret Manager Hook (#9368) |
| 40bf8f28f9 | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
| f6bd817a3a | 2020-06-16 | Introduce 'transfers' packages (#9320) |
| 639972d995 | 2020-06-16 | Add support for latest Apache Beam SDK in Dataflow operators (#9323) |
| 1459970b3b | 2020-06-15 | Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314) |
| 431ea3291c | 2020-06-15 | Resolve upstream tasks when template field is XComArg (#8805) |
| aee6ab94eb | 2020-06-15 | Wait for pipeline state in Data Fusion operators (#8954) |
| fb1c8b83d4 | 2020-06-10 | Add test for BQ operations using location (#9206) |
| a26afbfa51 | 2020-06-10 | Make generated job_id more informative in BQ insert_job (#9203) |
| c41192fa1f | 2020-06-10 | Upgrade pendulum to latest major version ~2.0 (#9184) |
| b1c8c5ed5b | 2020-06-09 | Allows using private endpoints in GKEStartPodOperator (#9169) |
| 5918efc86a | 2020-06-05 | Add 3.8 to the test matrices (#8836) |
| 9bcdadaf7e | 2020-06-05 | Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154) |
| f56811dff3 | 2020-06-05 | [AIRFLOW-6290] Create guide for GKE operators (#8883) |
| 76962867b5 | 2020-06-04 | Fix sql_to_gcs hook gzip of schema_file (#9140) |
| 17adcea835 | 2020-06-02 | Fix handling of subprocess error handling in s3_file_transform and gcs (#9106) |
| 7898525468 | 2020-06-01 | Add BigQueryInsertJobOperator (#8868) |
| 29eb68b90b | 2020-05-31 | Create guide for Dataproc Operators (#9037) |
| 886afaf622 | 2020-05-29 | Add example dag and system test for LocalFilesystemToGCSOperator (#9043) |
| a779c4dfc2 | 2020-05-29 | add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066) |
| ada26be23c | 2020-05-29 | Add correct description for dst param in LocalFilesystemToGCSOperator (#9055) |
| 81b2761b86 | 2020-05-29 | add example dag and system test for GoogleSheetsToGCSOperator (#9056) |
| 0b0e4f7a4c | 2020-05-26 | Preparing for RC3 relase of backports (#9026) |
| 00642a46d0 | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
| 3994030ea6 | 2020-05-26 | Refactor BigQuery operators (#8858) |
| cdb3f25456 | 2020-05-26 | All classes in backport providers are now importable in Airflow 1.10 (#8991) |
| 1d36b0303b | 2020-05-23 | Fix references in docs (#8984) |
| cf5cf45e1c | 2020-05-23 | Support YAML input for CloudBuildCreateOperator (#8808) |
| 499493c5c5 | 2020-05-19 | [AIRFLOW-6586] Improvements to gcs sensor (#7197) |
| 375d1ca229 | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
| 841d816647 | 2020-05-19 | Allow setting the pooling time in DLPHook (#8824) |
| 12c5e5d8ae | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
| f3521fb0e3 | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
| 15273f0ea0 | 2020-05-16 | Check for same task instead of Equality to detect Duplicate Tasks (#8828) |
| 92585ca4cb | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
| e1e833bb26 | 2020-05-13 | Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816) |
| 8b54919711 | 2020-05-12 | Refactor BigQuery hook methods to use python library (#8631) |
| 6911dfe837 | 2020-05-12 | Fix template fields in Google operators (#8840) |
| 4b06fde0f1 | 2020-05-12 | Fix Flake8 errors (#8841) |
| 1d12c347cb | 2020-05-12 | Refactor BigQuery check operators (#8813) |
| 493b685d78 | 2020-05-10 | Add separate example DAGs and system tests for google cloud speech (#8778) |
| 79ef8bed89 | 2020-05-10 | Added Upload Multiple Entity Read Files to specified big query dataset (#8610) |
| 280f1f0c4c | 2020-05-10 | Correctly restore upstream_task_ids when deserializing Operators (#8775) |
| 58aefb23b1 | 2020-05-08 | Added SDFtoGCSOperator (#8740) |
| 723c52c942 | 2020-05-07 | Add documentation for SpannerDeployInstanceOperator (#8750) |
| 25ee4211b3 | 2020-05-06 | Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531) |
| 8d6f1aa4b5 | 2020-05-05 | Support num_retries field in env var for GCP connection (#8700) |
| 67caae0f25 | 2020-05-04 | Add system test for gcs_to_bigquery (#8556) |
| bc45fa6759 | 2020-05-03 | Add system test and docs for Facebook Ads operators (#8503) |
| a28c66f23d | 2020-04-30 | [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625) |
| 992a24ce41 | 2020-04-28 | Split and improve BigQuery example DAG (#8529) |
| c1fb28230f | 2020-04-28 | Refactor BigQueryHook dataset operations (#8477) |
| e8d0f8feab | 2020-04-26 | Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430) |
| 37fdfa9775 | 2020-04-26 | [AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442) |
| 14b22e6ffe | 2020-04-25 | Add hook and operator for Google Cloud Life Sciences (#8481) |
| 72ddc94d1e | 2020-04-23 | Pass location using parmamter in Dataflow integration (#8382) |
| 912aa4b423 | 2020-04-23 | Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174) |
| 57c8c05839 | 2020-04-22 | Use python client in BQ hook create_empty_table/dataset and table_exists (#8377) |
| 5d3a7eef30 | 2020-04-20 | Allow multiple extra_packages in Dataflow (#8394) |
| 79c99b1b6a | 2020-04-18 | Added location parameter to BigQueryCheckOperator (#8273) |
| 79d3f33c1b | 2020-04-17 | Clean up temporary files in Dataflow operators (#8313) |
| efcffa323d | 2020-04-16 | Add Dataproc SparkR Example (#8240) |
| b198a1fa94 | 2020-04-15 | Create guide for BigQuery operators (#8276) |
| 2636cc932c | 2020-04-14 | Raise exception when GCP credential doesn't support account impersonation (#8213) |
| eee4ebaeeb | 2020-04-14 | Added Facebook Ads Operator #7887 (#8008) |
| 8cae07ea18 | 2020-04-14 | fixed typo (#8294) |
| 45c8983306 | 2020-04-13 | Less aggressive eager upgrade of requirements (#8267) |
| 1fd9ed3840 | 2020-04-13 | Add mypy plugin for decorators. (#8145) |
| 327b0a9f77 | 2020-04-13 | Added GoogleDisplayVideo360UploadLineItemsOperator (#8216) |
| bb5e403a32 | 2020-04-10 | Honor schema type for MySQL to GCS data pre-process (#8090) |
| 87969a350d | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
| 3fc89f29f5 | 2020-04-06 | [AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849) |
| 7ef75d2393 | 2020-04-03 | [AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049) |
| ed2bc00576 | 2020-04-02 | Add Google Ads list accounts operator (#8007) |
| 3808a6206e | 2020-04-01 | Unify Google class/package names (#8033) |
| 8a02402576 | 2020-03-31 | Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011) |
| 8e89780071 | 2020-03-31 | Add more refactor steps for providers.google (#8010) |
| aae3b8fb27 | 2020-03-31 | Individual package READMEs (#8012) |
| 779023968f | 2020-03-30 | [AIRFLOW-7075] Operators for storing information from GCS into GA (#7743) |
| 49abce5217 | 2020-03-30 | Improve system tests for Cloud Build (#8003) |
| 0f19a930d1 | 2020-03-29 | Remove GKEStartPodOperator when backporting (#7908) |
| 0e1c238b2f | 2020-03-28 | Get Airflow Variables from GCP Secrets Manager (#7946) |
| eb4af4f944 | 2020-03-28 | Make BaseSecretsBackend.build_path generic (#7948) |
| 01f99426fd | 2020-03-28 | Add download/upload operators for GCS and Google Sheets (#7866) |
| 892522f8e2 | 2020-03-26 | Change signature of GSheetsHook methods (#7853) |
| bfd425157a | 2020-03-26 | Improve idempotency in MLEngineHook.create_model (#7811) |
| f9c226343d | 2020-03-26 | Fix CloudSecretsManagerBackend invalid connections_prefix (#7861) |
| e3920f12f4 | 2020-03-26 | Improve setUp/tearDown in Cloud Firestore system test (#7862) |
| 8ba8a7295a | 2020-03-26 | Improve example DAGs for Cloud Memorystore (#7855) |
| f7d1a437c1 | 2020-03-26 | Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856) |
| beef6c230e | 2020-03-26 | Improve authorization in GCP system tests (#7863) |
| 5f165f3e42 | 2020-03-26 | [AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869) |
| 686d7d50bd | 2020-03-25 | Standardize SecretBackend class names (#7846) |
| 1982c3fdca | 2020-03-24 | Run Dataflow for ML Engine summary in venv (#7809) |
| eef87b9953 | 2020-03-23 | [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830) |
| 529db07b2e | 2020-03-23 | Improve Google PubSub hook publish method (#7831) |
| 4bde99f132 | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
| a001489b59 | 2020-03-23 | Improve example DAG for ML Engine (#7810) |
| 9e5a8e7f83 | 2020-03-23 | Add call to Super class in 'google' providers (#7823) |
| b86bf79bff | 2020-03-23 | Fix typo in GCP credentials_provider's docstring (#7818) |
| 56c013ce92 | 2020-03-23 | Add missing docstring in BigQueryHook.create_empty_table (#7817) |
| 426a79847c | 2020-03-23 | Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812) |
| cdf1809fce | 2020-03-23 | [AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795) |
| 27dac00e12 | 2020-03-22 | [AIRFLOW-7099] Improve system test for cloud transfer service (#7794) |
| 0daf5d729a | 2020-03-22 | Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791) |
| c8088c2bd7 | 2020-03-20 | [AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781) |
| 5106a29314 | 2020-03-20 | [AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748) |
| 759ce2a80c | 2020-03-20 | [AIRFLOW-6978] Add PubSubPullOperator (#7766) |
| 6b9b214e4c | 2020-03-20 | [AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692) |
| b118916969 | 2020-03-19 | [AIRFLOW-7069] Fix cloudsql system tests (#7770) |
| ae854cae5a | 2020-03-19 | [AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756) |
| 7e1e954d23 | 2020-03-19 | [AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759) |
| 6e21c139b3 | 2020-03-19 | [AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762) |
| ce022a3f72 | 2020-03-19 | [AIRFLOW-XXXX] Add cross-references for operators guide (#7760) |
| 029c84e552 | 2020-03-18 | [AIRFLOW-5421] Add Presto to GCS transfer operator (#7718) |
| 63a3102ede | 2020-03-18 | [AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725) |
| 73305c7bd5 | 2020-03-18 | [AIRFLOW-7081] Remove env variables from GCP guide (#7755) |
| 60fdbf6d92 | 2020-03-18 | [AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728) |
| de7e934ca3 | 2020-03-17 | [AIRFLOW-7079] Remove redundant code for storing template_fields (#7750) |
| 0de0347b27 | 2020-03-17 | [AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475) |
| 91557c6f87 | 2020-03-17 | [AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738) |
| 51161dbd9d | 2020-03-16 | [AIRFLOW-5664] Store timestamps with microseconds precision (#6354) |
| 2bc020c431 | 2020-03-14 | [AIRFLOW-7055] Verbose logging option for google provider (#7711) |
| c997cab42d | 2020-03-13 | [AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630) |
| 137896f326 | 2020-03-12 | [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685) |
| 1f77f943d5 | 2020-03-10 | [AIRFLOW-6980] Improve system tests and building providers package (#7615) |
| bf9b6b6d70 | 2020-03-09 | [AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664) |
| e5130dc9fe | 2020-03-09 | [AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659) |
| faf0df4b94 | 2020-03-09 | [AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666) |
| 42eef38217 | 2020-03-07 | [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506) |
| b5b9795f04 | 2020-03-07 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624) |
| 6b65038fb4 | 2020-03-06 | [AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631) |
| 755fe52249 | 2020-03-05 | [AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535) |
| cb2f339116 | 2020-03-04 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609) |
| 09fea3ce8e | 2020-03-04 | [AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612) |
| 8230ccc48b | 2020-03-04 | [AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547) |
| 0d1e3088aa | 2020-03-04 | [AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604) |
| ab6bb0012c | 2020-03-03 | [AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607) |
| 3db4ade3dc | 2020-02-29 | [AIRFLOW-6924] Fix Google DLP operators return types (#7546) |
| 008b4bab14 | 2020-02-27 | [AIRFLOW-6730] Use total_seconds instead of seconds (#7363) |
| bb552b2d9f | 2020-02-25 | [AIRFLOW-6908] Lazy load AirflowException (#7528) |
| d1a34246ac | 2020-02-25 | [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322) |
| 3320e432a1 | 2020-02-24 | [AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517) |
| dcf8743521 | 2020-02-24 | [AIRFLOW-6894] Prevent db query in example_dags (#7516) |
| 4d03e33c11 | 2020-02-22 | [AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456) |
| 35b9616378 | 2020-02-21 | [AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486) |
| aff3a361b4 | 2020-02-20 | [AIRFLOW-6558] Campaign Manager operators for conversions (#7420) |
| 9cbd7de6d1 | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
| 5b199cb86b | 2020-02-17 | [AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429) |
| 2c9345a8e0 | 2020-02-17 | [AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400) |
| 946bdc23c0 | 2020-02-16 | [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126) |
| 2381c820c8 | 2020-02-13 | [AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399) |
| 04c1fefbf2 | 2020-02-03 | [AIRFLOW-6676] added GCSDeleteBucketOperator (#7307) |
| a0252748ff | 2020-02-03 | [AIRFLOW-6717] Remove non-existent field from templated_fields (#7340) |
| 97a429f9d0 | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
| 9d8d075578 | 2020-02-03 | [AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337) |
| cf141506a2 | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
| 373c6aa4a2 | 2020-01-30 | [AIRFLOW-6682] Move GCP classes to providers package (#7295) |
| 83c037873f | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
| 057f3ae3a4 | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
| ceea293c16 | 2020-01-28 | [AIRFLOW-6656] Fix AIP-21 moving (#7272) |
| c42a375e79 | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
| 059eda05f8 | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
| f4d3e5e545 | 2020-01-13 | [AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151) |
| e7bf8ecb48 | 2020-01-13 | [AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125) |
| 5b6772cb83 | 2020-01-09 | [AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112) |
| 4f8592ae8f | 2020-01-08 | [AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046) |
| 20299473f1 | 2020-01-03 | [AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020) |
| 18e8cea4e7 | 2020-01-03 | [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007) |
| 95087af140 | 2019-12-31 | [AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968) |
| 69629a5a94 | 2019-12-09 | [AIRFLOW-5807] Move SFTP from contrib to providers. (#6464) |
| 25e9047a4a | 2019-12-09 | [AIRFLOW-6193] Do not use asserts in Airflow main code (#6749) |
| ed0a14f321 | 2019-12-09 | [AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734) |
| 2f2f89c148 | 2019-12-01 | [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701) |
| 03c870a617 | 2019-11-26 | [AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601) |
| 5c4cfea8c0 | 2019-11-15 | [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393) |
| 44a8c37a9a | 2019-11-13 | [AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581) |
| d633d3ac44 | 2019-11-13 | [AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371) |
| d985c02d9f | 2019-11-05 | [AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497) |
| a296cdabdb | 2019-11-04 | [AIRFLOW-5743] Move Google PubSub to providers package (#6476) |
| 470b2a779d | 2019-10-30 | [AIRFLOW-5741] Move Cloud Natural Language to providers (#6421) |
| f2caa451fc | 2019-10-27 | [AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424) |
| 16d7accb22 | 2019-10-22 | [AIRFLOW-4971] Add Google Display & Video 360 integration (#6170) |
| 4e661f535d | 2019-10-22 | [AIRFLOW-5379] Add Google Search Ads 360 operators (#6228) |
| 19e32b4e2c | 2019-10-18 | [AIRFLOW-5656] Rename provider to providers module (#6333) |