Skip to content

Releases: transferwise/pipelinewise

0.34.1 (2021-07-15)

16 Jul 10:23
812cf2b
Compare
Choose a tag to compare
  • Bump pipelinewise-target-snowflake from 1.13.0 to 1.13.1
    • Fixed an issue with S3 metadata required for decryption not being included in archived load files
  • Fixed an issue in fastsync to BigQuery data type mapping
  • Add location config parameter to fastsync to BigQuery

0.34.0 (2021-06-24)

25 Jun 08:05
0b9ae52
Compare
Choose a tag to compare
  • Add split_large_files option to FastSync target-snowflake to load large files in parallel into Snowflake
  • Add archive_load_files option to FastSync target-snwoflake to archive load files on S3
  • Bump pipelinewise-tap-postgres from 1.7.1 to 1.8.0
    • Add discovering of partitioned table
  • Bump pipelinewise-target-snowflake from 1.12.0 to 1.13.0
    • Add archive_load_files parameter to optionally archive load files on S3

0.33.0 (2021-04-12)

12 Apr 14:41
ac926d7
Compare
Choose a tag to compare
  • Add batch_wait_limit_seconds option to every tap/target combination
  • Bump pipelinewise-target-snowflake from 1.11.1 to 1.12.0
    • Add batch_wait_limit_seconds option
  • Bump pipelinewise-tap-mysql from 1.4.2 to 1.4.3
  • Bump a few vulnerable and security outdated packages

0.32.1 (2021-04-02)

02 Apr 17:05
3ab39dc
Compare
Choose a tag to compare
  • Bump pipelinewsie-target-snowflake from 1.11.0 to 1.11.1
    • Run SHOW FILE FORMATS SQL only once

0.32.0 (2021-03-22)

22 Mar 13:30
12a4bfd
Compare
Choose a tag to compare
  • Add transformation validation post import check to detect and deny load time transformations that's changing data types
  • Fixed an issue when fastsync to Postgres and Snowflake were failing if multiple load time transformations defined on the same column
  • Fixed an issue when fastsync not using unique file names and causing table name collision in the target database
  • Bump pipelinewise-tap-mysql from 1.4.0 to 1.4.2
    • Fixed an issue when data sometimes lost during LOG_BASED replication
  • Bump pipelinewise-tap-twilio from 1.1.1 to 1.1.2
    • Fix missing elements for streams without ordered response
  • Bump pipelinewsie-target-snowflake from 1.10.1 to 1.11.0

0.31.1 (2021-02-26)

26 Feb 09:46
148b0e1
Compare
Choose a tag to compare

Add support for AWS profile based authentication to FastSync tap-s3-csv.

0.31.0 (2021-02-23)

23 Feb 15:01
1eadbf2
Compare
Choose a tag to compare
  • Update TransferWise references to Wise
  • Bump pipelinewise-tap-twilio to 1.1.1
  • Bump psycopg-binary from 2.8.5 to 2.8.6

0.30.0 (2021-01-22)

22 Jan 12:34
7249eaa
Compare
Choose a tag to compare
  • Drop postgres replication slot in case of full re-sync of a tap
  • Add fastsync_parallelism optional parameter to customize the number of cores to use for parallelisation in FastSync
  • Bump pipelinewise-tap-twilio to 1.0.2

0.29.0 (2021-01-13)

15 Jan 12:51
7b8418a
Compare
Choose a tag to compare
  • Add tap-twilio

0.28.1 (2021-01-12)

12 Jan 12:09
0ba0c21
Compare
Choose a tag to compare
  • patch pipelinewise-tap-snowflake
  • Bumping dependencies of Pipelinewise