- Add
UniversalTransferOperator
that allows data transfers between supported source and target Datasets in Apache Airflow. The supported datasets are:File
andTable
. It offers a consistent agnostic interface, simplifying the users' experience, so they do not need to use specific providers or operators for transfers. #1492 , #1619 - Add transfer support for the following databases:
Databases | Transfer Mode supported | Pull Request |
---|---|---|
SQLite | non-native, third-party | #1731 |
Google BigQuery | non-native, third-party | #1732 |
Snowflake | non-native, third-party | #1735 |
- Add transfer support for the following filesystems:
File stores | Transfer Mode supported | Pull Request |
---|---|---|
Amazon S3 | non-native, third-party | #1492, #1621 |
Local | non-native, third-party | #1735 |
Google GCS | non-native, third-party | #1492, #1621 |
SFTP | non-native | #1725, #1866 |