- DockerPipelineOperator: add cleanup_output_folder parameter.
- Update to Apache Airflow 1.8.1
- Improve values in pipeline XComs
- SpmPipelineOperator inherits from SpmOperator
- Remove dataset argument from ScanFlatFolderPipelineOperator
- Refactor airflow_scan_operator package.
- All operators prefixed with 'Scan'
- Add ScanFlatFolderPipelineOperator
- Add extract_context_callable to extract information from the paths, removes the need for special operators to scan organised / non organised folders
- Add data_config parameter to PythonPipelineOperator
- Add provenance tracking to Python pipeline operator
- Optional output volume for Docker Pipeline operator