You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Apr 11, 2024. It is now read-only.
Describe the bug
There are two scenarios that need the fix:
When the source dataset is a file pattern or folder (eg: s3://dummy-bucket/folder/) and the destination dataset is a file, it should error out but currently, it would concatenate the file with that name.
While checking for file patterns we currently use pathlib library but we should also add checks using underlying provider library to correctly validate if it is a file or a file pattern.
Expected behavior
A clear and concise description of what you expected to happen.
Error out the source dataset is a file pattern or folder (eg: s3://dummy-bucket/folder/) and the destination dataset is a file.
Eg:
Describe the bug
There are two scenarios that need the fix:
s3://dummy-bucket/folder/
) and the destination dataset is a file, it should error out but currently, it would concatenate the file with that name.pathlib
library but we should also add checks using underlying provider library to correctly validate if it is a file or a file pattern.Expected behavior
A clear and concise description of what you expected to happen.
s3://dummy-bucket/folder/
) and the destination dataset is a file.Eg:
More details at: notion doc
The text was updated successfully, but these errors were encountered: