AzCopy v10.22.0

Version 10.22.0

New Features

1. Migrated to the latest azdatalake SDK.
2. Added support for OAuth when performing File -> File and Blob -> File copy/sync and File make/list/remove (#2302).
3. Added support to set tier on premium block blob accounts. (#2337)
4. Added support to cache latest AzCopy version and check the remote version every 24 hours instead of every run. (#2426)
5. Updated all SDK dependencies to their latest version and the default service version to 2023-08-03 for all services. (#2402)
6. Added support to rotate AzCopy logs. (#2213)
7. Added support to authenticate with Powershell and Azure CLI credentials. (#2433)

Bug Fixes

1. Fixed an issue where http headers and access tier would sometimes be sent as empty headers.
2. Fixed an issue where AzCopy would panic when passing an un-parseable URL. (#2404)
3. Fixed an issue where Object ID would be set as Resource ID when using MSI. (#2395)
4. Fixed an issue where the percent complete stat could round incorrectly. (#1078)
5. Fixed an issue where no transfers were scheduled would be logged as an error, it is now logged as a warning. (#874)
6. Fixed an issue where non canonicalized headers would not be printed in the log. (#2454)
7. Fixed an issue where cold tier would not be recognized as an allowed tier. (#2447)
8. Fixed an issue where s2s append blob copies would fail with AppendPositionConditionNotMet error on retry after first experiencing a service timeout error. (#2430)
9. Fixed an issue where AZCOPY_OAUTH_TOKEN_INFO would not be refreshed. (#2434)

Documentation

1. Updated --preserve-permissions documentation to indicate the correct roles necessary to perform the operation. (#2440)
2. Updated help message for sync and copy to include all ADLS Gen2 supported auth methods. (#2440)

Security fixes

1. Updated dependencies to address security vulnerabilities.

AzCopy v10.21.2

Version 10.21.2

Security fixes

1. Updated dependencies to address security vulnerabilities.

AzCopy v10.21.1

Version 10.21.1

Bug Fixes

1. Fixed an issue where validating destination length would fail a job instead of logging the error if read permissions are not provided.

AzCopy v10.22.0-Preview

Version 10.22.0-Preview

New Features

1. Migrated to the latest azdatalake SDK.

Bug Fixes

1. Fixed an issue where http headers and access tier would sometimes be sent as empty headers.
2. Fixed an issue where AzCopy would panic when passing an un-parseable URL. (#2404)

Security fixes

1. Updated dependencies to address security vulnerabilities.

AzCopy v10.21.0

Change Log

Version 10.21.0

New Features

1. Migrated to the latest azblob SDK.
2. Migrated to the latest azfile SDK.
3. Migrated from deprecated ADAL to MSAL through the latest azidentity SDK.
4. Added support for sync with Azure Data Lake Storage Gen2. (#2376)

Bug Fixes

1. Fixed an issue where ACL data would not copy when specifying *.dfs.core.windows.net endpoints (#2347).
2. Fixed an issue where Sync would incorrectly log that all files, even those that didn't get overwritten, would be overwritten. (#2372)

Documentation

1. Updated --dry-run documentation to indicate the effects of --overwrite are ignored. (#2325)

Special notes

1. Due to the migration from ADAL to MSAL, tenant ID must now be set when authorizing with single tenant applications created after 10/15/2018.

AzCopy v10.21.0 Preview

Version 10.21.0-Preview

New Features

1. Migrated to the latest azblob SDK.
2. Migrated to the latest azfile SDK.
3. Migrated from deprecated ADAL to MSAL through the latest azidentity SDK.
4. Deprecated support for object IDs in MSI. Client ID or Resource ID can be used as an alternative.

Special notes

1. Due to the migration from ADAL to MSAL, tenant ID must now be set when authorizing with single tenant applications created after 10/15/2018.

AzCopy v10.20.1

Version 10.20.1

Bug Fixes

1. Fixed an issue where LMT data is not returned on list command for Azure Files.

AzCopy v10.20.0

Change Log

Version 10.20.0

New Features

1. Mac M1/M2 Support
2. Force small blobs to use PutBlob for any source.
3. Support to delete CPK encrypted blobs.
4. Support to follow symlinks when --preserve-smb-permissions is enabled.
5. Support to return LMT data on list command for Azure Files.

Bug Fixes

1. Fixed an issue where source trailing dot header was passed when source for a S2S copy is not file service
2. Gracefully handle File Share trailing dot paths to Windows/Blob (that do not support trailing dot) by skipping such files
3. Allow trailing dot option to be ignored instead of erroring out in situations it does not apply.
4. Issue #2186 where AzCopy would panic when using --include-before and --include-after flags on remove file share resources.
5. Issue #2183 where AzCopy would panic when providing Azure Files URLs with no SAS token.
6. Fixed a bug where AzCopy would automatically assume a HNS path to be a file if the path did not have a slash terminator.
7. Fixed an issue where --skip-version-check would not be honored for login, logout, help commands. #2299

Documentation

1. Add a log for LMTs when a mismatch is encountered.
2. Added documentation indicating the login and logout commands will be deprecated in the future.

Security fixes

1. Updated dependencies to address security vulnerabilities.

What's Changed

• Mac M1 Beta Release by @tasherif-msft in #2239
• Code coverage and tests on e2e tests by @gapra-msft in #2225
• Resolved a few trailing dot issues by @gapra-msft in #2248
• Make pipeline fail when e2e tests fail by @gapra-msft in #2261
• Prevent panic on remove with include before param on file share accounts by @gapra-msft in #2270
• Return error on failure to split URL by @gapra-msft in #2271
• Updated dependencies by @gapra-msft in #2286
• Force small blobs to use PutBlob for all sources by @nakulkar-msft in #2250
• Handle DFS directories without path separator by @nakulkar-msft in #2280
• chore: unnecessary use of fmt.Sprintf by @testwill in #2277
• Add additional log when LMT mismatch is seen by @nakulkar-msft in #2306
• Added support to delete CPK encrypted blobs by @gapra-msft in #2304
• Added skip version check before calling beginDetectNewVersion by @gapra-msft in #2301
• Bump google.golang.org/grpc from 1.51.0 to 1.53.0 by @dependabot in #2284
• chore: slice replace loop by @testwill in #2278
• Support follow-symlinks SMB properties by @adreed-msft in #2258
• Pull properties to support extra data on Azure Files by @adreed-msft in #2256
• Deprecate login command by @nakulkar-msft in #2310
• Updated version and changelog for 10.20.0 release by @gapra-msft in #2312

New Contributors

• @testwill made their first contribution in #2277
• @dependabot made their first contribution in #2284

Full Changelog: v10.19.0...v10.20.0

AzCopy v10.19.0 MacOS ARM Preview

A native build of 10.19.0 targeting Apple Silicon Macs has been released.

A temporary download link is available here.

Documentation located at https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-v10 will be updated shortly to include references to the preview build.

AzCopy v10.19.0

Version 10.19.0

New Features

1. Support for new Cold Tier feature for Azure Blobs (--block-blob-tier=Cold)
2. Support preserving a trailing dot ('.') in names of files and directories in Azure Files (default is --trailing-dot=Enable)
3. Alternate modes to preserve hash for hash-based sync (#2214) (default is OS-dependent, either --local-hash-storage-mode=XAttr on MacOS/Linux or --local-hash-storage-mode=AlternateDataStreams on Windows)
   • OS-specific hashing modes are expected to be available on all filesystems the source would traverse. (user_xattr enabled on filesystems on Unix systems, FILE_NAMED_STREAMS flag expected on Windows volumes)
   • HiddenFiles provides an OS-agnostic method to store hash data; to prevent "dirtying" the source, also specify --hash-meta-dir directing AzCopy to store & read hidden hash metadata files elsewhere.
4. Support 'force-if-readonly' flag for Sync. (false by default)
5. Preserve posix properties while uploading or downloading from HNS enabled accounts (--preserve-posix-properties, false by default.)

Bug Fixes

1. Fix situation where large-files would hang infinitely with low value for 'cap-mbps'
2. Issue #2074 where AzCopy would hang after cancelling
3. Issue #1888 where directories with empty name are incorrectly handled.
4. Cancel HNS delete jobs #2117
5. Fix issue where large chunks could not be scheduled #2228
6. Fixed segfault on MacOS #1790
7. Fixed panic on attempt to create AzCopy dir #2191