azure-storage-azcopy: azcopy --recursive copy from source Linux server to File share doesn't work

Which version of the AzCopy was used?

Note: The version is visible when running AzCopy without any argument

10.2.1

Which platform are you using? (ex: Windows, Mac, Linux)

Linux

What command did you run?

./azcopy copy --recursive ../ARD-all-nebraska-2002-2019/ <SAS string copied from Azure File Storage>
Note: Please remove the SAS to avoid exposing your credentials. If you cannot remember the exact command, please retrieve it from the beginning of the log file.

What problem was encountered?

Log file is located at: /home/rave/.azcopy/6917c0c9-b2ea-e84b-51ec-ca9ae3f13f52.log

0 Done, 880 Failed, 424 Pending, 0 Skipped, 1304 Total, 


Job 6917c0c9-b2ea-e84b-51ec-ca9ae3f13f52 summary
Elapsed Time (Minutes): 0.0667
Total Number Of Transfers: 1304
Number of Transfers Completed: 0
Number of Transfers Failed: 1304
Number of Transfers Skipped: 0
TotalBytesTransferred: 0
Final Job Status: Failed

The log file is long and its hard to parse where the relevant error message is, but here is a section of it. I don’t think the error is correct because the Resource should be found since I copied the SAS string from file explorer.

2019/10/01 19:55:47 ERR: [P#0-T#1289] error deleting the (incomplete) file https://cropmaskperm.file.core.windows.net/azureml-filestore-896933ab-f4fd-42b2-a154-0abb35dfb0b0/unpacked_ard_landsat_downloads/ARD-all-nebraska-2002-2019/LT05_CU_015009_20020822_20190111_C01_V01_SR.tar?<SAS removed>. Failed with error -> github.com/Azure/azure-storage-file-go/azfile.newStorageError, /home/vsts/go/pkg/mod/github.com/!azure/azure-storage-file-go@v0.5.0/azfile/zc_storage_error.go:42
===== RESPONSE ERROR (ServiceCode=ResourceNotFound) =====
Description=The specified resource does not exist.
RequestId:1008d3f3-101a-00a3-5d92-789dc8000000
Time:2019-10-01T19:55:47.1641420Z, Details: 
   Code: ResourceNotFound
   DELETE https://cropmaskperm.file.core.windows.net/azureml-filestore-896933ab-f4fd-42b2-a154-0abb35dfb0b0/unpacked_ard_landsat_downloads/ARD-all-nebraska-2002-2019/LT05_CU_015009_20020822_20190111_C01_V01_SR.tar?<SAS removed>
   User-Agent: [AzCopy/10.2.1 Azure-Storage/0.5.0 (go1.12; linux)]
   X-Ms-Client-Request-Id: [d8a6a496-7d54-4229-683b-a36ac9cd5dbe]
   X-Ms-Version: [2018-03-28]
   --------------------------------------------------------------------------------
   RESPONSE Status: 404 The specified resource does not exist.
   Content-Length: [223]
   Content-Type: [application/xml]
   Date: [Tue, 01 Oct 2019 19:55:46 GMT]
   Server: [Windows-Azure-File/1.0 Microsoft-HTTPAPI/2.0]
   X-Ms-Error-Code: [ResourceNotFound]
   X-Ms-Request-Id: [1008d3f3-101a-00a3-5d92-789dc8000000]
   X-Ms-Version: [2018-03-28]

How can we reproduce the problem in the simplest way?

Not sure because it is so simple, so something might be different about either my source or destination. But you can try

Downloading azcopy, then

./azcopy login --tenant-id <tenant id from azure portal>
# get SAS url from file explorer
./azcopy copy --recursive ../ARD-all-nebraska-2002-2019/ <SAS string copied from Azure File Storage> # fails

Have you found a mitigation/solution?

No

About this issue

  • Original URL
  • State: closed
  • Created 5 years ago
  • Comments: 26 (13 by maintainers)

Most upvoted comments

Thanks for the detailed info Ryan. We (probably Adele) will look into it some more. Probably won’t be today though, I’m sorry.