azure-pipelines-tasks: Downloading Pipeline Artifact in Release pipeline takes forever with Timeout exceptions.

Type: Bug

Enter Task Name: Download Pipeline Artifact in Release pipeline

Environment

• Server - Azure Pipelines?
• Agent - Hosted windows-2019

Issue Description

When the build pipeline produces multiple artifacts and the release pipeline downloads all of them, the first 5-6 artifacts are downloaded fast (3-10 seconds per 100-200mb artifact), the rest might take a very long time to download, up to 3-4 minutes with constant timeout exceptions.

Task logs

2019-05-07T13:48:00.9612049Z ##[section]Starting: Download artifact - _MixMove vNext-CI - AccessPoint_Release
2019-05-07T13:48:00.9752046Z ==============================================================================
2019-05-07T13:48:00.9752185Z Task         : Download Pipeline Artifact
2019-05-07T13:48:00.9752266Z Description  : Download Pipeline Artifact
2019-05-07T13:48:00.9752323Z Version      : 1.1.3
2019-05-07T13:48:00.9752393Z Author       : Microsoft Corporation
2019-05-07T13:48:00.9752461Z Help         : Download named artifact from a pipeline to a local path.
2019-05-07T13:48:00.9752552Z ==============================================================================
2019-05-07T13:48:01.5054231Z Download artifact to: d:\a\r1\a/_MixMove vNext-CI/AccessPoint_Release
2019-05-07T13:48:02.7803529Z Information, Minimatch patterns: [**]
2019-05-07T13:48:03.3233176Z Information, Filtered 36 files from the Minimatch filters supplied.
2019-05-07T13:48:03.3733942Z Information, Could not initialize dataport.
2019-05-07T13:48:03.3901635Z Information, Downloaded 0.0 MB out of 114.3 MB (0%).
2019-05-07T13:48:08.4002992Z Information, Downloaded 20.3 MB out of 114.3 MB (18%).
2019-05-07T13:48:13.4082137Z Information, Downloaded 34.2 MB out of 114.3 MB (30%).
2019-05-07T13:48:18.4255119Z Information, Downloaded 43.3 MB out of 114.3 MB (38%).
2019-05-07T13:48:23.4277874Z Information, Downloaded 64.0 MB out of 114.3 MB (56%).
2019-05-07T13:48:25.6232265Z Warning, [https://xuavsblobprodsu6weus12.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/77BBFF14F8029B264608CE6644F0FEEBFEA578700CB3084E7175BB842AF8D3F001?sv=2017-04-17&sr=b&sig=t3poNXwyeqp6TzS6JJXwiDNdXHB9XPPtc1uLd06oDng%3D&spr=https&se=2019-05-07T16%3A56%3A07Z&sp=r&rscl=x-e2eid-0ad47c55-48f64b5c-aa5a4d23-670004dd-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:48:25.6232953Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:48:25.6233269Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:48:25.6233479Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:48:25.6233898Z    --- End of inner exception stack trace ---
2019-05-07T13:48:25.6234254Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:48:25.6234448Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:48:25.6234655Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:48:25.6236244Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:48:25.6236419Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:48:25.6236784Z Warning, [https://r23vsblobprodsu6weus80.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/AD7CD21379DB8E08F7F09C699C4681CBFCA084F9DD18E6D5755ACFDDDC3941C501?sv=2017-04-17&sr=b&sig=y8soNOPTFdAGN8Y6W%2F7CKcbouRvUjovE71tjTQOiKCo%3D&spr=https&se=2019-05-07T17%3A21%3A17Z&sp=r&rscl=x-e2eid-2f23e6ab-43b943d2-ab71923f-720f8696-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:48:25.6236985Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:48:25.6238506Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:48:25.6238596Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:48:25.6238662Z    --- End of inner exception stack trace ---
2019-05-07T13:48:25.6238915Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:48:25.6239017Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:48:25.6239306Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:48:25.6239393Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:48:25.6239826Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:48:28.4332472Z Information, Downloaded 69.9 MB out of 114.3 MB (61%).
2019-05-07T13:48:33.4436034Z Information, Downloaded 69.9 MB out of 114.3 MB (61%).
2019-05-07T13:48:38.4490631Z Information, Downloaded 69.9 MB out of 114.3 MB (61%).
2019-05-07T13:48:43.4599655Z Information, Downloaded 69.9 MB out of 114.3 MB (61%).
2019-05-07T13:48:46.7912734Z Warning, [https://xlmvsblobprodsu6weus15.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/6643AB92793736F5C5DCE1476DE831A4C95C7AD6AFB0653FE97F2B71942CA20501?sv=2017-04-17&sr=b&sig=zUTwMl6GAqhRfvghtU5O8Oh5ksk%2FYuh7rnGQJpQuVGE%3D&spr=https&se=2019-05-07T16%3A47%3A57Z&sp=r&rscl=x-e2eid-0ad47c55-48f64b5c-aa5a4d23-670004dd-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:48:46.7913318Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:48:46.7914129Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:48:46.7914334Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:48:46.7914524Z    --- End of inner exception stack trace ---
2019-05-07T13:48:46.7914710Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:48:46.7915242Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:48:46.7915536Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:48:46.7915723Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:48:46.7915935Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:48:46.7916385Z Warning, [https://r23vsblobprodsu6weus80.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/467FC29FFA48E4F17F3160EE598106174ACD011BFE5E7B831684EA26F02D3A4601?sv=2017-04-17&sr=b&sig=i5OIdmQWbGMivEPXwVKo3cwbq2BwgJ9Us19W6CkeaYY%3D&spr=https&se=2019-05-07T16%3A33%3A02Z&sp=r&rscl=x-e2eid-0ad47c55-48f64b5c-aa5a4d23-670004dd-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:48:46.7918561Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:48:46.7918838Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:48:46.7919041Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:48:46.7919225Z    --- End of inner exception stack trace ---
2019-05-07T13:48:46.7919479Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:48:46.7920159Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:48:46.7921305Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:48:46.7921541Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:48:46.7921855Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:48:48.4687108Z Information, Downloaded 74.3 MB out of 114.3 MB (65%).
2019-05-07T13:48:53.4766363Z Information, Downloaded 74.3 MB out of 114.3 MB (65%).
2019-05-07T13:48:58.4841351Z Information, Downloaded 74.3 MB out of 114.3 MB (65%).
2019-05-07T13:49:00.9914149Z Warning, [https://nsevsblobprodsu6weus42.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/0A08A8687F1374CF4BAA117E5D14D4D586B516AE20D39F2E2FD38983D4DF0EBA01?sv=2017-04-17&sr=b&sig=LItxO6mlumvXnQaGVQm0NbskkSaLWv4R8ojyOhLffAU%3D&spr=https&se=2019-05-07T16%3A04%3A42Z&sp=r&rscl=x-e2eid-81870edb-41ba4504-9d35bd75-e422ddb5-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:00.9914474Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:00.9914873Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:00.9915535Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:00.9915908Z    --- End of inner exception stack trace ---
2019-05-07T13:49:00.9916062Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:00.9916347Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:00.9916506Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:00.9916627Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:00.9917456Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:00.9917911Z Warning, [https://i40vsblobprodsu6weus59.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/82946E5A20C04A3229EF7C9CABA8834E995E9966C1E4309CE13F196989CD81C801?sv=2017-04-17&sr=b&sig=jMN3sgQrWeF2U%2F3LKPoNFjcMDTyeKqe2TbcuLxzJDXY%3D&spr=https&se=2019-05-07T17%3A01%3A12Z&sp=r&rscl=x-e2eid-7190cd7e-d8ed40c3-90c41c74-43c0bf4a-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:00.9918803Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:00.9919188Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:00.9920501Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:00.9920623Z    --- End of inner exception stack trace ---
2019-05-07T13:49:00.9921342Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:00.9921620Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:00.9921906Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:00.9922011Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:00.9922092Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:01.0066053Z Warning, [https://nu4vsblobprodsu6weus57.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/033FF830F3465DF12ADDC8425DEB5CAFE8532A99D76DF502EC98D4F5756AA15201?sv=2017-04-17&sr=b&sig=tKvyEytyCaGn6QxFf4wrTuX24sltRHXqmgy%2FvsuRBJA%3D&spr=https&se=2019-05-07T16%3A01%3A33Z&sp=r&rscl=x-e2eid-7190cd7e-d8ed40c3-90c41c74-43c0bf4a-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:01.0066512Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:01.0066733Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:01.0066819Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:01.0066920Z    --- End of inner exception stack trace ---
2019-05-07T13:49:01.0067015Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:01.0067195Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:01.0067341Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:01.0067435Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:01.0067547Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:01.0067719Z Warning, [https://bwlvsblobprodsu6weus62.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/7AFC3CE3DDFD831525564BC7B40A4F498D61D599CB2405B90A451A58F62572E001?sv=2017-04-17&sr=b&sig=EnsFBn1Aj%2F8cg7AIEJ09FripqjW5h7aNtUdSmGCFVjI%3D&spr=https&se=2019-05-07T16%3A57%3A45Z&sp=r&rscl=x-e2eid-12d7e820-a76d46be-ba8bff4e-2c99c86a-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:01.0068123Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:01.0068268Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:01.0069287Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:01.0069361Z    --- End of inner exception stack trace ---
2019-05-07T13:49:01.0069464Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:01.0069739Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:01.0071337Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:01.0071421Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:01.0071684Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:01.0861459Z Warning, [https://nsevsblobprodsu6weus42.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/3856F980A0EEAB04C78ECFA9E9C5D5134645E7799FB73E47D0F6FE64F91B8F8801?sv=2017-04-17&sr=b&sig=hk0OcuSRKibXVwGqhMfmrd76FlI2Q9JB9klYVfb1Tfc%3D&spr=https&se=2019-05-07T16%3A26%3A25Z&sp=r&rscl=x-e2eid-11293f45-f0a940b0-a736dc9b-88f72d39-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:01.0862451Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:01.0862957Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:01.0863211Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:01.0863430Z    --- End of inner exception stack trace ---
2019-05-07T13:49:01.0863687Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:01.0863965Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:01.0864244Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:01.0864496Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:01.0864750Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:01.0865053Z Warning, [https://41hvsblobprodsu6weus29.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/24B980D964DE88ED48D9C88EE196B0DE897B36054E94A8102A4C6BAED2E6E19C01?sv=2017-04-17&sr=b&sig=XOw1Iov9pDFHjYxy9pMNm3ril8k0kESAK8a2Vmkt5mA%3D&spr=https&se=2019-05-07T16%3A17%3A12Z&sp=r&rscl=x-e2eid-11293f45-f0a940b0-a736dc9b-88f72d39-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:01.0867086Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:01.0867447Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:01.0867711Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:01.0867985Z    --- End of inner exception stack trace ---
2019-05-07T13:49:01.0868300Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:01.0868607Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:01.0868974Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:01.0869220Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:01.0869304Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:01.0869480Z Warning, [https://o78vsblobprodsu6weus38.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/65F4F6A318378E92A05BB8CCC210A5D0E3D2E2BCFA7241B111D1A9982F373D6701?sv=2017-04-17&sr=b&sig=diaC9iXKMXvyAoG0m76DrYktWHdPPJRmQZJxTEufe6E%3D&spr=https&se=2019-05-07T16%3A47%3A48Z&sp=r&rscl=x-e2eid-2a4d2d34-78b44e93-9dd41581-ce37b7ae-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:01.0869699Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:01.0869814Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:01.0870064Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:01.0870288Z    --- End of inner exception stack trace ---
2019-05-07T13:49:01.0870382Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:01.0870481Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:01.0870600Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:01.0870697Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:01.0870770Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:01.1171128Z Warning, [https://41hvsblobprodsu6weus29.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/AEA44D6FBEB92C327BB15A29EA7F44F9CC13963A0FC387DF8A73D1B9323E6E0101?sv=2017-04-17&sr=b&sig=apPCR%2F%2FCSll34rBN%2F562Ms3pkLhWkTh7NKLjUzXHxRs%3D&spr=https&se=2019-05-07T17%3A21%3A51Z&sp=r&rscl=x-e2eid-2a4d2d34-78b44e93-9dd41581-ce37b7ae-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:01.1171466Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:01.1171754Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:01.1171847Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:01.1171934Z    --- End of inner exception stack trace ---
2019-05-07T13:49:01.1172017Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:01.1172244Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:01.1172355Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:01.1172689Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:01.1172768Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:01.1482744Z Warning, [https://jnjvsblobprodsu6weus16.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/2E25BBD8F5D0B03D038C09F31A305E27F91BC95143DA2A96B2A94E9D66B31DDE01?sv=2017-04-17&sr=b&sig=MOU%2FF9AT5YQ7Wtm0dsR7xoo9CX0d27o6VtRjlXFHGYQ%3D&spr=https&se=2019-05-07T16%3A21%3A37Z&sp=r&rscl=x-e2eid-12d7e820-a76d46be-ba8bff4e-2c99c86a-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:01.1483093Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:01.1483260Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:01.1483333Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:01.1483436Z    --- End of inner exception stack trace ---
2019-05-07T13:49:01.1483523Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:01.1483654Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:01.1483767Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:01.1483880Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:01.1483980Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:03.5048073Z Information, Downloaded 84.0 MB out of 114.3 MB (73%).
2019-05-07T13:49:08.5074018Z Information, Downloaded 84.0 MB out of 114.3 MB (73%).
2019-05-07T13:49:08.8065739Z Warning, [https://5bsvsblobprodsu6weus71.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/5EDF439E2BF42CB39D7948B86E153FBD0153B57C516DCAC3170A02DFD8D8F10901?sv=2017-04-17&sr=b&sig=gMLOrU08QsMcBBwjqkFMuxG3Q9kGDiEhcOccW75v%2F9o%3D&spr=https&se=2019-05-07T16%3A44%3A28Z&sp=r&rscl=x-e2eid-2f23e6ab-43b943d2-ab71923f-720f8696-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:08.8066322Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:08.8066561Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:08.8066650Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:08.8066753Z    --- End of inner exception stack trace ---
2019-05-07T13:49:08.8066853Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:08.8067003Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:08.8067157Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:08.8067389Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:08.8067513Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:08.8688453Z Warning, [https://m1evsblobprodsu6weus87.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/9AFEF1A4CECBC23D829103C0C4247F773F1E26F0C99D8D906520B77B507CF88701?sv=2017-04-17&sr=b&sig=PPTSVAu4af2ciLY7pIkonZVItjA4x%2FAwgoT0dTQmUBo%3D&spr=https&se=2019-05-07T17%3A12%3A39Z&sp=r&rscl=x-e2eid-2f23e6ab-43b943d2-ab71923f-720f8696-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:08.8688956Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:08.8689112Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:08.8689209Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:08.8689281Z    --- End of inner exception stack trace ---
2019-05-07T13:49:08.8689388Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:08.8689666Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:08.8689798Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:08.8689888Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:08.8690190Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:13.5197779Z Information, Downloaded 90.3 MB out of 114.3 MB (79%).
2019-05-07T13:49:18.5351027Z Information, Downloaded 90.3 MB out of 114.3 MB (79%).
2019-05-07T13:49:19.0696111Z Warning, [https://41hvsblobprodsu6weus29.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/AEA44D6FBEB92C327BB15A29EA7F44F9CC13963A0FC387DF8A73D1B9323E6E0101?sv=2017-04-17&sr=b&sig=apPCR%2F%2FCSll34rBN%2F562Ms3pkLhWkTh7NKLjUzXHxRs%3D&spr=https&se=2019-05-07T17%3A21%3A51Z&sp=r&rscl=x-e2eid-2a4d2d34-78b44e93-9dd41581-ce37b7ae-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 2/5, non-retryable exception caught. Throwing. Details:
2019-05-07T13:49:19.0697225Z Task was requested to be canceled. System.Threading.Tasks.TaskCanceledException: A task was canceled.
2019-05-07T13:49:19.0697471Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:19.0697693Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:19.0697920Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:19.0698122Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:19.0698300Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:19.0700603Z Warning, [https://41hvsblobprodsu6weus29.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/AEA44D6FBEB92C327BB15A29EA7F44F9CC13963A0FC387DF8A73D1B9323E6E0101?sv=2017-04-17&sr=b&sig=apPCR%2F%2FCSll34rBN%2F562Ms3pkLhWkTh7NKLjUzXHxRs%3D&spr=https&se=2019-05-07T17%3A21%3A51Z&sp=r&rscl=x-e2eid-2a4d2d34-78b44e93-9dd41581-ce37b7ae-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:19.0701249Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Threading.Tasks.TaskCanceledException: A task was canceled.
2019-05-07T13:49:19.0701588Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:19.0701769Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:19.0701926Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:19.0702038Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:19.0702131Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:19.0702257Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass59_0.<<HandleRedirectAsync>b__0>d.MoveNext()
2019-05-07T13:49:19.0702347Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:19.0702693Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:23.5485861Z Information, Downloaded 93.9 MB out of 114.3 MB (82%).
2019-05-07T13:49:28.5586472Z Information, Downloaded 93.9 MB out of 114.3 MB (82%).
2019-05-07T13:49:29.8684931Z Warning, [https://308vsblobprodsu6weus54.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/5807D7A8A108299F46A5D734A1EEC1B8B5A378566672A4736FDC21174BF1CE3901?sv=2017-04-17&sr=b&sig=QZXyJgGFF0huI0YU2J5%2FDTPDE80a%2FpgUxaWxhY5qVUM%3D&spr=https&se=2019-05-07T16%3A41%3A16Z&sp=r&rscl=x-e2eid-0ad47c55-48f64b5c-aa5a4d23-670004dd-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:29.8685338Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:29.8686289Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:29.8686423Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:29.8686655Z    --- End of inner exception stack trace ---
2019-05-07T13:49:29.8686759Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:29.8686884Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:29.8686981Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:29.8687080Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:29.8687162Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:33.5857818Z Information, Downloaded 94.6 MB out of 114.3 MB (83%).
2019-05-07T13:49:38.5917339Z Information, Downloaded 94.8 MB out of 114.3 MB (83%).
2019-05-07T13:49:43.6022328Z Information, Downloaded 99.4 MB out of 114.3 MB (87%).
2019-05-07T13:49:44.5286237Z Warning, [https://iosvsblobprodsu6weus30.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/D3DA7894155EEA12C42AD44F8B1F5AE93270A427C48F5B15E1CB93458F1EB70E01?sv=2017-04-17&sr=b&sig=FbifkTYzqlGamuhIIhGzxqmNgsvIobrAo11eiTTWc5U%3D&spr=https&se=2019-05-07T17%3A39%3A16Z&sp=r&rscl=x-e2eid-12d7e820-a76d46be-ba8bff4e-2c99c86a-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:44.5286544Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:44.5286783Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:44.5287225Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:44.5287793Z    --- End of inner exception stack trace ---
2019-05-07T13:49:44.5288078Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:44.5288434Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:44.5288740Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:44.5289013Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:44.5289159Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:44.5593226Z Warning, [https://fx1vsblobprodsu6weus34.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/AB50F57C950CF3569DF70BCC9C274485DAD3194F82CC75C2E95F2192811CD10701?sv=2017-04-17&sr=b&sig=iGwc18UWUY3P%2FJWXfNHW%2FGPjfGls4TQuL6MYAVNr1iw%3D&spr=https&se=2019-05-07T17%3A20%3A18Z&sp=r&rscl=x-e2eid-12d7e820-a76d46be-ba8bff4e-2c99c86a-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:49:44.5593752Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.WinHttpException: Error 12002 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The operation timed out'.
2019-05-07T13:49:44.5594253Z    at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
2019-05-07T13:49:44.5594367Z    at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
2019-05-07T13:49:44.5594446Z    --- End of inner exception stack trace ---
2019-05-07T13:49:44.5594571Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:49:44.5594698Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:49:44.5594843Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:49:44.5594944Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:49:44.5595175Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:49:48.6190613Z Information, Downloaded 99.6 MB out of 114.3 MB (87%).
2019-05-07T13:49:53.6387004Z Information, Downloaded 100.7 MB out of 114.3 MB (88%).
2019-05-07T13:49:58.6413870Z Information, Downloaded 100.7 MB out of 114.3 MB (88%).
2019-05-07T13:50:03.6525890Z Information, Downloaded 110.5 MB out of 114.3 MB (97%).
2019-05-07T13:50:08.6642262Z Information, Downloaded 110.7 MB out of 114.3 MB (97%).
2019-05-07T13:50:13.6736227Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:50:18.6837307Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:50:23.6899041Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:50:28.6919209Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:50:33.6943668Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:50:38.7057266Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:50:43.7080714Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:50:48.7151540Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:50:53.7383595Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:50:58.7504239Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:51:03.7517723Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:51:08.7585580Z Information, Downloaded 113.5 MB out of 114.3 MB (99%).
2019-05-07T13:51:12.1649007Z Warning, [https://kx9vsblobprodsu6weus66.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/453E45E736A110A416CD15BA45E6B10158698284BB3ABB739275CFBD646F952601?sv=2017-04-17&sr=b&sig=SHbcYIxXUITJkR9DX7Stzih4s5vh678GRhgTYVZrKdE%3D&spr=https&se=2019-05-07T16%3A32%3A27Z&sp=r&rscl=x-e2eid-2a4d2d34-78b44e93-9dd41581-ce37b7ae-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, non-retryable exception caught. Throwing. Details:
2019-05-07T13:51:12.1649623Z Task was requested to be canceled. System.Threading.Tasks.TaskCanceledException: A task was canceled.
2019-05-07T13:51:12.1649887Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:51:12.1650148Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:51:12.1650346Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:51:12.1650569Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:51:12.1651554Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:51:12.1653221Z Warning, [https://kx9vsblobprodsu6weus66.blob.core.windows.net/dbe63b98307635479db31e89f778704d55/453E45E736A110A416CD15BA45E6B10158698284BB3ABB739275CFBD646F952601?sv=2017-04-17&sr=b&sig=SHbcYIxXUITJkR9DX7Stzih4s5vh678GRhgTYVZrKdE%3D&spr=https&se=2019-05-07T16%3A32%3A27Z&sp=r&rscl=x-e2eid-2a4d2d34-78b44e93-9dd41581-ce37b7ae-session-fbcd7455-c21842f0-9e2e7d15-31d925a5] Try 1/5, retryable exception caught. Retrying in 00:00:01. Details:
2019-05-07T13:51:12.1653585Z Exception.Data didn't contain key LastRequestResponse or its value was null or not a string. Was HttpRequestExceptionExtensions.SetHttpMessagesForTracing called? System.Threading.Tasks.TaskCanceledException: A task was canceled.
2019-05-07T13:51:12.1653787Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-05-07T13:51:12.1654030Z    at Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1 task, CancellationToken cancellationToken, Func`1 makeMessage, String file, String member, Int32 line)
2019-05-07T13:51:12.1654554Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass56_0.<<GetRedirectResponseAsync>b__0>d.MoveNext()
2019-05-07T13:51:12.1654641Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:51:12.1654771Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:51:12.1654864Z    at Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass59_0.<<HandleRedirectAsync>b__0>d.MoveNext()
2019-05-07T13:51:12.1654994Z --- End of stack trace from previous location where exception was thrown ---
2019-05-07T13:51:12.1655084Z    at Microsoft.VisualStudio.Services.Content.Common.AsyncHttpRetryHelper`1.InvokeAsync(CancellationToken cancellationToken)
2019-05-07T13:51:13.5923086Z Information, Downloaded 114.3 MB out of 114.3 MB (100%).
2019-05-07T13:51:13.5923654Z Information, Download completed.
2019-05-07T13:51:13.5935864Z Information, 
2019-05-07T13:51:13.5936117Z Download statistics:
2019-05-07T13:51:13.5936440Z Total Content: 114.3 MB 
2019-05-07T13:51:13.5936607Z Physical Content Downloaded: 113.8 MB
2019-05-07T13:51:13.5936752Z Compression Saved: 0.6 MB
2019-05-07T13:51:13.5936909Z Local Caching Saved: 0.0 MB
2019-05-07T13:51:13.5937048Z Chunks Downloaded: 1,486
2019-05-07T13:51:13.5937189Z 
2019-05-07T13:51:13.5957054Z Downloading artifact finished.
2019-05-07T13:51:13.6291383Z ##[section]Finishing: Download artifact - _MixMove vNext-CI - AccessPoint_Release