azure-pipelines-agent: Integration with Test result log parser causes timeout in on-prem agent

Agent Version and Platform

Version of your agent? 2.148.0 (x64)

We noticed in this version, one of the features added is:

  • Integrate Log Parser with master #2066

OS of the machine running the agent? OSX/Windows/Linux/… Windows Server 2016 (Version 1607)

Azure DevOps Type and Version

dev.azure.com (formerly visualstudio.com) or on-premises TFS/Azure DevOps Server? dev.azure.com

If dev.azure.com, what is your organization name? https://dev.azure.com/bankinter

What’s not working?

After a successful release, the Finalize Job task takes about 4 minutes, and shows the output below. The releases ends succesfully, but this adds an additional 4 min to finalize:

2019-03-06T15:26:17.1310880Z ##[section]Starting: Finalize Job
2019-03-06T15:28:36.6152178Z    at Microsoft.VisualStudio.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
2019-03-06T15:28:36.6152614Z    --- End of inner exception stack trace ---
2019-03-06T15:28:36.6152735Z    at Microsoft.VisualStudio.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
2019-03-06T15:28:36.6152827Z    at Microsoft.VisualStudio.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
2019-03-06T15:28:36.6152937Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-03-06T15:28:36.6153029Z    at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
2019-03-06T15:28:36.6153435Z    at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpMethod method, Guid locationId, Object routeValues, ApiResourceVersion version, HttpContent content, IEnumerable`1 queryParameters, Object userState, CancellationToken cancellationToken)
2019-03-06T15:28:36.6153545Z    at Microsoft.VisualStudio.Services.CustomerIntelligence.WebApi.CustomerIntelligenceHttpClient.PublishEventsAsync(CustomerIntelligenceEvent[] events, Object userState, CancellationToken cancellationToken)
2019-03-06T15:28:36.6153652Z    at Agent.Plugins.Log.TestResultParser.Plugin.TestResultLogPlugin.PopulatePipelineConfig(IAgentLogPluginContext context)
2019-03-06T15:28:36.6153725Z    at Agent.Plugins.Log.TestResultParser.Plugin.TestResultLogPlugin.InitializeAsync(IAgentLogPluginContext context)
2019-03-06T15:28:36.6153817Z TestResultLogParser: Warning: Unable to initialize TestResultLogParser.
2019-03-06T15:30:16.5896286Z    at Microsoft.VisualStudio.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
2019-03-06T15:30:16.5896458Z    --- End of inner exception stack trace ---
2019-03-06T15:30:16.5896528Z    at Microsoft.VisualStudio.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
2019-03-06T15:30:16.5896627Z    at Microsoft.VisualStudio.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
2019-03-06T15:30:16.5896711Z    at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
2019-03-06T15:30:16.5896821Z    at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
2019-03-06T15:30:16.5897136Z    at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpMethod method, Guid locationId, Object routeValues, ApiResourceVersion version, HttpContent content, IEnumerable`1 queryParameters, Object userState, CancellationToken cancellationToken)
2019-03-06T15:30:16.5897345Z    at Microsoft.VisualStudio.Services.CustomerIntelligence.WebApi.CustomerIntelligenceHttpClient.PublishEventsAsync(CustomerIntelligenceEvent[] events, Object userState, CancellationToken cancellationToken)
2019-03-06T15:30:16.5897532Z    at Agent.Plugins.Log.TestResultParser.Plugin.TestResultLogPlugin.InitializeAsync(IAgentLogPluginContext context)
2019-03-06T15:30:16.5897672Z    at Agent.Sdk.AgentLogPluginHost.RunAsync(IAgentLogPlugin plugin, CancellationToken token)
2019-03-06T15:30:16.5897965Z TestResultLogParser: Waiting for log plugin to finish, pending process 1329 log lines.
2019-03-06T15:30:16.5898214Z TestResultLogParser: Fail to process output: Fail to initialize: The HTTP request timed out after 00:01:40..
2019-03-06T15:30:16.5911885Z Start cleaning up orphan processes.
2019-03-06T15:30:16.6262381Z ##[section]Finishing: Finalize Job

Most likelly, our firewall is not allowing the traffic requiered by the TestResultLogParser. Is it possible to disable this feature? What URLs need to be enabled?

About this issue

  • Original URL
  • State: closed
  • Created 5 years ago
  • Comments: 22 (3 by maintainers)

Most upvoted comments

Hi all, The Finalize Job step has suddenly dropped from 2 minutes 30 to less than 1 second. I’m not sure if a change has gone in… but if one has “Thank you!”. This will make a big difference on our side to the release times:

2019-04-02T08:48:59.2618629Z ##[section]Starting: Finalize Job
2019-04-02T08:48:59.2657274Z Start cleaning up orphan processes.
2019-04-02T08:48:59.2665279Z ##[section]Finishing: Finalize Job

Thank you 😃