arrow: [Packaging][C#] Nuget build is failing on maintenance branch for 13.0.0

Describe the bug, including details regarding any error messages, version, and platform.

The nuget job is failing on our maintenance branch but does not seem to be failing on main: https://github.com/ursacomputing/crossbow/actions/runs/5654516424/job/15319395743 I had a minor conflict when cherry-picking but it does not seem related. This was the conflict:

$ git diff
diff --cc csharp/test/Apache.Arrow.Tests/Apache.Arrow.Tests.csproj
index cdbfe47,805fb5a..0000000
--- a/csharp/test/Apache.Arrow.Tests/Apache.Arrow.Tests.csproj
+++ b/csharp/test/Apache.Arrow.Tests/Apache.Arrow.Tests.csproj
@@@ -21,4 -24,12 +24,16 @@@
      <ProjectReference Include="..\..\src\Apache.Arrow\Apache.Arrow.csproj" />
    </ItemGroup>
  
- </Project>
++<<<<<<< HEAD
++</Project>
++=======
+   <ItemGroup Condition="!$([MSBuild]::IsTargetFrameworkCompatible($(TargetFramework), 'net6.0'))">
+     <Compile Remove="TimeOnlyTests.cs" />
+   </ItemGroup>
+ 
+   <ItemGroup Condition="$([MSBuild]::IsTargetFrameworkCompatible($(TargetFramework), 'net5.0'))">
+     <Compile Remove="Extensions\Net472Extensions.cs" />
+   </ItemGroup>
+ 
+ </Project>
++>>>>>>> b557e85 (GH-36812: [C#] Fix C API support to work with .NET desktop framework (#36813))

I ended up deleting:

I ended up deleting the:
+   <ItemGroup Condition="!$([MSBuild]::IsTargetFrameworkCompatible($(TargetFramework), 'net6.0'))">
+     <Compile Remove="TimeOnlyTests.cs" />
+   </ItemGroup>

because https://github.com/apache/arrow/issues/34620 is not part of the release.

Here the full log of the failure:

 + dotnet test
/arrow/csharp /
  Determining projects to restore...
  All projects are up-to-date for restore.
  Apache.Arrow -> /arrow/csharp/artifacts/Apache.Arrow/Debug/netstandard1.3/Apache.Arrow.dll
  Apache.Arrow -> /arrow/csharp/artifacts/Apache.Arrow/Debug/netstandard2.0/Apache.Arrow.dll
  Apache.Arrow -> /arrow/csharp/artifacts/Apache.Arrow/Debug/netcoreapp3.1/Apache.Arrow.dll
  Apache.Arrow -> /arrow/csharp/artifacts/Apache.Arrow/Debug/net6.0/Apache.Arrow.dll
  Apache.Arrow.Tests -> /arrow/csharp/artifacts/Apache.Arrow.Tests/Debug/net7.0/Apache.Arrow.Tests.dll
Test run for /arrow/csharp/artifacts/Apache.Arrow.Tests/Debug/net7.0/Apache.Arrow.Tests.dll (.NETCoreApp,Version=v7.0)
  Apache.Arrow.IntegrationTest -> /arrow/csharp/artifacts/Apache.Arrow.IntegrationTest/Debug/net7.0/Apache.Arrow.IntegrationTest.dll
Microsoft (R) Test Execution Command Line Tool Version 17.6.3 (x64)
Copyright (c) Microsoft Corporation.  All rights reserved.

  Apache.Arrow.Flight -> /arrow/csharp/artifacts/Apache.Arrow.Flight/Debug/netstandard2.1/Apache.Arrow.Flight.dll
Starting test execution, please wait...
A total of 1 test files matched the specified pattern.
The active test run was aborted. Reason: Test host process crashed

Passed!  - Failed:     0, Passed:  1114, Skipped:     0, Total:  1114, Duration: 1 s - Apache.Arrow.Tests.dll (net7.0)
Test Run Aborted with error System.Exception: One or more errors occurred.
 ---> System.Exception: Unable to read beyond the end of the stream.
   at System.IO.BinaryReader.Read7BitEncodedInt()
   at System.IO.BinaryReader.ReadString()
   at Microsoft.VisualStudio.TestPlatform.CommunicationUtilities.LengthPrefixCommunicationChannel.NotifyDataAvailable()
   at Microsoft.VisualStudio.TestPlatform.CommunicationUtilities.TcpClientExtensions.MessageLoopAsync(TcpClient client, ICommunicationChannel channel, Action`1 errorHandler, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---.
  Apache.Arrow.Flight -> /arrow/csharp/artifacts/Apache.Arrow.Flight/Debug/netstandard2.0/Apache.Arrow.Flight.dll
  Apache.Arrow.Compression -> /arrow/csharp/artifacts/Apache.Arrow.Compression/Debug/netstandard2.0/Apache.Arrow.Compression.dll
  Apache.Arrow.Compression.Tests -> /arrow/csharp/artifacts/Apache.Arrow.Compression.Tests/Debug/net7.0/Apache.Arrow.Compression.Tests.dll
Test run for /arrow/csharp/artifacts/Apache.Arrow.Compression.Tests/Debug/net7.0/Apache.Arrow.Compression.Tests.dll (.NETCoreApp,Version=v7.0)
Microsoft (R) Test Execution Command Line Tool Version 17.6.3 (x64)
Copyright (c) Microsoft Corporation.  All rights reserved.

Starting test execution, please wait...
A total of 1 test files matched the specified pattern.

Passed!  - Failed:     0, Passed:     8, Skipped:     0, Total:     8, Duration: 29 ms - Apache.Arrow.Compression.Tests.dll (net7.0)
  Apache.Arrow.Flight.AspNetCore -> /arrow/csharp/artifacts/Apache.Arrow.Flight.AspNetCore/Debug/netcoreapp3.1/Apache.Arrow.Flight.AspNetCore.dll
  Apache.Arrow.Flight.TestWeb -> /arrow/csharp/artifacts/Apache.Arrow.Flight.TestWeb/Debug/net7.0/Apache.Arrow.Flight.TestWeb.dll
  Apache.Arrow.Flight.Tests -> /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0/Apache.Arrow.Flight.Tests.dll
Test run for /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0/Apache.Arrow.Flight.Tests.dll (.NETCoreApp,Version=v7.0)
Microsoft (R) Test Execution Command Line Tool Version 17.6.3 (x64)
Copyright (c) Microsoft Corporation.  All rights reserved.

Starting test execution, please wait...
A total of 1 test files matched the specified pattern.
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:42639
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:41381
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:39049
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:36315
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:44449
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:32851
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:40155
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:38051
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:39785
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:36593
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:36325
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...
info: Microsoft.Hosting.Lifetime[14]
      Now listening on: http://[::]:33377
info: Microsoft.Hosting.Lifetime[0]
      Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
      Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
      Content root path: /arrow/csharp/artifacts/Apache.Arrow.Flight.Tests/Debug/net7.0
info: Microsoft.Hosting.Lifetime[0]
      Application is shutting down...

Passed!  - Failed:     0, Passed:    12, Skipped:     0, Total:    12, Duration: 309 ms - Apache.Arrow.Flight.Tests.dll (net7.0)
1
Error: `docker-compose --file /home/runner/work/crossbow/crossbow/arrow/docker-compose.yml run --rm ubuntu-csharp` exited with a non-zero exit code 1, see the process log above.

Component(s)

C#, Continuous Integration, Packaging

About this issue

Original URL
State: closed
Created a year ago
Comments: 18 (18 by maintainers)

Commits related to this issue

GH-36863: [C#][Packaging] Do not shutdown PythonEngine on CDataInterfacePythonTests if .NET is > 5.0 — committed to raulcd/arrow by raulcd a year ago
GH-36863: [C#][Packaging] Do not shutdown PythonEngine on CDataInterfacePythonTests if .NET is > 5.0 (#36868) ### Rationale for this change Tests are failing on maintenance branch to generate Nuget ... — committed to apache/arrow by raulcd a year ago
GH-36863: [C#][Packaging] Do not shutdown PythonEngine on CDataInterfacePythonTests if .NET is > 5.0 (#36868) ### Rationale for this change Tests are failing on maintenance branch to generate Nuget ... — committed to apache/arrow by raulcd a year ago
GH-36863: [C#] Remove unnecessary applied fix to not shutdown PythonEngine on CDataInterfacePythonTests if .NET is > 5.0 — committed to raulcd/arrow by raulcd a year ago
GH-36863: [C#] Remove unnecessary applied fix to not shutdown PythonEngine on CDataInterfacePythonTests if .NET is > 5.0 (#36872) ### Rationale for this change Maintenance branch fix is not necessar... — committed to apache/arrow by raulcd a year ago
GH-36863: [C#][Packaging] Do not shutdown PythonEngine on CDataInterfacePythonTests if .NET is > 5.0 (#36868) ### Rationale for this change Tests are failing on maintenance branch to generate Nuget ... — committed to R-JunmingChen/arrow by raulcd a year ago
GH-36863: [C#] Remove unnecessary applied fix to not shutdown PythonEngine on CDataInterfacePythonTests if .NET is > 5.0 (#36872) ### Rationale for this change Maintenance branch fix is not necessar... — committed to R-JunmingChen/arrow by raulcd a year ago
GH-36863: [C#][Packaging] Do not shutdown PythonEngine on CDataInterfacePythonTests if .NET is > 5.0 (#36868) ### Rationale for this change Tests are failing on maintenance branch to generate Nuget ... — committed to loicalleyne/arrow by raulcd a year ago
GH-36863: [C#] Remove unnecessary applied fix to not shutdown PythonEngine on CDataInterfacePythonTests if .NET is > 5.0 (#36872) ### Rationale for this change Maintenance branch fix is not necessar... — committed to loicalleyne/arrow by raulcd a year ago

Most upvoted comments

I’ve reverted https://github.com/apache/arrow/commit/d9b90035ddf273fa547d34ad2f4b04c15af3704a from the maintenance branch and I have cherry-picked https://github.com/apache/arrow/commit/b4775012ab0f7d8f996538af69f7d1c732f16ff0 This fixed the issue as seen on the latest run: https://github.com/ursacomputing/crossbow/actions/runs/5659869798/job/15334334744 I’ve pushed a new PR to remove the previous commit on main: https://github.com/apache/arrow/pull/36872

raulcd on Jul 25, 2023