arrow: [Java] Test failure in Dataset regarding `TestAllTypes`

Describe the bug, including details regarding any error messages, version, and platform.

There is a test failure regarding parquet based test cases in Dataset module. This issue was identified here.

Error:  Failures: 
Error:    TestAllTypes.testAllTypesParquet:261->TestDataset.assertParquetFileEquals:124 expected:<...length=2, nullCount=[2], ArrowFieldNode [length=0, nullCount=0], ArrowFieldNode [length=2, nullCount=2], ArrowFieldNode [length=0, nullCount=0], ArrowFieldNode [length=2, nullCount=2], ArrowFieldNode [length=0, nullCount=0], ArrowFieldNode [length=2, nullCount=2], ArrowFieldNode [length=2, nullCount=0]], #buffers=71, buffersLayout=[ArrowBuffer [offset=0, size=1], ArrowBuffer [offset=8, size=1], ArrowBuffer [offset=16, size=1], ArrowBuffer [offset=24, size=2], ArrowBuffer [offset=32, size=1], ArrowBuffer [offset=40, size=4], ArrowBuffer [offset=48, size=1], ArrowBuffer [offset=56, size=8], ArrowBuffer [offset=64, size=1], ArrowBuffer [offset=72, size=16], ArrowBuffer [offset=88, size=1], ArrowBuffer [offset=96, size=2], ArrowBuffer [offset=104, size=1], ArrowBuffer [offset=112, size=4], ArrowBuffer [offset=120, size=1], ArrowBuffer [offset=128, size=8], ArrowBuffer [offset=136, size=1], ArrowBuffer [offset=144, size=16], ArrowBuffer [offset=160, size=1], ArrowBuffer [offset=168, size=8], ArrowBuffer [offset=176, size=1], ArrowBuffer [offset=184, size=16], ArrowBuffer [offset=200, size=1], ArrowBuffer [offset=208, size=12], ArrowBuffer [offset=224, size=1], ArrowBuffer [offset=232, size=1], ArrowBuffer [offset=240, size=12], ArrowBuffer [offset=256, size=1], ArrowBuffer [offset=264, size=1], ArrowBuffer [offset=272, size=12], ArrowBuffer [offset=288, size=1], ArrowBuffer [offset=296, size=1], ArrowBuffer [offset=304, size=12], ArrowBuffer [offset=320, size=1], ArrowBuffer [offset=328, size=1], ArrowBuffer [offset=336, size=2], ArrowBuffer [offset=344, size=1], ArrowBuffer [offset=352, size=8], ArrowBuffer [offset=360, size=1], ArrowBuffer [offset=368, size=8], ArrowBuffer [offset=376, size=1], ArrowBuffer [offset=384, size=16], ArrowBuffer [offset=400, size=1], ArrowBuffer [offset=408, size=16], ArrowBuffer [offset=424, size=1], ArrowBuffer [offset=432, size=16], ArrowBuffer [offset=448, size=1], ArrowBuffer [offset=456, size=16], ArrowBuffer [offset=472, size=1], ArrowBuffer [offset=480, size=16], ArrowBuffer [offset=496, size=1], ArrowBuffer [offset=504, size=16], ArrowBuffer [offset=520, size=1], ArrowBuffer [offset=528, size=32], ArrowBuffer [offset=560, size=1], ArrowBuffer [offset=568, size=32], ArrowBuffer [offset=600, size=1], ArrowBuffer [offset=608, size=12], ArrowBuffer [offset=624, size=0], ArrowBuffer [offset=624, size=0], ArrowBuffer [offset=624, size=1], ArrowBuffer [offset=632, size=12], ArrowBuffer [offset=648, size=0], ArrowBuffer [offset=648, size=0], ArrowBuffer [offset=648, size=1], ArrowBuffer [offset=656, size=12], ArrowBuffer [offset=672, size=0], ArrowBuffer [offset=672, size=0], ArrowBuffer [offset=672, size=1], ArrowBuffer [offset=680, size=1], ArrowBuffer [offset=688], size=8]], closed=f...> but was:<...length=2, nullCount=[1], ArrowFieldNode [length=2, nullCount=2], ArrowFieldNode [length=0, nullCount=0], ArrowFieldNode [length=2, nullCount=2], ArrowFieldNode [length=0, nullCount=0], ArrowFieldNode [length=2, nullCount=2], ArrowFieldNode [length=0, nullCount=0], ArrowFieldNode [length=2, nullCount=2], ArrowFieldNode [length=2, nullCount=0]], #buffers=73, buffersLayout=[ArrowBuffer [offset=0, size=1], ArrowBuffer [offset=8, size=1], ArrowBuffer [offset=16, size=1], ArrowBuffer [offset=24, size=2], ArrowBuffer [offset=32, size=1], ArrowBuffer [offset=40, size=4], ArrowBuffer [offset=48, size=1], ArrowBuffer [offset=56, size=8], ArrowBuffer [offset=64, size=1], ArrowBuffer [offset=72, size=16], ArrowBuffer [offset=88, size=1], ArrowBuffer [offset=96, size=2], ArrowBuffer [offset=104, size=1], ArrowBuffer [offset=112, size=4], ArrowBuffer [offset=120, size=1], ArrowBuffer [offset=128, size=8], ArrowBuffer [offset=136, size=1], ArrowBuffer [offset=144, size=16], ArrowBuffer [offset=160, size=1], ArrowBuffer [offset=168, size=4], ArrowBuffer [offset=176, size=1], ArrowBuffer [offset=184, size=8], ArrowBuffer [offset=192, size=1], ArrowBuffer [offset=200, size=16], ArrowBuffer [offset=216, size=1], ArrowBuffer [offset=224, size=12], ArrowBuffer [offset=240, size=1], ArrowBuffer [offset=248, size=1], ArrowBuffer [offset=256, size=12], ArrowBuffer [offset=272, size=1], ArrowBuffer [offset=280, size=1], ArrowBuffer [offset=288, size=12], ArrowBuffer [offset=304, size=1], ArrowBuffer [offset=312, size=1], ArrowBuffer [offset=320, size=12], ArrowBuffer [offset=336, size=1], ArrowBuffer [offset=344, size=1], ArrowBuffer [offset=352, size=2], ArrowBuffer [offset=360, size=1], ArrowBuffer [offset=368, size=8], ArrowBuffer [offset=376, size=1], ArrowBuffer [offset=384, size=8], ArrowBuffer [offset=392, size=1], ArrowBuffer [offset=400, size=16], ArrowBuffer [offset=416, size=1], ArrowBuffer [offset=424, size=16], ArrowBuffer [offset=440, size=1], ArrowBuffer [offset=448, size=16], ArrowBuffer [offset=464, size=1], ArrowBuffer [offset=472, size=16], ArrowBuffer [offset=488, size=1], ArrowBuffer [offset=496, size=16], ArrowBuffer [offset=512, size=1], ArrowBuffer [offset=520, size=16], ArrowBuffer [offset=536, size=1], ArrowBuffer [offset=544, size=32], ArrowBuffer [offset=576, size=1], ArrowBuffer [offset=584, size=32], ArrowBuffer [offset=616, size=1], ArrowBuffer [offset=624, size=12], ArrowBuffer [offset=640, size=0], ArrowBuffer [offset=640, size=0], ArrowBuffer [offset=640, size=1], ArrowBuffer [offset=648, size=12], ArrowBuffer [offset=664, size=0], ArrowBuffer [offset=664, size=0], ArrowBuffer [offset=664, size=1], ArrowBuffer [offset=672, size=12], ArrowBuffer [offset=688, size=0], ArrowBuffer [offset=688, size=0], ArrowBuffer [offset=688, size=1], ArrowBuffer [offset=696, size=1], ArrowBuffer [offset=704], size=8]], closed=f...>

Component(s)

Java

About this issue

Original URL
State: closed
Created 4 months ago
Comments: 19 (8 by maintainers)

Commits related to this issue

GH-40568: [Java] Test failure in Dataset regarding TestAllTypes (#40662) ### Rationale for this change A recurring CI failure was observed as recorded in https://github.com/apache/arrow/issues/40568... — committed to apache/arrow by vibhatha 3 months ago

Most upvoted comments

Could you try git bisect to identify which commit is related to this?

kou on Mar 19, 2024

It seems that you mixed LLVM from conda and LLVM by apt:

CMake Warning at cmake_modules/FindLLVMAlt.cmake:58 (find_package):
  Could not find a configuration file for package "LLVM" that is compatible
  with requested version "18.1".

  The following configuration files were considered but not accepted:

    /home/asus/miniforge3/envs/pyarrow-dev/lib/cmake/llvm/LLVMConfig.cmake, version: 17.0.6
    /usr/lib/llvm-15/cmake/LLVMConfig.cmake, version: 15.0.7
    /usr/lib/llvm-13/cmake/LLVMConfig.cmake, version: 13.0.1
    /usr/lib/llvm-15/lib/cmake/llvm/LLVMConfig.cmake, version: 15.0.7
    /usr/lib/llvm-13/lib/cmake/llvm/LLVMConfig.cmake, version: 13.0.1
    /usr/lib/llvm-15/share/llvm/cmake/LLVMConfig.cmake, version: 15.0.7
    /usr/lib/llvm-13/share/llvm/cmake/LLVMConfig.cmake, version: 13.0.1
    /lib/llvm-15/cmake/LLVMConfig.cmake, version: 15.0.7
    /lib/llvm-13/cmake/LLVMConfig.cmake, version: 13.0.1

Call Stack (most recent call first):
  src/gandiva/CMakeLists.txt:30 (find_package)


-- Using LLVMConfig.cmake in: /home/asus/miniforge3/envs/pyarrow-dev/lib/cmake/llvm
-- Found llvm-link /usr/lib/llvm-15/bin/llvm-link
-- Found clang /usr/lib/llvm-15/bin/clang-15

kou on Mar 15, 2024

Or could you also install clang by conda?

kou on Mar 15, 2024

Could you remove llvm installed by conda?

kou on Mar 15, 2024

Could you also show dpkg -l | grep libstd?

kou on Mar 15, 2024