velox: Cannot access memory at address in StringDictionaryEncoder::addKey

We encounter the following exceptions when using the Writer API to write DWRF file with large num rows.

0x00007f0f39221859 in __GI_abort () at abort.c:79 #2 0x00007f0f385a9f1f in ?? () from /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so #3 0x00007f0f38eeb143 in ?? () from /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so #4 0x00007f0f38d3cd30 in JVM_handle_linux_signal () from /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so #5 0x00007f0f38d3002c in ?? () from /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so #6 <signal handler called> #7 folly::detail::crc32_detail::align_to_8 (next=<optimized out>, crc0=<optimized out>, align=7) at ../folly/hash/detail/Crc32cDetail.cpp:171 #8 folly::detail::crc32c_hw ( buf=0x32312d37302d3739 <error: Cannot access memory at address 0x32312d37302d3739>, len=758591533, crc=0) at ../folly/hash/detail/Crc32cDetail.cpp:251 #9 0x00007f0e1f8f6b90 in folly::crc32c ( data=0x32312d37302d3739 <error: Cannot access memory at address 0x32312d37302d3739>, nbytes=758591533, startingChecksum=0) at ../folly/hash/Checksum.cpp:133 #10 0x00007f0e1f2aa65b in facebook::velox::dwrf::StringDictionaryEncoder::addKey(folly::Range<char const*>, unsigned int, unsigned int) () from /tmp/spark_columnar_plugin_9017457352165741288/libvelox.so #11 0x00007f0e1f28be1e in facebook::velox::dwrf::(anonymous namespace)::StringColumnWriter::write(std::shared_ptr<facebook::velox::BaseVector> const&, facebook::velox::dwrf::Ranges const&) () from /tmp/spark_columnar_plugin_9017457352165741288/libvelox.so #12 0x00007f0e1f285151 in facebook::velox::dwrf::(anonymous namespace)::StructColumnWriter::writeChildrenAndStats(facebook::velox::RowVector const*, facebook::velox::dwrf::Ranges const&, unsigned long) () from /tmp/spark_columnar_plugin_9017457352165741288/libvelox.so #13 0x00007f0e1f28961b in facebook::velox::dwrf::(anonymous namespace)::StructColumnWriter::write(std::shared_ptr<facebook::velox::BaseVector> const&, facebook::velox::dwrf::Ranges const&) () from /tmp/spark_columnar_plugin_9017457352165741288/libvelox.so #14 0x00007f0e1f2dddd7 in facebook::velox::dwrf::Writer::write(std::shared_ptr<facebook::velox::BaseVector> const&) () from /tmp/spark_columnar_plugin_9017457352165741288/libvelox.so @mbasmanova Do you have any comments?