lz4-java: Unexpected error of the latest v1.7.0 in Spark on Mac OS X 10.13 (older macOS)

Hi, @odaira, thanks for tough work in advance!

We now use the latest lz4-java (v1.7.0) and we got an error report from a Spark user below;

dyld: lazy symbol binding failed: Symbol not found: ____chkstk_darwin
  Referenced from: /private/var/folders/1v/ckh8py712_n_5r628_16w0l40000gn/T/liblz4-java-820584040681098780.dylib (which was built for Mac OS X 10.15)
  Expected in: /usr/lib/libSystem.B.dylibdyld: Symbol not found: ____chkstk_darwin
  Referenced from: /private/var/folders/1v/ckh8py712_n_5r628_16w0l40000gn/T/liblz4-java-820584040681098780.dylib (which was built for Mac OS X 10.15)
  Expected in: /usr/lib/libSystem.B.dylib

https://issues.apache.org/jira/browse/SPARK-30196?page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel&focusedCommentId=17005066#comment-17005066

Any info about that?

Bests, Takeshi

About this issue

Original URL
State: closed
Created 5 years ago
Reactions: 1
Comments: 17 (13 by maintainers)

Commits related to this issue

Set the target of macOS JNI binding to 10.9 (#156) — committed to lz4/lz4-java by odaira 4 years ago
MINOR: Update dependencies for Kafka 2.5 (#7909) Noteworthy: * zstd decompression speed improvement of ~10%: https://github.com/facebook/zstd/releases/tag/v1.4.4 * EasyMock, PowerMock and Mockito:... — committed to apache/kafka by ijuma 4 years ago
Set the target of macOS JNI binding to 10.9 (#156) — committed to lz4/lz4-java by odaira 4 years ago

Most upvoted comments

I was using the if flag of compilerarg wrong. I’ll release 1.7.1 by the end of next week.

odaira on Jan 10, 2020

Released 1.7.1.

odaira on Jan 18, 2020

Many thanks!

maropu on Jan 10, 2020

In order to make this easier to test, maybe we could use a Travis CI cross-build to test on both Ubuntu and OS X. According to its docs, it looks like Travis supports macOS v10.10 through v10.14.

joshrosen-stripe on Jan 8, 2020

@maropu @lfrancke Could you check if this jar causes the error on macOS 10.13 or before? https://oss.sonatype.org/service/local/repositories/snapshots/content/org/lz4/lz4-java/1.8-SNAPSHOT/lz4-java-1.8-20200108.044929-1.jar

odaira on Jan 8, 2020