hudi: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support

Tips before filing an issue

Have you gone through our FAQs? yes
Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced

Tried building the latest master using the command mvn clean install -DskipTests. It fails with the below error - [ERROR] Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run (proto-compile) on project hudi-utilities_2.11: Error extracting protoc for version 3.21.5: Unsupported platform: protoc-3.21.5-osx-x86_64.exe -> [Help 1]

To Reproduce

Steps to reproduce the behavior:

Use M1 mac
Try building the project using mvn clean install -DskipTests

Expected behavior

Build should finish successfully.

About this issue

Original URL
State: closed
Created 2 years ago
Reactions: 1
Comments: 28 (27 by maintainers)

Most upvoted comments

I also meet this problem😂. Thanks everyone below this issue.

ERROR

[INFO]
[INFO] --- protoc-jar-maven-plugin:3.11.4:run (proto-compile) @ hudi-utilities_2.11 ---
[INFO] Protoc version: 3.21.5
protoc-jar: protoc version: 3.21.5, detected platform: osx-aarch_64 (mac os x/aarch64)
protoc-jar: downloading: http://repo1.maven.org/maven2/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: downloading: http://repo1.maven.org/maven2/com/github/os72/protoc/maven-metadata.xml
protoc-jar: downloading: http://repo1.maven.org/maven2/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: downloading: http://repo1.maven.org/maven2/com/github/os72/protoc/maven-metadata.xml
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Hudi 0.13.0-SNAPSHOT:
....
[ERROR] Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run (proto-compile) on project hudi-utilities_2.11: Error extracting protoc for version 3.21.5: Unsupported platform: protoc-3.21.5-osx-aarch_64.exe -> [Help 1]

mvn -v
Apache Maven 3.8.6 (84538c9988a25aec085021c365c560670ad80f63)
Maven home: /opt/homebrew/Cellar/maven/3.8.6/libexec
Java version: 1.8.0_352, vendor: Amazon.com Inc., runtime: Library/Java/JavaVirtualMachines/corretto-1.8.0_352/Contents/Home/jre
Default locale: en_CN, platform encoding: UTF-8
OS name: "mac os x", version: "12.6.1", arch: "aarch64", family: "mac"

Solution

After I delete settings.xml and cached protoc binary(os72, google/protobuf).It work successfully. The key is that delete settings.xml, just remove cache is useless

jackwener on Jan 11, 2023

i was able to run successful build locally without any customisations and with empty setting.xml and deleted previously cached protoc binary

slachiewicz on Sep 23, 2022