解决mac下transport-native-unix-common编译失败问题

发表于 分类于 Waline： 阅读次数：

Mac 下编译 netty 报错，提示 Netty/Transport/Native/Unix/Common 模块编译失败，到网上搜索一下，并未发现有人遇到过类似问题，因此做下记录。

问题排查

Netty 源码来自 https://github.com/netty/netty.git，使用的是 4.1 分支

编译使用的命令是 mvn clean install -Dmaven.test.skip

编译结果如下

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
[INFO] Reactor Summary for Netty 4.1.59.Final-SNAPSHOT:
[INFO] 
[INFO] Netty/Dev-Tools .................................... SUCCESS [  0.702 s]
[INFO] Netty .............................................. SUCCESS [  7.312 s]
[INFO] Netty/Common ....................................... SUCCESS [ 12.437 s]
[INFO] Netty/Buffer ....................................... SUCCESS [  6.144 s]
[INFO] Netty/Resolver ..................................... SUCCESS [  2.562 s]
[INFO] Netty/Transport .................................... SUCCESS [  5.945 s]
[INFO] Netty/Codec ........................................ SUCCESS [  6.889 s]
[INFO] Netty/Codec/DNS .................................... SUCCESS [  2.848 s]
[INFO] Netty/Codec/HAProxy ................................ SUCCESS [  2.426 s]
[INFO] Netty/Handler ...................................... SUCCESS [  7.069 s]
[INFO] Netty/Codec/HTTP ................................... SUCCESS [  7.346 s]
[INFO] Netty/Codec/HTTP2 .................................. SUCCESS [  6.570 s]
[INFO] Netty/Codec/Memcache ............................... SUCCESS [  2.425 s]
[INFO] Netty/Codec/MQTT ................................... SUCCESS [  2.799 s]
[INFO] Netty/Codec/Redis .................................. SUCCESS [  2.397 s]
[INFO] Netty/Codec/SMTP ................................... SUCCESS [  2.103 s]
[INFO] Netty/Codec/Socks .................................. SUCCESS [  2.930 s]
[INFO] Netty/Codec/Stomp .................................. SUCCESS [  2.212 s]
[INFO] Netty/Codec/XML .................................... SUCCESS [  2.235 s]
[INFO] Netty/Handler/Proxy ................................ SUCCESS [  2.279 s]
[INFO] Netty/Resolver/DNS ................................. SUCCESS [  3.554 s]
[INFO] Netty/Transport/RXTX ............................... SUCCESS [  1.993 s]
[INFO] Netty/Transport/SCTP ............................... SUCCESS [  2.579 s]
[INFO] Netty/Transport/UDT ................................ SUCCESS [  2.602 s]
[INFO] Netty/Example ...................................... SUCCESS [  5.584 s]
[INFO] Netty/Transport/Native/Unix/Common ................. FAILURE [  0.245 s]
[INFO] Netty/Testsuite .................................... SKIPPED
[INFO] Netty/Transport/Native/Unix/Common/Tests ........... SKIPPED
[INFO] Netty/Transport/Native/KQueue ...................... SKIPPED
[INFO] Netty/Resolver/DNS/MacOS ........................... SKIPPED
[INFO] Netty/Transport/Native/Epoll ....................... SKIPPED
[INFO] Netty/All-in-One ................................... SKIPPED
[INFO] Netty/Tarball ...................................... SKIPPED
[INFO] Netty/Testsuite/Autobahn ........................... SKIPPED
[INFO] Netty/Testsuite/Http2 .............................. SKIPPED
[INFO] Netty/Testsuite/OSGI ............................... SKIPPED
[INFO] Netty/Testsuite/Shading ............................ SKIPPED
[INFO] Netty/Testsuite/Native ............................. SKIPPED
[INFO] Netty/Testsuite/NativeImage ........................ SKIPPED
[INFO] Netty/Testsuite/NativeImage/Client ................. SKIPPED
[INFO] Netty/Testsuite/NativeImage/ClientRuntimeInit ...... SKIPPED
[INFO] Netty/Transport/BlockHound/Tests ................... SKIPPED
[INFO] Netty/Microbench ................................... SKIPPED
[INFO] Netty/BOM .......................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------

很明显是 Netty/Transport/Native/Unix/Common 编译未通过，查看后面的报错提示

1
2
3
4
5
6
7
8
9
10
11
12
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.8:run (build-native-lib) on project netty-transport-native-unix-common: An Ant BuildException has occured: exec returned: 1
[ERROR] around Ant part ...<exec resolveexecutable="true" failonerror="true" executable="make">... @ 4:71 in /Users/gorden5566/github/netty/transport-native-unix-common/target/antrun/build-main.xml
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :netty-transport-native-unix-common

出现一个 Ant 构建异常，加上 -X 参数重新执行编译，命令如下

1
mvn clean install -Dmaven.test.skip=true -X

得到如下提示信息

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.8:run (build-native-lib) on project netty-transport-native-unix-common: An Ant BuildException has occured: exec returned: 1
[ERROR] around Ant part ...<exec resolveexecutable="true" failonerror="true" executable="make">... @ 4:71 in /Users/gorden5566/github/netty/transport-native-unix-common/target/antrun/build-main.xml
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.8:run (build-native-lib) on project netty-transport-native-unix-common: An Ant BuildException has occured: exec returned: 1
around Ant part ...<exec resolveexecutable="true" failonerror="true" executable="make">... @ 4:71 in /Users/gorden5566/github/netty/transport-native-unix-common/target/antrun/build-main.xml
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:957)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:289)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:193)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.apache.maven.wrapper.BootstrapMainStarter.start (BootstrapMainStarter.java:39)
    at org.apache.maven.wrapper.WrapperExecutor.execute (WrapperExecutor.java:122)
    at org.apache.maven.wrapper.MavenWrapperMain.main (MavenWrapperMain.java:60)
Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant BuildException has occured: exec returned: 1
around Ant part ...<exec resolveexecutable="true" failonerror="true" executable="make">... @ 4:71 in /Users/gorden5566/github/netty/transport-native-unix-common/target/antrun/build-main.xml
    at org.apache.maven.plugin.antrun.AntRunMojo.execute (AntRunMojo.java:342)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:957)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:289)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:193)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.apache.maven.wrapper.BootstrapMainStarter.start (BootstrapMainStarter.java:39)
    at org.apache.maven.wrapper.WrapperExecutor.execute (WrapperExecutor.java:122)
    at org.apache.maven.wrapper.MavenWrapperMain.main (MavenWrapperMain.java:60)
Caused by: org.apache.tools.ant.BuildException: exec returned: 1
    at org.apache.tools.ant.taskdefs.ExecTask.runExecute (ExecTask.java:646)
    at org.apache.tools.ant.taskdefs.ExecTask.runExec (ExecTask.java:671)
    at org.apache.tools.ant.taskdefs.ExecTask.execute (ExecTask.java:497)
    at org.apache.tools.ant.UnknownElement.execute (UnknownElement.java:293)
    at sun.reflect.GeneratedMethodAccessor30.invoke (Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.apache.tools.ant.dispatch.DispatchUtils.execute (DispatchUtils.java:106)
    at org.apache.tools.ant.Task.perform (Task.java:352)
    at org.apache.tools.ant.Target.execute (Target.java:437)
    at org.apache.tools.ant.Target.performTasks (Target.java:458)
    at org.apache.tools.ant.Project.executeSortedTargets (Project.java:1406)
    at org.apache.tools.ant.Project.executeTarget (Project.java:1377)
    at org.apache.maven.plugin.antrun.AntRunMojo.execute (AntRunMojo.java:313)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:957)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:289)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:193)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.apache.maven.wrapper.BootstrapMainStarter.start (BootstrapMainStarter.java:39)
    at org.apache.maven.wrapper.WrapperExecutor.execute (WrapperExecutor.java:122)
    at org.apache.maven.wrapper.MavenWrapperMain.main (MavenWrapperMain.java:60)
[ERROR] 
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :netty-transport-native-unix-common

有这样一行

1
Caused by: org.apache.tools.ant.BuildException: exec returned: 1

看上去是 Ant 命令安装有问题，但不知道是什么原因。往上翻下提示，看看有没有执行信息提示

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
[INFO] Executing tasks
Build sequence for target(s) `main' is [main]
Complete build sequence is [main, ]

main:
     [exec] Current OS is Mac OS X
     [exec] Setting environment variable: CC=clang
     [exec] Setting environment variable: AR=ar
     [exec] Setting environment variable: LIB_DIR=/Users/gorden5566/github/netty/transport-native-unix-common/target/native-lib-only
     [exec] Setting environment variable: OBJ_DIR=/Users/gorden5566/github/netty/transport-native-unix-common/target/native-objs-only
     [exec] Setting environment variable: JNI_PLATFORM=darwin
     [exec] Setting environment variable: CFLAGS=-O3 -Werror -Wno-attributes -fPIC -fno-omit-frame-pointer -Wunused-variable -fvisibility=hidden
     [exec] Setting environment variable: LDFLAGS=-Wl,--no-as-needed -lrt
     [exec] Setting environment variable: LIB_NAME=libnetty-unix-common
     [exec] Setting environment variable: MACOSX_DEPLOYMENT_TARGET=10.2
     [exec] Executing 'make'
     [exec] The ' characters around the executable and arguments are
     [exec] not part of the command.
Execute:Java13CommandLauncher: Executing 'make'
The ' characters around the executable and arguments are
not part of the command.
     [exec] xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun

发现是少了 /Library/Developer/CommandLineTools/usr/bin/xcrun

这个提示好熟悉，是还未安装 Xcode Comand-line Tools

执行如下命令下载并安装

1
xcode-select --install

然后重新编译，提示如下信息

1
2
3
4
5
6
7
8
9
main:
     [exec] In file included from src/main/c/netty_unix.c:16:mkdir -p /Users/gorden5566/github/netty/transport-native-unix-common/target/native-objs-only
     [exec] 
     [exec] src/main/c/netty_unix_jni.h:19:10: fatal error: 'jni.h' file not found
     [exec] #include <jni.h>
     [exec]          ^~~~~~~clang -o /Users/gorden5566/github/netty/transport-native-unix-common/target/native-objs-only/netty_unix.o -c src/main/c/netty_unix.c -O3 -Werror -Wno-attributes -fPIC -fno-omit-frame-pointer -Wunused-variable -fvisibility=hidden -I/include -I/include/darwin -Itarget/netty-jni-util
     [exec] 
     [exec] 1 error generated.
     [exec] make: *** [/Users/gorden5566/github/netty/transport-native-unix-common/target/native-objs-only/netty_unix.o] Error 1

未找到 jni.h 头文件。

检查 JAVA_HOME，发现并未设置

1
2
➜  ~ echo $JAVA_HOME

添加 JAVA_HOME 变量后编译通过

总结

若 netty 编译失败，请检查以下各项是否正常

  1. Xcode Comand-line Tools

    新安装的 mac 系统，默认是未安装的，可执行 xcode-select --install 命令安装

  2. JAVA_HOME

    若未设置，会提示找不到 jni.h 头文件

  3. 安装必要的工具和 lib 库

    1
    brew install autoconf automake libtool

  4. 如果你是用的 Linux 系统，请参考以下命令安装依赖

    1
    2
    3
    4
    5
    6
    7
    # RHEL/CentOS/Fedora:
    sudo yum install autoconf automake libtool make tar \
                     glibc-devel \
                     libgcc.i686 glibc-devel.i686
    # Debian/Ubuntu:
    sudo apt-get install autoconf automake libtool make tar \
                         gcc

更多信息请参考 Native transports

相关文章
  • 2019-09-28
    JNI入门之HelloWorld

    本文通过编写一个简单的 HelloWorld 带你熟悉下 JNI，包括如何编写一个 JNI 方法，如何打包成动态链接库，如何加载并调用等。

  • 2021-04-08
    一次诡异的NoSuchMethodError问题排查

    最近遇到了一次诡异的 NoSuchMethodError 错误，通常情况下遇到这个报错，大概率是类加载冲突导致的，然而这次的情况却不大一样。

  • 2019-10-13
    如何查找 jdk 中的 native 实现

    jdk 中有很多 native 方法，比如 Object 类的 registerNatives 方法、String 类的 intern 方法等。这些方法在 java 层面只有接口定义，具体的方法实现则是在 jdk 中，采用 c/c++ 实现。本文主要讲下如何找到 native 方法的实现。

  • 2019-10-19
    netty的direct memory大小设置

    最近遇到一个 netty 的 OutOfDirectMemoryError 报错，是在分配 direct memory 时内存不足导致的，看了下报错提示，要分配的内存大小为 16M，剩余的空间不足。这里 max direct memory 大约有 7G，于是就有一个疑问，这个值是怎么设置的？

  • 2021-02-03
    netty的Promise源码分析

    netty 使用 DefaultPromise 完成异步操作，它对 jdk 的 Future 进行了扩展，提供了更丰富的功能。