构建 Apache Zeppelin 时出错

Posted 2023-03-23

【中文标题】构建 Apache Zeppelin 时出错

【英文标题】：Getting error while building the Apache Zeppelin

【发布时间】：2017-04-12 19:39:24

【问题描述】：

我已经用 cloudera 设置了我的 hadoop。我想安装 zeppelin 来连接 hive 并为我的查询构建 UI。使用以下命令构建 zeppelin 命令时：

sudo mvn clean package -Pspark-1.3 -Dspark.version=1.3.0 -Dhadoop.version=2.6.0-cdh5.4.7 -Phadoop-2.6 -Pyarn -DskipTests

我在 web 应用程序模块收到此错误：

[ERROR] npm ERR! Linux 3.19.0-71-generic
[ERROR] npm ERR! argv "/home/zeppelin/incubator-zeppelin/zeppelin-web/node/node" "/home/zeppelin/incubator-zeppelin/zeppelin-web/node/node_modules/npm/bin/npm-cli.js" "run" "build"
[ERROR] npm ERR! node v4.6.2
[ERROR] npm ERR! npm  v3.10.9
[ERROR] npm ERR! code ELIFECYCLE
[ERROR] npm ERR! zeppelin-web@0.0.0 build: `grunt build`
[ERROR] npm ERR! Exit status 3
[ERROR] npm ERR!
[ERROR] npm ERR! Failed at the zeppelin-web@0.0.0 build script 'grunt build'.
[ERROR] npm ERR! Make sure you have the latest version of node.js and npm installed.
[ERROR] npm ERR! If you do, this is most likely a problem with the zeppelin-web package,
[ERROR] npm ERR! not with npm itself.
[ERROR] npm ERR! Tell the author that this fails on your system:
[ERROR] npm ERR!     grunt build
[ERROR] npm ERR! You can get information on how to open an issue for this project with:
[ERROR] npm ERR!     npm bugs zeppelin-web
[ERROR] npm ERR! Or if that isn't available, you can get their info via:
[ERROR] npm ERR!     npm owner ls zeppelin-web
[ERROR] npm ERR! There is likely additional logging output above.
[ERROR]
[ERROR] npm ERR! Please include the following file with any support request:
[ERROR] npm ERR!     /home/zeppelin/incubator-zeppelin/zeppelin-web/npm-debug.log
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Zeppelin ........................................... SUCCESS [  2.527 s]
[INFO] Zeppelin: Interpreter .............................. SUCCESS [  6.355 s]
[INFO] Zeppelin: Zengine .................................. SUCCESS [  3.253 s]
[INFO] Zeppelin: Display system apis ...................... SUCCESS [  9.241 s]
[INFO] Zeppelin: Spark dependencies ....................... SUCCESS [ 16.473 s]
[INFO] Zeppelin: Spark .................................... SUCCESS [ 13.479 s]
[INFO] Zeppelin: Markdown interpreter ..................... SUCCESS [  0.270 s]
[INFO] Zeppelin: Angular interpreter ...................... SUCCESS [  0.162 s]
[INFO] Zeppelin: Shell interpreter ........................ SUCCESS [  0.211 s]
[INFO] Zeppelin: Livy interpreter ......................... SUCCESS [  2.485 s]
[INFO] Zeppelin: HBase interpreter ........................ SUCCESS [  1.742 s]
[INFO] Zeppelin: Apache Pig Interpreter ................... SUCCESS [  1.367 s]
[INFO] Zeppelin: PostgreSQL interpreter ................... SUCCESS [  0.294 s]
[INFO] Zeppelin: JDBC interpreter ......................... SUCCESS [  0.565 s]
[INFO] Zeppelin: File System Interpreters ................. SUCCESS [  0.514 s]
[INFO] Zeppelin: Flink .................................... SUCCESS [  3.358 s]
[INFO] Zeppelin: Apache Ignite interpreter ................ SUCCESS [  0.367 s]
[INFO] Zeppelin: Kylin interpreter ........................ SUCCESS [  0.218 s]
[INFO] Zeppelin: Python interpreter ....................... SUCCESS [  0.252 s]
[INFO] Zeppelin: Lens interpreter ......................... SUCCESS [  1.496 s]
[INFO] Zeppelin: Apache Cassandra interpreter ............. SUCCESS [ 29.842 s]
[INFO] Zeppelin: Elasticsearch interpreter ................ SUCCESS [  1.322 s]
[INFO] Zeppelin: BigQuery interpreter ..................... SUCCESS [  0.389 s]
[INFO] Zeppelin: Alluxio interpreter ...................... SUCCESS [  1.106 s]
[INFO] Zeppelin: Scio ..................................... SUCCESS [ 23.182 s]
[INFO] Zeppelin: web Application .......................... FAILURE [  8.124 s]
[INFO] Zeppelin: Server ................................... SKIPPED
[INFO] Zeppelin: Packaging distribution ................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:09 min
[INFO] Finished at: 2016-11-28T18:16:15-05:00
[INFO] Final Memory: 524M/2992M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.3:npm (npm build) on project zeppelin-web: Failed to run task: 'npm run build' failed. (error code 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :zeppelin-web

我的安装有几个版本：

Hadoop 2.6.0-cdh5.4.7
java version "1.7.0_111"
Hive 1.1.0-cdh5.4.7
git version 1.9.1
nodejs - v7.2.0
npm - 3.10.9
Apache Maven 3.3.9 
Spark 1.3.0

我尝试了很多方法来解决这个问题，但没有运气。任何人都可以让我解决这个问题并成功运行构建。非常感谢您的回复和时间。

编辑

my npm install in zeppelin-web 提供以下输出：

npm WARN deprecated minimatch@0.3.0: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated CSSselect@0.7.0: the module is now available as 'css-select'
npm WARN deprecated CSSwhat@0.4.7: the module is now available as 'css-what'
npm WARN deprecated minimatch@0.2.14: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated graceful-fs@1.2.3: graceful-fs v3.0.0 and before will fail on node releases >= v7.0. Please update to graceful-fs@^4.0.0 as soon as possible. Use 'npm ls graceful-fs' to find it in the tree.
npm WARN deprecated node-uuid@1.4.7: use uuid module instead
npm WARN deprecated minimatch@2.0.10: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated graceful-fs@2.0.3: graceful-fs v3.0.0 and before will fail on node releases >= v7.0. Please update to graceful-fs@^4.0.0 as soon as possible. Use 'npm ls graceful-fs' to find it in the tree.
npm WARN prefer global jsonlint@1.6.2 should be installed with -g
npm WARN prefer global jshint@2.8.0 should be installed with -g
npm WARN lifecycle zeppelin-web@0.0.0~postinstall: cannot run in wd %s %s (wd=%s) zeppelin-web@0.0.0 bower install --silent /home/zeppelin/incubator-zeppelin/zeppelin-web
zeppelin-web@0.0.0 /home/zeppelin/incubator-zeppelin/zeppelin-web

我没有在这里复制树，因为这里复制太长了。谢谢。

【问题讨论】：

孵化器飞艇？为什么不使用最新版本的 Zeppelin 和 Spark？

什么意思？我必须用我当前的 hadoop 安装它。

incubator-zeppelin 应该在 0.5.6 之前，现在 zeppelin 在 0.6.2。 Spark 1.4 也很老了，最新版本是 2.0.2。

【参考方案1】：

每当我在 web 应用程序上遇到问题时，我都会按照程序进行操作。

cd zeppelin-web目录 删除 node_modules 目录 输入npm install

如果你想用 CDH 构建 Zeppelin，你应该在你的构建命令中添加-Pvendor-repo 选项。

你可以在here看到一些构建命令示例

希望这会有所帮助。

【讨论】：

感谢您的回复。我试过这个，它仍然给我同样的错误。我执行了您为 CDH 提供的链接中提到的相同命令，但没有运气。我怎么能以其他方式排除故障？感谢您的回复。

你能把zeppelin-web/bower_components/前面的npm install也去掉吗？

我在 zeppelin-web 中找不到 bower_components ！！

可以升级node 版本吗？

仅供参考我的node 版本是v5.9.1 和npm 版本是3.7.3，你能附上npm install 的所有输出吗？

【参考方案2】：

问题在于 zeppelin build 已更新到 v0.6.2 请在克隆孵化器后添加：

git 克隆https://github.com/apache/incubator-zeppelin.git cd 孵化器-zeppelin git checkout c928f9a46ecacebc868d6dc10a95c02f9018a18e cd ../

Maven 将使用 zeppelin build 0.6.1，它应该可以完成而没有任何错误。

【讨论】：

我在哪个目录路径下做 git clone ？

如果使用pegasus修改文件为：pegasus/install/zeppelin/install_zeppelin.sh

感谢它对我有用。我明天有演讲，你救了我。感谢您的回复。

我不明白“如果你使用 pegasus 修改的文件是：pegasus/install/zeppelin/install_zeppelin.sh”这个虽然！你能解释一下吗？

不客气！这个问题困扰了我这几天。抱歉，我假设您正在使用项目 pegasus 来安装您的环境，因为您的问题与我的完全相同。也许这个解决方案会帮助更多的人。