编译dr-elephant遇到的问题

Posted 2020-12-10 songchaolin

本地scala version为2.11.8，spark为2.4.0版本

于是修改dr-elephant/build.sbt 

scalaVersion := "2.11.8"

修改dr-elephant/compile.conf

hadoop_version=2.8.4
spark_version=2.4.0
play_opts="-Dsbt.repository.config=app-conf/resolver.conf"

修改dr-elephant/compile.sh

# Default configurations
HADOOP_VERSION="2.8.4"
SPARK_VERSION="2.4.0"

在根目录下执行 ./complie.sh

 

 

 

 在dr-elephant 项目中并没有scala的版本依赖

修改dr-elephant bilibili$ cd project 下面有这些文件

Dependencies.scala                    findbugs-exclude-filters.xml
build.properties                    plugins.sbt
checkstyle-config.xml                    project
checkstyle-java.header                    scalastyle-config.xml
checkstyle-noframes-severity-sorted-modified.xsl    scalastyle_xml_to_html.py
checkstyle-suppressions.xml                target

vi  plugins.sbt 新增

scalaVersion := "2.11.8"

vi build.properties

#
# Copyright 2016 LinkedIn Corp.
#
# Licensed under the Apache License, Version 2.0 (the "License"); you may not
# use this file except in compliance with the License. You may obtain a copy of
# the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations under
# the License.
#

sbt.version=1.2.8

再次编译

 搞定 然而之后又报错如下

 

 缺少sbt-plugin 2.2.2 

看下 dr-elephant/project/plugins.sbt 看来问题在这

 对我使用来说,不需要这个插件 将其注释掉再次运行,解决此问题