Spark maven 依赖破坏了 spring-boot 应用程序

Posted

技术标签:

【中文标题】Spark maven 依赖破坏了 spring-boot 应用程序【英文标题】:Spark maven dependency breaks down sprint-boot application 【发布时间】:2016-10-20 16:05:47 【问题描述】:

我有一个带有 Swing GUI 的 spring-boot 应用程序。它只是工作!但是,只要我将 spark 2.0 依赖项添加到 pom.xml 文件,它就会在启动过程中显示以下错误消息并且不会启动!

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/ehsun7b/.m2/repository/ch/qos/logback/logback-classic/1.1.7/logback-classic-1.1.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/ehsun7b/.m2/repository/org/slf4j/slf4j-log4j12/1.7.21/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]

  .   ____          _            __ _ _
 /\\ / ___'_ __ _ _(_)_ __  __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
 \\/  ___)| |_)| | | | | || (_| |  ) ) ) )
  '  |____| .__|_| |_|_| |_\__, | / / / /
 =========|_|==============|___/=/_/_/_/
 :: Spring Boot ::        (v1.4.1.RELEASE)

2016-10-21 00:02:23.795  INFO 1642 --- [           main] edu.mfldclin.mcrf.vakilabad.Application  : Starting Application on Ehsuns-MacBook-Pro.local with PID 1642 (/Users/ehsun7b/NetBeansProjects/vakilabad/target/classes started by ehsun7b in /Users/ehsun7b/NetBeansProjects/vakilabad)
2016-10-21 00:02:23.797  INFO 1642 --- [           main] edu.mfldclin.mcrf.vakilabad.Application  : No active profile set, falling back to default profiles: default
2016-10-21 00:02:23.839  INFO 1642 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@67c27493: startup date [Fri Oct 21 00:02:23 MYT 2016]; root of context hierarchy
2016-10-21 00:02:24.290  INFO 1642 --- [           main] f.a.AutowiredAnnotationBeanPostProcessor : JSR-330 'javax.inject.Inject' annotation found and supported for autowiring
2016-10-21 00:02:25.650  INFO 1642 --- [           main] e.m.mcrf.vakilabad.log.LogService        : LogService init.
2016-10-21 00:02:25.767  INFO 1642 --- [           main] e.mfldclin.mcrf.vakilabad.log.LogFrame   : Adding LogFrame instance to the LogMonitors of LogService: edu.mfldclin.mcrf.vakilabad.log.LogFrame[frame0,0,2,511x390,invalid,hidden,layout=java.awt.BorderLayout,title=Log since 2016-10-21T00:02:25.750,resizable,normal,defaultCloseOperation=DISPOSE_ON_CLOSE,rootPane=javax.swing.JRootPane[,0,22,511x368,invalid,layout=javax.swing.JRootPane$RootLayout,alignmentX=0.0,alignmentY=0.0,border=,flags=16777673,maximumSize=,minimumSize=,preferredSize=],rootPaneCheckingEnabled=true]
2016-10-21 00:02:25.897  WARN 1642 --- [           main] s.c.a.AnnotationConfigApplicationContext : Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'org.springframework.boot.autoconfigure.info.ProjectInfoAutoConfiguration': Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'spring.info-org.springframework.boot.autoconfigure.info.ProjectInfoProperties': Initialization of bean failed; nested exception is javax.validation.ValidationException: Unable to create a Configuration, because no Bean Validation provider could be found. Add a provider like Hibernate Validator (RI) to your classpath.
2016-10-21 00:02:25.897  INFO 1642 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Unregistering JMX-exposed beans on shutdown
2016-10-21 00:02:25.902  INFO 1642 --- [           main] utoConfigurationReportLoggingInitializer : 

Error starting ApplicationContext. To display the auto-configuration report re-run your application with 'debug' enabled.
2016-10-21 00:02:25.906 ERROR 1642 --- [           main] o.s.b.d.LoggingFailureAnalysisReporter   : 

***************************
APPLICATION FAILED TO START
***************************

Description:

The Bean Validation API is on the classpath but no implementation could be found

Action:

Add an implementation, such as Hibernate Validator, to the classpath

这是我添加的依赖项:

<dependency> 
  <groupId>org.apache.spark</groupId>
  <artifactId>spark-core_2.11</artifactId>
  <version>2.0.1</version>
</dependency>

【问题讨论】:

【参考方案1】:

我在spark-core_2.11-2.0.1.jar\META-INF\DEPENDENCIES 看到了:

// ------------------------------------------------------------------
// Transitive dependencies of this project determined from the
// maven pom organized by organization.
// ------------------------------------------------------------------

Spark Project Core


From: 'an unknown organization'
...
...
  - Bean Validation API (http://beanvalidation.org) javax.validation:validation-api:jar:1.1.0.Final
    License: The Apache Software License, Version 2.0  (http://www.apache.org/licenses/LICENSE-2.0.txt) 

如果使用@EnableAutoConfiguration,spring 可能会看到这种对类路径的依赖,并尝试找到Java specification for Bean Validation 的实现。 (spring validation 的一些有趣的阅读)。

在我看来,这是因为 spark 使用 jersey 作为向我们显示工作状态等信息的一种方式 jersey bean-validation - 但我不太确定这个说法。

但您可以通过提供Bean Validation 的实现来解决此问题 - 只需将实现的依赖项添加到 maven。

休眠验证器

<!-- https://mvnrepository.com/artifact/org.hibernate/hibernate-validator -->
<dependency>
    <groupId>org.hibernate</groupId>
    <artifactId>hibernate-validator</artifactId>
    <version>5.3.0.Final</version>
</dependency>

或更快 (source) Apache BeanValidation

<!-- https://mvnrepository.com/artifact/org.apache.bval/bval-jsr303 -->
<dependency>
    <groupId>org.apache.bval</groupId>
    <artifactId>bval-jsr303</artifactId>
    <version>0.5</version>
</dependency>

解决方案在 cmets 中! (排除验证 API)

【讨论】:

昨天我尝试添加hibernate验证器并没有解决问题,让我试试apache bval看看如何。 没有太大帮助:org.springframework.beans.factory.UnsatisfiedDependencyException:创建名称为“org.springframework.boot.autoconfigure.info.ProjectInfoAutoConfiguration”的bean时出错:通过构造函数参数0表示的不满足依赖关系;嵌套异常是 org.springframework.beans.factory.BeanCreationException:创建名为“spring.info-org.springframework.boot.autoconfigure.info.ProjectInfoProperties”的 bean 时出错:bean 初始化失败;嵌套异常是 嗯,这很奇怪。尝试排除验证,但我认为最好用 BeanValidator 解决这个问题,但你可以尝试这样的事情 spark-core 排除依赖:&lt;dependency&gt; &lt;groupId&gt;org.apache.spark&lt;/groupId&gt; &lt;artifactId&gt;spark-core_2.11&lt;/artifactId&gt; &lt;version&gt;2.0.1&lt;/version&gt; &lt;exclusions&gt; &lt;exclusion&gt; &lt;groupId&gt;javax.validation&lt;/groupId&gt; &lt;artifactId&gt;validation-api&lt;/artifactId&gt; &lt;/exclusion&gt; &lt;/exclusions&gt; &lt;/dependency&gt; 暂时解决了这个问题,我希望这个排除不会影响 Spark API 中的任何内容。谢谢

以上是关于Spark maven 依赖破坏了 spring-boot 应用程序的主要内容,如果未能解决你的问题,请参考以下文章

使用 Maven 依赖项的 Spark 版本不匹配

Maven 版本依赖

Spring Maven Plugin 的不同封装:Spring + Spark 应用

如何在Maven中配置Spring依赖

使用maven-shade-plugin插件解决spark依赖冲突问题

使用 Maven 下载 Spring 3.0.0 依赖项