Java - 类存在两次(在类路径和应用程序 jar 上)。 LinkageError:ClassCastException

Posted

技术标签:

【中文标题】Java - 类存在两次(在类路径和应用程序 jar 上)。 LinkageError:ClassCastException【英文标题】:Java - Class exists twice (on classpath and on application jar). LinkageError: ClassCastException 【发布时间】:2020-01-21 10:06:35 【问题描述】:

启动 Java 应用程序时出现以下错误。

我需要在启动应用程序之前将一些hadoop相关目录导出到类路径以使其工作(我不能跳过这一步),我收到以下错误。

原因:java.lang.LinkageError: ClassCastException: 试图 castjar:文件:/usr/hdp/3.0.0.0-1634/hadoop/lib/jsr311-api-1.1.1.jar!/javax/ws/rs/ext/RuntimeDelegate.class 到 罐子:文件:/ tmp目录/ BLOBSTORE-634df1c1-ffc8-4610-86af-8f39b33e4250 / job_ac11246bea2bb31008c1a78212357514 / blob_p-79f2d3193313ea987c15b4b28411db0fc2aa436c-f858cb54126b6d546c01e5ed453bf106 /javax/ws/rs/ext/RuntimeDelegate.class 在 javax.ws.rs.ext.RuntimeDelegate.findDelegate(RuntimeDelegate.java:146) 在 javax.ws.rs.ext.RuntimeDelegate.getInstance(RuntimeDelegate.java:120) 在 javax.ws.rs.core.UriBuilder.newInstance(UriBuilder.java:95) 在 javax.ws.rs.core.UriBuilder.fromUri(UriBuilder.java:119) 在 org.glassfish.jersey.client.JerseyWebTarget.(JerseyWebTarget.java:71) 在 org.glassfish.jersey.client.JerseyClient.target(JerseyClient.java:290) 在 org.glassfish.jersey.client.JerseyClient.target(JerseyClient.java:76) 在 com.hortonworks.registries.schemaregistry.client.SchemaRegistryClient.lambda$currentSchemaRegistryTargets$0(SchemaRegistryClient.java:293) 在 java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) 在 com.hortonworks.registries.schemaregistry.client.SchemaRegistryClient.currentSchemaRegistryTargets(SchemaRegistryClient.java:293) 在 com.hortonworks.registries.schemaregistry.client.SchemaRegistryClient.getSupportedSchemaProviders(SchemaRegistryClient.java:384) 在 com.hortonworks.registries.schemaregistry.client.SchemaRegistryClient.getDefaultDeserializer(SchemaRegistryClient.java:969) 在 SchemaService.InitDeserializer(SchemaService.java:47) 在 SchemaService.deserialize(SchemaService.java:38) 在 org.apache.flink.streaming.connectors.kafka.internals.KafkaDeserializationSchemaWrapper.deserialize(KafkaDeserializationSchemaWrapper.java:45) 在 org.apache.flink.streaming.connectors.kafka.internal.KafkaFetcher.runFetchLoop(KafkaFetcher.java:140) 在 org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:712) 在 org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:93) 在 org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:57) 在 org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:97) 在 org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:302) 在 org.apache.flink.runtime.taskmanager.Task.run(Task.java:711) 在 java.lang.Thread.run(Thread.java:745)

经过一些研究,我发现程序尝试使用的类存在于两个不同的 JAR 文件中:

第一个是对我的 maven 应用程序 (javax.ws.rs.jar) 上的库的传递依赖

第二个是位于目录中的 jar,其中包含来自 hortonworks 的所有 hadoop 依赖项,我需要将其导出到我的类路径中以使应用程序正常工作 (jsr311-api-1.1.1.jar)

所以我需要以某种方式告诉程序,应该使用打包在我的应用程序的 jar 中的 maven 依赖项而不是位于类路径上的 jar。(javax.ws.rs.jar)而不删除这个 jar,因为它是我的大数据集群安装的一部分,我无法在类路径中使用这些 jar。

有什么想法吗?

pom.xml 依赖导致问题:

<dependency>
    <groupId>com.hortonworks.registries</groupId>
    <artifactId>schema-registry-client</artifactId>
    <version>$schema.registry.version</version>
</dependency>

依赖树:

[INFO] amgrd:KafkaDemoProcessor:jar:0.0.1-SNAPSHOT
[INFO] +- org.apache.flink:flink-java:jar:1.8.1:compile
[INFO] |  +- org.apache.flink:flink-core:jar:1.8.1:compile
[INFO] |  |  +- org.apache.flink:flink-annotations:jar:1.8.1:compile
[INFO] |  |  +- org.apache.flink:flink-metrics-core:jar:1.8.1:compile
[INFO] |  |  +- com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
[INFO] |  |  |  +- com.esotericsoftware.minlog:minlog:jar:1.2:compile
[INFO] |  |  |  \- org.objenesis:objenesis:jar:2.1:compile
[INFO] |  |  +- commons-collections:commons-collections:jar:3.2.2:compile
[INFO] |  |  \- org.apache.commons:commons-compress:jar:1.18:compile
[INFO] |  +- org.apache.flink:flink-shaded-asm:jar:5.0.4-6.0:compile
[INFO] |  +- org.apache.flink:flink-shaded-asm-6:jar:6.2.1-6.0:compile
[INFO] |  +- org.apache.commons:commons-lang3:jar:3.3.2:compile
[INFO] |  +- org.apache.commons:commons-math3:jar:3.5:compile
[INFO] |  +- org.slf4j:slf4j-api:jar:1.7.15:compile
[INFO] |  +- com.google.code.findbugs:jsr305:jar:1.3.9:compile
[INFO] |  \- org.apache.flink:force-shading:jar:1.8.1:compile
[INFO] +- org.apache.flink:flink-streaming-java_2.12:jar:1.8.1:compile
[INFO] |  +- org.apache.flink:flink-runtime_2.12:jar:1.8.1:compile
[INFO] |  |  +- org.apache.flink:flink-queryable-state-client-java_2.12:jar:1.8.1:compile
[INFO] |  |  +- org.apache.flink:flink-hadoop-fs:jar:1.8.1:compile
[INFO] |  |  +- org.apache.flink:flink-shaded-netty:jar:4.1.32.Final-6.0:compile
[INFO] |  |  +- org.apache.flink:flink-shaded-jackson:jar:2.7.9-6.0:compile
[INFO] |  |  +- org.javassist:javassist:jar:3.19.0-GA:compile
[INFO] |  |  +- org.scala-lang:scala-library:jar:2.12.7:compile
[INFO] |  |  +- com.typesafe.akka:akka-actor_2.12:jar:2.4.20:compile
[INFO] |  |  |  +- com.typesafe:config:jar:1.3.0:compile
[INFO] |  |  |  \- org.scala-lang.modules:scala-java8-compat_2.12:jar:0.8.0:compile
[INFO] |  |  +- com.typesafe.akka:akka-stream_2.12:jar:2.4.20:compile
[INFO] |  |  |  +- org.reactivestreams:reactive-streams:jar:1.0.0:compile
[INFO] |  |  |  \- com.typesafe:ssl-config-core_2.12:jar:0.2.1:compile
[INFO] |  |  |     \- org.scala-lang.modules:scala-parser-combinators_2.12:jar:1.0.4:compile
[INFO] |  |  +- com.typesafe.akka:akka-protobuf_2.12:jar:2.4.20:compile
[INFO] |  |  +- com.typesafe.akka:akka-slf4j_2.12:jar:2.4.20:compile
[INFO] |  |  +- org.clapper:grizzled-slf4j_2.12:jar:1.3.2:compile
[INFO] |  |  +- com.github.scopt:scopt_2.12:jar:3.5.0:compile
[INFO] |  |  +- org.xerial.snappy:snappy-java:jar:1.1.4:compile
[INFO] |  |  \- com.twitter:chill_2.12:jar:0.7.6:compile
[INFO] |  |     \- com.twitter:chill-java:jar:0.7.6:compile
[INFO] |  \- org.apache.flink:flink-shaded-guava:jar:18.0-6.0:compile
[INFO] +- org.apache.flink:flink-clients_2.12:jar:1.8.1:compile
[INFO] |  +- org.apache.flink:flink-optimizer_2.12:jar:1.8.1:compile
[INFO] |  \- commons-cli:commons-cli:jar:1.3.1:compile
[INFO] +- org.apache.flink:flink-connector-kafka_2.11:jar:1.8.1:compile
[INFO] |  +- org.apache.flink:flink-connector-kafka-base_2.11:jar:1.8.1:compile
[INFO] |  \- org.apache.kafka:kafka-clients:jar:2.0.1:compile
[INFO] |     \- org.lz4:lz4-java:jar:1.4.1:compile
[INFO] +- com.hortonworks.registries:schema-registry-client:jar:0.3.0:compile
[INFO] |  +- com.hortonworks.registries:schema-registry-common:jar:0.3.0:compile
[INFO] |  |  +- com.google.guava:guava:jar:18.0:compile
[INFO] |  |  +- org.slf4j:log4j-over-slf4j:jar:1.7.12:compile
[INFO] |  |  +- com.fasterxml.jackson.core:jackson-core:jar:2.7.3:compile
[INFO] |  |  \- com.fasterxml.jackson.core:jackson-databind:jar:2.7.3:compile
[INFO] |  +- org.glassfish.jersey.core:jersey-client:jar:2.22.1:compile
[INFO] |  |  +- javax.ws.rs:javax.ws.rs-api:jar:2.0.1:compile
[INFO] |  |  +- org.glassfish.jersey.core:jersey-common:jar:2.22.1:compile
[INFO] |  |  |  +- javax.annotation:javax.annotation-api:jar:1.2:compile
[INFO] |  |  |  +- org.glassfish.jersey.bundles.repackaged:jersey-guava:jar:2.22.1:compile
[INFO] |  |  |  \- org.glassfish.hk2:osgi-resource-locator:jar:1.0.1:compile
[INFO] |  |  +- org.glassfish.hk2:hk2-api:jar:2.4.0-b31:compile
[INFO] |  |  |  +- org.glassfish.hk2:hk2-utils:jar:2.4.0-b31:compile
[INFO] |  |  |  \- org.glassfish.hk2.external:aopalliance-repackaged:jar:2.4.0-b31:compile
[INFO] |  |  +- org.glassfish.hk2.external:javax.inject:jar:2.4.0-b31:compile
[INFO] |  |  \- org.glassfish.hk2:hk2-locator:jar:2.4.0-b31:compile
[INFO] |  +- org.glassfish.jersey.media:jersey-media-multipart:jar:2.22.1:compile
[INFO] |  |  \- org.jvnet.mimepull:mimepull:jar:1.9.6:compile
[INFO] |  +- com.hortonworks.registries:registry-common:jar:0.3.0:compile
[INFO] |  |  +- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:jar:2.7.3:compile
[INFO] |  |  |  \- org.yaml:snakeyaml:jar:1.15:compile
[INFO] |  |  +- com.github.fge:json-schema-validator:jar:2.2.6:compile
[INFO] |  |  |  +- joda-time:joda-time:jar:2.3:compile
[INFO] |  |  |  +- com.googlecode.libphonenumber:libphonenumber:jar:6.2:compile
[INFO] |  |  |  +- com.github.fge:json-schema-core:jar:1.2.5:compile
[INFO] |  |  |  |  +- com.github.fge:uri-template:jar:0.9:compile
[INFO] |  |  |  |  |  \- com.github.fge:msg-simple:jar:1.1:compile
[INFO] |  |  |  |  |     \- com.github.fge:btf:jar:1.2:compile
[INFO] |  |  |  |  +- com.github.fge:jackson-coreutils:jar:1.8:compile
[INFO] |  |  |  |  \- org.mozilla:rhino:jar:1.7R4:compile
[INFO] |  |  |  +- javax.mail:mailapi:jar:1.4.3:compile
[INFO] |  |  |  |  \- javax.activation:activation:jar:1.1:compile
[INFO] |  |  |  \- net.sf.jopt-simple:jopt-simple:jar:4.6:compile
[INFO] |  |  +- org.apache.hadoop:hadoop-client:jar:2.7.1:compile
[INFO] |  |  |  +- org.apache.hadoop:hadoop-common:jar:2.7.1:compile
[INFO] |  |  |  |  +- xmlenc:xmlenc:jar:0.52:compile
[INFO] |  |  |  |  +- commons-httpclient:commons-httpclient:jar:3.1:compile
[INFO] |  |  |  |  +- commons-codec:commons-codec:jar:1.4:compile
[INFO] |  |  |  |  +- commons-net:commons-net:jar:3.1:compile
[INFO] |  |  |  |  +- javax.servlet.jsp:jsp-api:jar:2.1:runtime
[INFO] |  |  |  |  +- commons-logging:commons-logging:jar:1.1.3:compile
[INFO] |  |  |  |  +- commons-lang:commons-lang:jar:2.6:compile
[INFO] |  |  |  |  +- commons-configuration:commons-configuration:jar:1.6:compile
[INFO] |  |  |  |  |  +- commons-digester:commons-digester:jar:1.8:compile
[INFO] |  |  |  |  |  |  \- commons-beanutils:commons-beanutils:jar:1.7.0:compile
[INFO] |  |  |  |  |  \- commons-beanutils:commons-beanutils-core:jar:1.8.0:compile
[INFO] |  |  |  |  +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
[INFO] |  |  |  |  +- com.google.code.gson:gson:jar:2.2.4:compile
[INFO] |  |  |  |  +- org.apache.hadoop:hadoop-auth:jar:2.7.1:compile
[INFO] |  |  |  |  |  +- org.apache.httpcomponents:httpclient:jar:4.2.5:compile
[INFO] |  |  |  |  |  |  \- org.apache.httpcomponents:httpcore:jar:4.2.4:compile
[INFO] |  |  |  |  |  \- org.apache.curator:curator-framework:jar:2.7.1:compile
[INFO] |  |  |  |  +- org.apache.curator:curator-client:jar:2.7.1:compile
[INFO] |  |  |  |  +- org.apache.curator:curator-recipes:jar:2.7.1:compile
[INFO] |  |  |  |  +- org.apache.htrace:htrace-core:jar:3.1.0-incubating:compile
[INFO] |  |  |  |  \- org.apache.zookeeper:zookeeper:jar:3.4.6:compile
[INFO] |  |  |  |     \- io.netty:netty:jar:3.7.0.Final:compile
[INFO] |  |  |  +- org.apache.hadoop:hadoop-hdfs:jar:2.7.1:compile
[INFO] |  |  |  |  +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
[INFO] |  |  |  |  +- io.netty:netty-all:jar:4.0.23.Final:compile
[INFO] |  |  |  |  +- xerces:xercesImpl:jar:2.9.1:compile
[INFO] |  |  |  |  |  \- xml-apis:xml-apis:jar:1.3.04:compile
[INFO] |  |  |  |  \- org.fusesource.leveldbjni:leveldbjni-all:jar:1.8:compile
[INFO] |  |  |  \- org.apache.hadoop:hadoop-annotations:jar:2.7.1:compile
[INFO] |  |  +- org.hibernate:hibernate-validator:jar:5.1.3.Final:compile
[INFO] |  |  |  +- javax.validation:validation-api:jar:1.1.0.Final:compile
[INFO] |  |  |  +- org.jboss.logging:jboss-logging:jar:3.1.3.GA:compile
[INFO] |  |  |  \- com.fasterxml:classmate:jar:1.0.0:compile
[INFO] |  |  \- org.springframework:spring-context:jar:4.3.6.RELEASE:compile
[INFO] |  |     +- org.springframework:spring-aop:jar:4.3.6.RELEASE:compile
[INFO] |  |     +- org.springframework:spring-beans:jar:4.3.6.RELEASE:compile
[INFO] |  |     +- org.springframework:spring-core:jar:4.3.6.RELEASE:compile
[INFO] |  |     \- org.springframework:spring-expression:jar:4.3.6.RELEASE:compile
[INFO] |  \- com.hortonworks.registries:common-auth:jar:0.3.0:compile
[INFO] |     \- org.apache.directory.server:apacheds-kerberos-codec:jar:2.0.0-M15:compile
[INFO] |        +- org.apache.directory.server:apacheds-i18n:jar:2.0.0-M15:compile
[INFO] |        +- org.apache.directory.api:api-asn1-api:jar:1.0.0-M20:compile
[INFO] |        \- org.apache.directory.api:api-util:jar:1.0.0-M20:compile
[INFO] \- com.hortonworks.registries:schema-registry-serdes:jar:0.3.0:compile
[INFO]    +- org.apache.avro:avro:jar:1.8.2:compile
[INFO]    |  +- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile
[INFO]    |  +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile
[INFO]    |  +- com.thoughtworks.paranamer:paranamer:jar:2.7:compile
[INFO]    |  \- org.tukaani:xz:jar:1.5:compile
[INFO]    +- commons-io:commons-io:jar:2.5:compile
[INFO]    +- com.fasterxml.jackson.core:jackson-annotations:jar:2.7.3:compile
[INFO]    +- org.glassfish.jersey.media:jersey-media-json-jackson:jar:2.22.1:compile
[INFO]    |  \- org.glassfish.jersey.ext:jersey-entity-filtering:jar:2.22.1:compile
[INFO]    \- com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:jar:2.7.3:compile
[INFO]       +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.7.3:compile
[INFO]       \- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.7.3:compile

谢谢

【问题讨论】:

【参考方案1】:

我将这些 jar 添加到具有这些版本的类路径中。并构建并运行。我找不到任何原因。

<!-- https://mvnrepository.com/artifact/com.hortonworks.registries/schema-registry-client -->
        <dependency>
            <groupId>com.hortonworks.registries</groupId>
            <artifactId>schema-registry-client</artifactId>
            <version>0.8.0</version>
        </dependency>
        <!-- https://mvnrepository.com/artifact/com.hortonworks.registries/schema-registry-serdes -->
        <dependency>
            <groupId>com.hortonworks.registries</groupId>
            <artifactId>schema-registry-serdes</artifactId>
            <version>0.8.0</version>
        </dependency>

        <!-- https://mvnrepository.com/artifact/org.glassfish.jersey.core/jersey-client -->
        <dependency>
            <groupId>org.glassfish.jersey.core</groupId>
            <artifactId>jersey-client</artifactId>
            <version>2.29.1</version>
        </dependency>
        <!-- https://mvnrepository.com/artifact/javax.ws.rs/javax.ws.rs-api -->
        <dependency>
            <groupId>javax.ws.rs</groupId>
            <artifactId>javax.ws.rs-api</artifactId>
            <version>2.1</version>
        </dependency>

【讨论】:

我还添加了这些依赖项(groupId:org.glassfish.jersey.inject,art​​ifactId:jersey-hk2 试图修复我现在遇到的以下异常,但即使添加此依赖项也是异常仍然:“java.lang.IllegalStateException: InjectionManagerFactory not found. at org.glassfish.jersey.internal.inject.Injections.lambda$lookupInjectionManagerFactory$0(Injections.java:74) ***.com/questions/44088493/… 请查看此资源 我已经尝试过使用 bot jersey-hk2 和 jersey-cdi2-se 依赖项。对于 jersey-hk2,我得到了上面提到的异常,对于 jersey-cdi2-se,我现在尝试了,这是我得到的错误 .IllegalStateException: WELD-ENV-000016: Missing beans.xml file in META-INF。跨度> 它与 jersey-hk2 依赖项一起工作,我不知道为什么我第一次尝试它失败了。谢谢!【参考方案2】:

如果解决 LinkageError 的类名相同,则可以这样导入。

所以我们有两个同名但在不同包中的类

头等舱

package com.bbc.config;

public class Test1 
 

二等舱

package com.bbc.domain;

public class Test1 

还有主类

package com.bbc.mainclass;
import com.bbc.config.Test1;

public class Main 
  public static void main(String[] args) 

  // this will import from config      
  Test1 test1 = new Test1(); // this will import from Test1

  // this will import from domain       
  com.bbc.domain.Test1 test11 = new com.bbc.domain.Test1();

  

【讨论】:

谢谢,但在这种情况下,我不是在编写导入类的代码,它们是我的库的传递依赖项。该代码在我正在使用的 API 的方法中调用 好的,你能把这两个依赖贴在这里 您需要更改依赖项中的范围。 howtodoinjava.com/maven/maven-dependency-scopes 导致此错误的依赖是 schema-registry-client 和 schema-registry-serdes。我写了上面的pom.xml。但我不需要在 pom.xml 上排除它(如果我这样做,程序将失败并出现 ClassNotFound 异常,因为未包含该库) 我不太确定错误是否意味着我所说的(试图在类路径中加载 jar),因为我不习惯使用 Java,但这是我在这里理解的

以上是关于Java - 类存在两次(在类路径和应用程序 jar 上)。 LinkageError:ClassCastException的主要内容,如果未能解决你的问题,请参考以下文章

maven打包报错:在类路径或引导类路径中找不到程序包 java.lang

尽管 jar 在类路径中,但获取 ClassNotFoundException

适用于 blob 的 Azure Java SDK - 已请求加载默认 HttpClient 提供程序,但在类路径中找不到该提供程序

在类路径资源中定义名称为“xxxEntityManagerFactory”的 bean 创建错误

为啥渲染方法在类组件中运行两次而没有包含任何状态?

“Bean Validation API 在类路径上,但找不到实现”阻止启动