hudi flink 集成error ,未解决

Posted 秉寒-CHO

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了hudi flink 集成error ,未解决相关的知识,希望对你有一定的参考价值。

2021-08-07 10:29:55

org.apache.flink.util.FlinkException: Error from OperatorCoordinator

    at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder.notifySubtaskReady(OperatorCoordinatorHolder.java:426)

    at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder.lambda$setupSubtaskGateway$6(OperatorCoordinatorHolder.java:416)

    at java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:670)

    at java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:646)

    at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)

    at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)

    at org.apache.flink.runtime.executiongraph.Execution.transitionState(Execution.java:1815)

    at org.apache.flink.runtime.executiongraph.Execution.transitionState(Execution.java:1775)

    at org.apache.flink.runtime.executiongraph.Execution.switchToRunning(Execution.java:1509)

    at org.apache.flink.runtime.executiongraph.ExecutionGraph.updateStateInternal(ExecutionGraph.java:1605)

    at org.apache.flink.runtime.executiongraph.ExecutionGraph.updateState(ExecutionGraph.java:1584)

    at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:660)

    at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:89)

    at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:446)

    at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

    at java.lang.reflect.Method.invoke(Method.java:498)

    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:305)

    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:212)

    at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77)

    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:158)

    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)

    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)

    at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)

    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)

    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)

    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)

    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)

    at akka.actor.Actor$class.aroundReceive(Actor.scala:517)

    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)

    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)

    at akka.actor.ActorCell.invoke(ActorCell.scala:561)

    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)

    at akka.dispatch.Mailbox.run(Mailbox.scala:225)

    at akka.dispatch.Mailbox.exec(Mailbox.scala:235)

    at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)

    at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)

    at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)

    at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

Caused by: java.lang.AbstractMethodError: Method org/apache/hudi/sink/StreamWriteOperatorCoordinator.subtaskReady(ILorg/apache/flink/runtime/operators/coordination/OperatorCoordinator$SubtaskGateway;)V is abstract

    at org.apache.hudi.sink.StreamWriteOperatorCoordinator.subtaskReady(StreamWriteOperatorCoordinator.java)

    at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder.notifySubtaskReady(OperatorCoordinatorHolder.java:423)

    ... 38 more

以上是关于hudi flink 集成error ,未解决的主要内容,如果未能解决你的问题,请参考以下文章

hudi flink 集成error ,未解决

Huid学习七:Hudi与Flink集成

数据湖架构HudiHudi集成Flink案例详解

Flink CDC + Hudi 海量数据入湖在顺丰的实践

数据湖:什么是Hudi

数据湖技术之Hudi 集成 Spark