在命令行上运行 Apache Ignite 时创建 Ignite 组件失败

Posted

技术标签:

【中文标题】在命令行上运行 Apache Ignite 时创建 Ignite 组件失败【英文标题】:Failed to Create Ignite Component when running Apache Ignite on command Line 【发布时间】:2016-12-27 03:19:39 【问题描述】:

在开始学习 ignite 时,我最终使用 IntelliJ 作为 IDE,它运行良好。但是,我需要将它移到超级计算机环境中,并且需要能够从命令行运行它,但是我的代码无法找到所需的类。我使用 maven 创建了我的项目,添加了入门指南中提到的正确依赖项。之后,我对项目进行了 maven 打包并使用了以下命令:

/usr/java/jdk1.8.0_91/bin/java -cp "$IGNITE_HOME/modules/core/target/ignite-core-1.6.0.jar:$IGNITE_HOME/modules/core/target/libs/cache-api-1.0.0.jar:$IGNITE_HOME/modules/spring/target/ignite-spring-1.6.0.jar:target/my-app-1.0-SNAPSHOT.jar" com.mycompany.app.App

但是它无法创建一个 ignite 组件并出现以下错误:

Exception in thread "main" class org.apache.ignite.IgniteException: Failed to create Ignite component (consider adding ignite-spring module to classpath) [component=SPRING, cls=org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl]
    at org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:906)
    at org.apache.ignite.Ignition.start(Ignition.java:350)
    at com.mycompany.app.App.main(App.java:24)
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to create Ignite component (consider adding ignite-spring module to classpath) [component=SPRING, cls=org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl]
    at org.apache.ignite.internal.IgniteComponentType.componentException(IgniteComponentType.java:313)
    at org.apache.ignite.internal.IgniteComponentType.create0(IgniteComponentType.java:289)
    at org.apache.ignite.internal.IgniteComponentType.create(IgniteComponentType.java:200)
    at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:637)
    at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:840)
    at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:749)
    at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:619)
    at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:589)
    at org.apache.ignite.Ignition.start(Ignition.java:347)
    ... 1 more
Caused by: java.lang.NoClassDefFoundError: org/springframework/beans/BeansException
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:264)
    at org.apache.ignite.internal.IgniteComponentType.create0(IgniteComponentType.java:275)
    ... 8 more
Caused by: java.lang.ClassNotFoundException: org.springframework.beans.BeansException
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 11 more

寻找其他p类似的问题,我看到是因为pom文件中没有包含ignite-spring。但是,我已将其包括在内。这是我的 pom 文件:

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
  <modelVersion>4.0.0</modelVersion>
  <groupId>com.mycompany.app</groupId>
  <artifactId>my-app</artifactId>
  <packaging>jar</packaging>
  <version>1.0-SNAPSHOT</version>
  <name>my-app</name>
  <url>http://maven.apache.org</url>
  <build>
  <plugins>
    <plugin>
      <groupId>org.apache.maven.plugins</groupId>
      <artifactId>maven-compiler-plugin</artifactId>
      <version>3.5.1</version>
      <configuration>
       <source>1.8</source>
       <target>1.8</target>
      </configuration>
    </plugin>
  </plugins>
  </build>
  <dependencies>
    <dependency>
      <groupId>org.apache.ignite</groupId>
      <artifactId>ignite-core</artifactId>
      <version>1.6.0</version>
    </dependency>
    <dependency>
      <groupId>org.apache.ignite</groupId>
      <artifactId>ignite-spring</artifactId>
      <version>1.6.0</version>
    </dependency>
    <dependency>
      <groupId>org.apache.ignite</groupId>
      <artifactId>ignite-indexing</artifactId>
      <version>1.6.0</version>
    </dependency>
  </dependencies>
</project>

我哪里出错了?是否重要到 IDE 导致某些东西变得不一致?我运行代码的命令是否不完整或错误?谢谢您的帮助。如果需要,这里是发生错误的代码的第一行:

package com.mycompany.app;

import org.apache.ignite.Ignite;
import org.apache.ignite.IgniteCache;
import org.apache.ignite.Ignition;
import java.io.BufferedReader;
import java.io.FileReader;
import java.io.IOException;
import java.net.URL;
import java.net.URLClassLoader;
import java.util.StringTokenizer;

public class App

    public static void main( String[] args ) 
        printClasspath();
        String data;
        try 
            data = readFile("tweet.txt");
            Ignite ignite = Ignition.start("/ignite-1.6.0/examples/config/example-ignite.xml");
            IgniteCache<Integer, String[]> cache = ignite.getOrCreateCache("myCacheName");
        ...
        
     

【问题讨论】:

【参考方案1】:

我建议执行以下操作:

    将所有应用程序类(没有 Ignite 依赖项)打包到一个 JAR 中,并将其放入 IGNITE_HOME/libs 文件夹中。 将 MAIN_CLASS 环境变量设置为您的主类 (com.mycompany.app.App)。 运行IGNITE_HOME/bin/ignite.sh 脚本。它将正确地形成具有所有必需的 Ignite 依赖项的 Java 类路径参数,并将运行您的应用程序。

【讨论】:

感谢您的快速响应,我能够让它以这种方式工作。我想知道这是否是在 ignite 上运行应用程序的首选方式。这是唯一的方法吗?我问是因为在我们的设置中,我们不希望每个用户都将他们的 jar 放入共享的 IGNITE_HOME/libs 中。另外,如果它们都尝试运行主类,您将如何将多个服务器连接在一起?我并没有对管理系统搞砸太多,但是如果我尝试设置一些服务器而没有设置主类然后运行一个设置了它的服务器,那么网格管理器会出错。 您可以根据需要启动任意数量的独立服务器。上面显示的方法只是使用 Ignite 依赖项运行应用程序的一种方法(显然不是唯一的一种)。【参考方案2】:

因为我们的java类没有识别类 参考以下命令

在 UNIX 上安装

    下载https://ignite.apache.org/download.cgi站点

    apache-ignite-fabric-1.5.0-b1-bin 解压这个文件夹

    在本例中,我的“apache-ignite-fabric-1.5.0-b1-bin”目录位于“/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin”

    HelloWorld 程序示例:

    //program starting#################################################################################################################################
    
    import org.apache.ignite.Ignite;
    import org.apache.ignite.IgniteException;
    import org.apache.ignite.Ignition;
    import org.apache.ignite.IgniteCache;
    //import org.apache.ignite.internal.util.spring;
    public class HelloWorld 
      public static void main(String[] args) throws IgniteException 
        try (Ignite ignite = Ignition.start("/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/examples/config/example-ignite.xml")) 
          // Put values in cache.
          IgniteCache<Integer, String> cache = ignite.getOrCreateCache("myCache");
          cache.put(1, "Hello");
          cache.put(2, "World");
          cache.put(3,"Durga Prasad");
          // Get values from cache
          // Broadcast 'Hello World' on all the nodes in the cluster.
          ignite.compute().broadcast(()->System.out.println(cache.get(1) + " " + cache.get(2) + " " +cache.get(3)));
        
      
    
    
    
    //end program ###################################################################################################################### 
    

    这个 HelloWorld.java 文件是在“[stp@ril-srv-sp4 apache-ignite-fabric-1.5.0-b1-bin]$ cd libs”位置创建的

    在编译此程序之前,我们必须确定“/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs”文件夹和子文件夹中的所有 jar 位置。

    [stp@ril-srv-sp4 apache-ignite-fabric-1.5.0-b1-bin]$ cd libs
    javac -cp "/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-core-1.5.0-b1.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/cache-api-1.0.0.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-shmem-1.0.0.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-indexing/commons-codec-1.6.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-indexing/h2-1.3.175.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-indexing/ignite-indexing-1.5.0-b1.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-indexing/lucene-core-3.5.0.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/commons-logging-1.1.1.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-beans-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-expression-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/ignite-spring-1.5.0-b1.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-context-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-jdbc-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-aop-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-core-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-tx-4.1.0.RELEASE.jar" HelloWorld.java
    

    使用“HelloWorld.class”创建一个 jar 文件

    jar -cf HelloWorld.jar HelloWorld.class
    

    将这个 jar 文件与类一起运行

    [stp@ril-srv-sp4 libs]$ java -cp "/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-core-1.5.0-b1.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/cache-api-1.0.0.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-shmem-1.0.0.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-indexing/commons-codec-1.6.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-indexing/h2-1.3.175.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-indexing/ignite-indexing-1.5.0-b1.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-indexing/lucene-core-3.5.0.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/commons-logging-1.1.1.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-beans-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-expression-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/ignite-spring-1.5.0-b1.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-context-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-jdbc-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-aop-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-core-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/ignite-spring/spring-tx-4.1.0.RELEASE.jar:/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/libs/HelloWorld.jar" HelloWorld
    [14:14:26]    __________  ________________
    [14:14:26]   /  _/ ___/ |/ /  _/_  __/ __/
    [14:14:26]  _/ // (7 7    // /  / / / _/
    [14:14:26] /___/\___/_/|_/___/ /_/ /___/
    [14:14:26]
    [14:14:26] ver. 1.5.0-b1#20151202-sha1:062d440c
    [14:14:26] 2015 Copyright(C) Apache Software Foundation
    [14:14:26]
    [14:14:26] Ignite documentation: http://ignite.apache.org
    [14:14:26]
    [14:14:26] Quiet mode.
    [14:14:26]   ^-- Logging to file '/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/work/log/ignite-6790e4dd.0.log'
    [14:14:26]   ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.sh|bat
    [14:14:26]
    [14:14:26] OS: Linux 3.10.0-327.el7.x86_64 amd64
    [14:14:26] VM information: OpenJDK Runtime Environment 1.8.0_102-b14 Oracle Corporation OpenJDK 64-Bit Server VM 25.102-b14
    [14:14:26] Configured plugins:
    [14:14:26]   ^-- None
    [14:14:26]
    [14:14:26] Security status [authentication=off, tls/ssl=off]
    [14:14:28] Performance suggestions for grid  (fix if possible)
    [14:14:28] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true
    [14:14:28]   ^-- Disable peer class loading (set 'peerClassLoadingEnabled' to false)
    [14:14:28]   ^-- Disable grid events (remove 'includeEventTypes' from configuration)
    [14:14:28]
    [14:14:28] To start Console Management & Monitoring run ignitevisorcmd.sh|bat
    [14:14:28]
    [14:14:28] Ignite node started OK (id=6790e4dd)
    [14:14:28] Topology snapshot [ver=2, servers=2, clients=0, CPUs=4, heap=14.0GB]
    Hello World Durga Prasad
    [14:14:29] Ignite node stopped OK [uptime=00:00:00:633]
    

    使用 example-ignite.xml 文件打开另一个终端

    [stp@ril-srv-sp4 bin]$ ./ignite.sh "/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/examples/config/example-ignite.xml"
    OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0
    [14:14:17]    __________  ________________
    [14:14:17]   /  _/ ___/ |/ /  _/_  __/ __/
    [14:14:17]  _/ // (7 7    // /  / / / _/
    [14:14:17] /___/\___/_/|_/___/ /_/ /___/
    [14:14:17]
    [14:14:17] ver. 1.5.0-b1#20151202-sha1:062d440c
    [14:14:17] 2015 Copyright(C) Apache Software Foundation
    [14:14:17]
    [14:14:17] Ignite documentation: http://ignite.apache.org
    [14:14:17]
    [14:14:17] Quiet mode.
    [14:14:17]   ^-- Logging to file '/home/stp/ignite/apache-ignite-fabric-1.5.0-b1-bin/work/log/ignite-825641bf.0.log'
    [14:14:17]   ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.sh|bat
    [14:14:17]
    [14:14:17] OS: Linux 3.10.0-327.el7.x86_64 amd64
    [14:14:17] VM information: OpenJDK Runtime Environment 1.8.0_102-b14 Oracle Corporation OpenJDK 64-Bit Server VM 25.102-b14
    [14:14:17] Configured plugins:
    [14:14:17]   ^-- None
    [14:14:17]
    [14:14:17] Security status [authentication=off, tls/ssl=off]
    [14:14:19] Performance suggestions for grid  (fix if possible)
    [14:14:19] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true
    [14:14:19]   ^-- Disable peer class loading (set 'peerClassLoadingEnabled' to false)
    [14:14:19]   ^-- Disable grid events (remove 'includeEventTypes' from configuration)
    [14:14:19]
    [14:14:19] To start Console Management & Monitoring run ignitevisorcmd.sh|bat
    [14:14:19]
    [14:14:19] Ignite node started OK (id=825641bf)
    [14:14:19] Topology snapshot [ver=1, servers=1, clients=0, CPUs=4, heap=1.0GB]
    [14:14:28] New version is available at ignite.apache.org: 1.7.0
    [14:14:28] Topology snapshot [ver=2, servers=2, clients=0, CPUs=4, heap=14.0GB]
    Hello World Durga Prasad
    [14:14:29] Topology snapshot [ver=3, servers=1, clients=0, CPUs=4, heap=1.0GB]
    

【讨论】:

以上是关于在命令行上运行 Apache Ignite 时创建 Ignite 组件失败的主要内容,如果未能解决你的问题,请参考以下文章

Apache Ignite 客户端无法计算字符串键的哈希码

使用JDBC连接将记录插入Apache Ignite Cluster时出现异常

如何使Apache Ignite缓存中的对象无效

Apache Ignite 学习

Symfony - 进程运行抛出异常 - 在命令行上执行有效

Apache Ignite 容错