Cloudera Manager中安装部署Elasticsearch服务

Posted zhangrui153169

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Cloudera Manager中安装部署Elasticsearch服务相关的知识,希望对你有一定的参考价值。

 

 
  1. 制作Elasticsearch的Parcel包和csd文件

  2. 将Parcel包和manifest.json文件部署到httpd服务中

    [root@node01 ~]# mkdir -p /var/www/html/elasticsearch
    [root@node01 ~]# cd /var/www/html/elasticsearch
    [root@node01 elasticsearch]# cp /root/github/cloudera/elasticsearch-parcel/build-parcel/ELASTICSEARCH-0.0.5.elasticsearch.p0.5/ ./
    [root@node01 elasticsearch]# cp /root/github/cloudera/elasticsearch-parcel/build-parcel/manifest.json ./
    [root@node01 elasticsearch]# ll
    total 338924
    -rw-r--r-- 1 root root 347041696 May  5 10:23 ELASTICSEARCH-0.0.5.elasticsearch.p0.5-xenial.parcel
    -rw-r--r-- 1 root root       485 May  5 10:23 manifest.json
     

    浏览器访问是否部署成功
    技术图片

  3. 将生成的csd文件,复制到cloudera-manager-server服务所在节点的/opt/cloudera/csd目录下

    [root@node01 ~]# cd /opt/cloudera/csd/
    [root@node01 csd]# cp ~/github/cloudera/elasticsearch-parcel/build-csd/ELASTICSEARCH-1.0.jar ./
     
  4. 重启cloudera-scm-server服务

    [root@node01 ~]# /opt/cm-5.12.1/etc/init.d/cloudera-scm-server restart
     
  5. 配置远程Parcel存储库 技术图片
    技术图片

  6. 重启Cloudera Management Service
    技术图片

  7. 下载分发激活
    技术图片
    技术图片
    技术图片技术图片
    技术图片
    技术图片

  8. 部署Elasticsearch
    技术图片
    技术图片
    技术图片
    技术图片
    技术图片
    技术图片
    技术图片

  9. 配置节点

    cluster.initial_master_nodes: ["bigdata-dev-41","bigdata-dev-42","bigdata-dev-43"]
     

    技术图片
    技术图片

      1. 遇到的问题

          1. 问题一
            could not find java in JAVA_HOME or bundled at /usr/java/latest/bin/java
             
            解决办法:
            [root@node01 cloudera]# cd elasticsearch-parcel
            [root@node01 cloudera]# cd csd-src/scripts/
            [root@node01 cloudera]# vim control.sh
             
            注释掉JAVA_HOME设置
            locateJava() 
            	echo
                #export JAVA_HOME=/usr/java/latest
                echo "Changing Java Home to: $JAVA_HOME"
            	export JAVA="$JAVA_HOME/bin/java"
            	echo "Changing Java to: $JAVA"
                echo
            
             
          2. 问题二
            Exception in thread "main" org.elasticsearch.bootstrap.BootstrapException: org.elasticsearch.cli.UserException: unable to create temporary keystore at [/opt/cloudera/parcels/ELASTICSEARCH/config/elasticsearch.keystore.tmp], please check filesystem permissions
            Likely root cause: java.nio.file.AccessDeniedException: /opt/cloudera/parcels/ELASTICSEARCH-0.0.5.elasticsearch.p0.5/config/elasticsearch.keystore.tmp
            	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
            	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
            	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
            	at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
            	at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
            	at java.nio.file.Files.newOutputStream(Files.java:216)
            	at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
            	at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
            	at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
            	at org.elasticsearch.common.settings.KeyStoreWrapper.save(KeyStoreWrapper.java:467)
            	at org.elasticsearch.bootstrap.Bootstrap.loadSecureSettings(Bootstrap.java:232)
            	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:289)
            	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159)
            	at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150)
            	at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
            	at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124)
            	at org.elasticsearch.cli.Command.main(Command.java:90)
            	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115)
            	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)
                            解决办法:
                                 
        在cdh集群各个节点均执行:
                         chmod 777 /opt/cloudera/parcels/ELASTICSEARCH-0.0.5.elasticsearch.p0.5/config/
        
         

以上是关于Cloudera Manager中安装部署Elasticsearch服务的主要内容,如果未能解决你的问题,请参考以下文章

手动安装cloudera manager 5.x(tar包方式)详解

hive-metastore 无法在 cloudera manager 安装过程中启动

Cloudera Manager介绍

CM (Cloudera Manager) 的安装,便于CDH的离线部署

Cloudera Manager Server CDH 5.15部署

离线部署 Cloudera Manager 5 和 CDH 5.12.1 及使用 CDH 部署 Hadoop 集群服务