Ubuntu-16.04-Desktop +Hadoop2.7.5+Eclipse-Neon的云计算开发环境的搭建(伪分布式方式)

Posted ParamousGIS

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Ubuntu-16.04-Desktop +Hadoop2.7.5+Eclipse-Neon的云计算开发环境的搭建(伪分布式方式)相关的知识,希望对你有一定的参考价值。


 

 

主控终端

主机名

ubuntuhadoop.smartmap.com

IP

192.168.1.60

Subnet mask

255.255.255.0

Gateway

192.168.1.1

DNS

218.30.19.50

 

61.134.1.5

Search domains

smartmap.com

 

 

 

 

 

 

 

 


 

1.  设置网络IP

sudo nmtui

 

clip_image002


sudo /etc/init.d/networking restart

2.  设置主机名

 

sudo hostnamectl set-hostname=ubuntuhadoop.smartmap.com

 

sudo gedit /etc/hosts

 

127.0.0.1       localhost

# 127.0.0.1     ubuntuhadoop.smartmap.com

# 127.0.0.1     ubuntuhadoop

192.168.1.60    ubuntuhadoop

192.168.1.60    ubuntuhadoop.smartmap.com

 

 

# The following lines are desirable for IPv6 capable hosts

::1     ip6-localhost ip6-loopback

fe00::0 ip6-localnet

ff00::0 ip6-mcastprefix

ff02::1 ip6-allnodes

ff02::2 ip6-allrouters

 

3.  关闭防火墙

sudo ufw disable

 

4.  安装VMwareTool

 

https://www.linuxidc.com/Linux/2016-04/130807.htm

 

5.  安装SSH

5.1.  安装SSH服务

sudo apt-get install -y openssh-server

 

5.2.  设置SSH

sudo vi /etc/ssh/sshd_config

 

PermitRootLogin yes

 

5.3.  启动SSH服务

sudo service ssh start

sudo service ssh restart

 

5.4.  节点间无密码互访

5.4.1.  zyx用户

cd ~

ssh-keygen -t rsa

 

cp .ssh/id_rsa.pub .ssh/authorized_keys

 

5.4.2.  root用户

 

sudo su – root

cd ~

ssh-keygen -t rsa

 

cp .ssh/id_rsa.pub .ssh/authorized_keys

exit

6.  设置vimUbuntu中的vim太难用了)

 

sudo gedit /etc/vim/vimrc.tiny

 

" set compatible

 

set nocompatible

set backspace=2

 

" vim: set ft=vim:

 

7.  安装JDK

7.1.  加入OracleJDK仓库

 

sudo add-apt-repository ppa:webupd8team/java

 

7.2.  更新

 

sudo apt-get update

 

7.3.  安装

 

sudo apt-get install oracle-java8-installer

 

注意:java默认安装在 /usr/lib/jvm文件夹下

 

7.4.  环境变量配置

 

sudo gedit /etc/profile

 

 

export JAVA_HOME=/usr/lib/jvm/java-8-oracle

export JRE_HOME=$JAVA_HOME/jre

export CLASSPATH=.:$CLASSPATH:$JAVA_HOME/lib:$JRE_HOME/lib

export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin

 

 

export HADOOP_HOME=/usr/local/hadoop/hadoop-2.7.5

export HADOOP_MAPRED_HOME=$HADOOP_HOME

export HADOOP_COMMON_HOME=$HADOOP_HOME

export HADOOP_HDFS_HOME=$HADOOP_HOME

export YARN_HOME=$HADOOP_HOME

 

export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop

export YARN_CONF_DIR=$HADOOP_HOME/etc/hadoop

 

export PATH=$PATH:$HADOOP_HOME/sbin

export PATH=$PATH:$HADOOP_HOME/bin

 

export LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/amd64/server:/usr/local/lib:$HADOOP_HOME/lib/native

export JAVA_LIBRARY_PATH=$LD_LIBRARY_PATH:$JAVA_LIBRARY_PATH

 

 

souce /etc/profile

 

8.  安装Hadoop

 

8.1.以上是关于Ubuntu-16.04-Desktop +Hadoop2.7.5+Eclipse-Neon的云计算开发环境的搭建(伪分布式方式)的主要内容,如果未能解决你的问题,请参考以下文章

[BSidesCF 2020]Had a bad day

Red Had 9 下Samba服务器创建

Installation of packages ‘stringi’ had non-zero exit status

google sheets写入数据时报错:Request had insufficient authentication scopes

nodes had volume node affinity conflict

BUU-WEB-[BSidesCF 2020]Had a bad day