Hadoop 集群搭建 (二):语言环境

Java, Python, Scala

maximilian-weisbecker-544039-unsplash

人生苦短

Ps:安装包均存放于 vmware 共享文件夹 Hadoop 中

安装 JDK

  • cd /mnt/hgfs/Hadoop
  • cp jdk-8u212-linux-x64.tar.gz /usr/local/src/
  • cd /usr/local/src/
  • tar zxvf jdk-8u212-linux-x64.tar.gz
  • rm -rf jdk-8u212-linux-x64.tar.gz

配置 JDK 环境变量:

  • vim ~/.bashrc
# 添加如下信息
# SET JAVA PATH
export JAVA_HOME=/usr/local/src/jdk1.8.0_212
export CLASSPATH=.:$CLASSPATH:$JAVA_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin
  • source ~/.bashrc

安装 anaconda3

  • cd /mnt/hgfs/Hadoop
  • cp Miniconda3-latest-Linux-x86_64.sh /usr/local/src/
  • cd /usr/local/src
  • sudo yum -y install bzip2
  • sh Miniconda3-latest-Linux-x86_64.sh
  • rm -rf Miniconda3-latest-Linux-x86_64.sh

配置环境变量:

  • source ~/.bashrc

更新 conda 环境:

  • conda update —all

安装 Scala

  • cd /mnt/hgfs/Hadoop
  • cp scala-2.11.12.tgz /usr/local/src/
  • cd /usr/local/src/
  • tar zxvf scala-2.11.12.tgz
  • rm -rf scala-2.11.12.tgz

配置 Scala 环境变量:

  • vim ~/.bashrc
# 添加如下信息
# SET SCALA PATH
export SCALA_HOME=/usr/local/src/scala-2.11.12
export PATH=$PATH:$SCALA_HOME/bin
  • source ~/.bashrc