Cloudera Manager安装部署
来自: http://my.oschina.net/lwhmdj0823/blog/611221
1:下载jdk1.8
2:新建/usr/java文件夹
将jdk-8u11-linux-x64.tar.gz放到该文件夹中,并将工作目录切换到/usr/java目录下。如下图所示:
解压 tar -xzvf jdk-8u11-linux-x64.tar.gz
3:配置环境变量
进入etc/profile
添加环境变量配置。
4:设置profile使其立即生效
5:Establish Your Cloudera Manager Repository Strategy(创建Cloudera Manager 仓库源信息)
添加内容为
Wq退出vim编辑器
6.安装Cloudera Manager Server Packages
7.安装Cloudera Manager Agent Packages
安装cloudera-manager-agent-5.5.1-1.cm551.p0.8.el6.x86_64.rpm
安装MySQL-python-1.2.3-0.3.c1.1.el6.x86_64.rpm
安装mod_ssl-2.2.15-47.el6.centos.1.x86_64.rpm
安装python-psycopg2-2.0.14-2.el6.x86_64.rpm
升级安装httpd-2.2.15-47.el6.centos.1.x86_64.rpm
升级安装httpd-tools-2.2.15-47.el6.centos.1.x86_64.rpm
如果rpm包没有下载那直接用
yum install cloudera-manager-agent cloudera-manager-daemons
如果下载了rmp包:
sudo yum --nogpgcheck localinstall cloudera-manager-agent-*.rpm
8:配置Cloudera Manager Agent文件
( /etc/cloudera-scm-agent/config.ini)
server_host Cloudera Manager Server的主机名
server_port Cloudera Manager Server的端口号
9:安装CDH和管理的各种服务包
Download the CDH 5 "1-click Install" package (or RPM).
下载cloudera-cdh-5-0.x86_64.rpm
wget https://archive.cloudera.com/cdh5/one-click-install/redhat/6/x86_64/cloudera-cdh-5-0.x86_64.rpm
yum --nogpgcheck localinstall cloudera-cdh-5-0.x86_64.rpm
add a repository key
rpm --import https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
安装CDH packages:
yum clean all
yum install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr
以上会安装以下的包
avro-tools
crunch
flume-ng
hadoop-hdfs-fuse
hadoop-hdfs-nfs3
hadoop-httpfs
hadoop-kms
hbase-solr
hive-hbase
hive-webhcat
hue-beeswax
hue-hbase
hue-impala
hue-pig
hue-plugins
hue-rdbms
hue-search
hue-spark
hue-sqoop
hue-zookeeper
impala
impala-shell
kite
llama
mahout
oozie
pig
pig-udf-datafu
search
sentry
solr-mapreduce
spark-core
spark-history-server
spark-master
spark-python
spark-worker
sqoop
sqoop2
whirr
安装以下的依赖包
avro-libs
bigtop-jsvc
bigtop-tomcat
bigtop-utils
hadoop
hadoop-0.20-mapreduce
hadoop-client
hadoop-hdfs
hadoop-libhdfs
hadoop-mapreduce
hadoop-yarn
hbase
hive
hive-hcatalog
hive-jdbc
hue-common
oozie-client
parquet
parquet-format
solr
sqoop2-client
zookeeper
如果以上的包都已经下载到本地了的目录cdh-service-rpm下
cd cdh-service-rpm/
yum install *
12.进入****:7180管理界面进行各个节点集群安装。
13:省略