CDH6.2安装之YUM方式
参考:
https://www.sysit.cn/blog/post/sysit/CDH6.2.0%E7%B3%BB%E7%BB%9F%E9%83%A8%E7%BD%B2%E6%89%8B%E5%86%8C
https://www.cnblogs.com/yinzhengjie/articles/11029566.html
https://www.cnblogs.com/yinzhengjie/p/10372369.html
官网
https://www.cloudera.com/documentation/enterprise/6/6.2/topics/install_cm_cdh.html
https://blog.51cto.com/7072753/2176533?source=dra
1/ 配置cloudera官方源
每个节点
https://www.cloudera.com/documentation/enterprise/6/6.2/topics/configure_cm_repo.html
wget https://archive.cloudera.com/cm6/6.2.0/redhat7/yum/cloudera-manager.repo
mv cloudera-manager.repo /etc/yum.repos.d/
rpm --import https://archive.cloudera.com/cm6/6.2.0/redhat7/yum/RPM-GPG-KEY-cloudera
2/ Installing Oracle JDK Using Cloudera Manager
#一般yum安装的oracle-jdk都放在/usr/java下:
yum install java -y
配置环境变量,在 profie 文 件 末 尾 添 加 jdk 路 径 :
export JAVA_HOME=/usr/java/jdk1.8.0_181-cloudera
export CLASS_PATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin
source /etc/profile
#一般open-jdk在/usr/lib/jvm/
参考: https://www.cnblogs.com/hongfeng2019/p/11331688.html
tips: /etc/profile注释掉的也会生效,删除老配置,source, exit用户再进入即生效.
3/ 安装cm
管理节点:
yum install cloudera-manager-daemons
yum install cloudera-manager-agent
yum install cloudera-manager-server
其它节点:
yum install cloudera-manager-agent
4/ 在管理节点mysql建相关库
# 登录mysql
mysql -uroot -p
建立库前:
mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| performance_schema |
| sys |
| test |
+--------------------+
5 rows in set (0.00 sec)
#数据库配置
https://www.cloudera.com/documentation/enterprise/6/6.2/topics/cm_ig_mysql.html#cmig_topic_5_5
CREATE DATABASE scm DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON scm.* TO 'scm'@'%' IDENTIFIED BY 'Fengfeng99~';
GRANT ALL ON scm.* TO 'scm'@'localhost' IDENTIFIED BY 'Fengfeng99~';
CREATE DATABASE amon DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON amon.* TO 'amon'@'%' IDENTIFIED BY 'Fengfeng99~';
GRANT ALL ON amon.* TO 'amon'@'localhost' IDENTIFIED BY 'Fengfeng99~';
CREATE DATABASE rman DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON rman.* TO 'rman'@'%' IDENTIFIED BY 'Fengfeng99~';
GRANT ALL ON rman.* TO 'rman'@'localhost' IDENTIFIED BY 'Fengfeng99~';
CREATE DATABASE hue DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON hue.* TO 'hue'@'%' IDENTIFIED BY 'Fengfeng99~';
GRANT ALL ON hue.* TO 'hue'@'localhost' IDENTIFIED BY 'Fengfeng99~';
CREATE DATABASE hive DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON hive.* TO 'hive'@'%' IDENTIFIED BY 'Fengfeng99~';
GRANT ALL ON hive.* TO 'hive'@'localhost' IDENTIFIED BY 'Fengfeng99~';
CREATE DATABASE sentry DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON sentry.* TO 'sentry'@'%' IDENTIFIED BY 'Fengfeng99~';
GRANT ALL ON sentry.* TO 'sentry'@'localhost' IDENTIFIED BY 'Fengfeng99~';
CREATE DATABASE nav DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON nav.* TO 'nav'@'%' IDENTIFIED BY 'Fengfeng99~';
GRANT ALL ON nav.* TO 'nav'@'localhost' IDENTIFIED BY 'Fengfeng99~';
CREATE DATABASE navms DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON navms.* TO 'navms'@'%' IDENTIFIED BY 'Fengfeng99~';
GRANT ALL ON navms.* TO 'navms'@'localhost' IDENTIFIED BY 'Fengfeng99~';
CREATE DATABASE oozie DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON oozie.* TO 'oozie'@'%' IDENTIFIED BY 'Fengfeng99~';
GRANT ALL ON oozie.* TO 'oozie'@'localhost' IDENTIFIED BY 'Fengfeng99~';
flush privileges;
#查看授权情况
SHOW GRANTS FOR 'hive'@'%';
#建库后:
mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| amon |
| hue |
| metastore |
| mysql |
| nav |
| navms |
| oozie |
| performance_schema |
| rman |
| scm |
| sentry |
| sys |
| test |
+--------------------+
安装mysql-connector-java:
wget https://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.47.tar.gz
tar -zxvf mysql-connector-java-5.1.47.tar.gz
mkdir /usr/share/java
cp mysql-connector-java-5.1.47/mysql-connector-java-5.1.47-bin.jar /usr/share/java/mysql-connector-java.jar
初始化数据库:
/opt/cloudera/cm/schema/scm_prepare_database.sh mysql scm scm Fengfeng99~
#如果数据库在另一台机器上用:https://www.cloudera.com/documentation/enterprise/6/6.2/topics/prepare_cm_database.html
/opt/cloudera/cm/schema/scm_prepare_database.sh mysql -h db01.example.com --scm-host cm01.example.com scm scm
#调整Cloudera Manager Server的默认堆内存大小,从2G调成4G
grep CMF_JAVA_OPTS /etc/default/cloudera-scm-server
export CMF_JAVA_OPTS="-Xmx4G -XX:MaxPermSize=256m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp"
#修改各节点的配置文件
grep server_port /etc/cloudera-scm-agent/config.ini #server_port 是Server和Agent的通信端口,别乱改
server_port=7182
grep server_host /etc/cloudera-scm-agent/config.ini #CM服务器默认是本机
server_host=localhost
#修改为指向node1
ansible client -m shell -a 'sed -i 's/server_host=localhost/server_host=zhep-opay-temp-1.novalocal/g' /etc/cloudera-scm-agent/config.ini'
ansible client -m shell -a 'grep server_host /etc/cloudera-scm-agent/config.ini'
# 启动
systemctl start cloudera-scm-server
比较慢,大概需要5-10分钟,可打开日志看,不断会更新数据库的sechma版本
tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log
当看到这一句时,恭喜你,成功了.
2019-08-10 13:03:09,688 INFO WebServerImpl:com.cloudera.server.cmf.WebServerImpl: Started Jetty server.
systemctl enable cloudera-scm-server
systemctl status cloudera-scm-server
# 查看监听端口
ss -antlp | grep 7180
安装过程中会遇到的一些问题:
https://www.cloudera.com/documentation/enterprise/6/6.2/topics/cm_ig_troubleshooting.html#cmig_topic_19
管理节点和各节点:
systemctl restart cloudera-scm-agent
systemctl enable cloudera-scm-agent
systemctl status cloudera-scm-agent
CDH6.2安装之YUM方式的更多相关文章
- Linux环境下安装MySQL(yum方式)
1.下载mysql源安装包shell> wget http://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm 安装my ...
- linux 安装mysql yum方式
centos 6 #二进制rpm包安装 yum -y install mysql-server mysql centos7 mariadb和mysql一样的 只是一个分支 防止 mysql 被Orac ...
- CDH6.2安装之离线方式
参考: https://www.cnblogs.com/swordfall/p/10816797.html 下载parcels: https://archive.cloudera.com/cdh6/6 ...
- docker安装(yum方式)
1. 更新现有的yum 包:sudo yum update 2.添加Docker源: 2.1首先创建docker.repo: touch /etc/yum.repos.d/docker.repo [d ...
- Docker安装(yum方式 centos7)
yum install -y yum-utils device-mapper-persistent-data lvm2 yum-config-manager --add-repo http://m ...
- CentOS 7.2 yum方式安装MySQL 5.7
CentOS 7之后的版本yum的默认源中使用MariaDB替代原先MySQL,因此安装方式较为以往有一些改变: 下载mysql的源 wget http://dev.mysql.com/get/mys ...
- Centos中yum方式安装java
查看CentOS自带JDK是否已安装.◆输入:yum list installed |grep java. 若有自带安装的JDK,如何卸载CentOS系统自带Java环境?◆卸载JDK相关文件输入:y ...
- CentOS 6.5系统使用yum方式安装LAMP环境和phpMyAdmin详细过程
介绍如何在CentOs6.2下面使用YUM配置安装LAMP环境,一些兄弟也很喜欢使用编译的安装方法,个人觉得如果不是对服务器做定制,用yum安装稳定简单,何必去download&make&am ...
- centos 7 yum方式安装MySQL 5.6
本文根据mysql的官方文档操作:https://dev.mysql.com/doc/mysql-yum-repo-quick-guide/en/ 由于Centos7 默认数据库是mariabd(网上 ...
随机推荐
- golang web实战之三(基于iris框架的 web小应用,数据库采用 sqlite3 )
一.效果:一个图片应用 1.可上传图片到uploads目录. 2.可浏览和评论图片(用富文本编辑器输入) 二.梳理一下相关知识: 1.iris框架(模板输出,session) 2.富文本编辑器.sql ...
- word粘贴图片到ckeitor
在之前在工作中遇到在富文本编辑器中粘贴图片不能展示的问题,于是各种网上扒拉,终于找到解决方案,在这里感谢一下知乎中众大神以及TheViper. 通过知乎提供的思路找到粘贴的原理,通过TheViper找 ...
- 一步一步理解线段树——转载自JustDoIT
一步一步理解线段树 目录 一.概述 二.从一个例子理解线段树 创建线段树 线段树区间查询 单节点更新 区间更新 三.线段树实战 -------------------------- 一 概述 线段 ...
- 在vue中引入layer弹框的简易方法
npm i --save layui-layer 2.在main.js中引入 import layer from "layui-layer"; 3.然后就可以在各个组件中使用lay ...
- 设置PyCharm中选择文本的背景颜色和代码中和选中单词相同单词的背景颜色
1 设置选中单词的背景颜色 首先进入File->Setting->Editor->Color Scheme后复制一个存在的颜色主题作为自定义的颜色主题(默认的颜色主题是无法修改的,也 ...
- Fastadmin 后台编辑,或者添加的时候,出现的问题
1.情况如图:编辑的时候,这个关联id,默认查出来的是用户昵称,如果要显示用户名,该怎么修改,不要着急,听我慢慢道来 2.首先要找到 编辑页面,检查问题 3.完成
- When Database Sharding is Appropriate DATABASE SHARDING
w横切 http://www.agildata.com/database-sharding/ When Database Sharding is Appropriate Database Shardi ...
- ThreadPoolExecutor 优雅关闭线程池的原理.md
经典关闭线程池代码 ExecutorService executorService = Executors.newFixedThreadPool(10); executorService.shutdo ...
- regsvr32 错误解决方案
regsvr32对dll进行注册时报错,0x80070005表示权限不够,虽然是以管理员身份登录,但是仍然需要如下操作: 在运行命令提示符的时候,请右击 命令提示符 选 以管理身份运行.
- JAVA记事本的图形用户界面应用程序
JAVA记事本的图形用户界面应用程序 整体分析: 代码实现: import java.awt.EventQueue; import java.awt.event.ActionEvent; import ...