Spark集群安装MySQL环境
1.修改yum源
鉴于用国外的Yum源,速度比较慢,所以想到将国外的yum源改为国内的Yum源,这里选择使用比较多的阿里云源。具体修改方法可以参考此连接
我们先新建一个新的文件用来存放Yum源:
[kfk@bigdata-pro01 ~]$ cd /etc/yum.repos.d/
[kfk@bigdata-pro01 yum.repos.d]$ ll
total
-rw-r--r--. root root Nov CentOS-Base.repo
-rw-r--r--. root root Nov CentOS-Debuginfo.repo
-rw-r--r--. root root Nov CentOS-Media.repo
-rw-r--r--. root root Nov CentOS-Vault.repo
[kfk@bigdata-pro01 yum.repos.d]$ sudo touch CentOS-Base
下载新的CentOS-Base.repo 到/etc/yum.repos.d/:
[kfk@bigdata-pro01 yum.repos.d]$ sudo wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-6.repo
---- ::-- http://mirrors.aliyun.com/repo/Centos-6.repo
Resolving mirrors.aliyun.com... 183.232.170.189, 183.232.170.182, 111.29.22.220, ...
Connecting to mirrors.aliyun.com|183.232.170.189|:... connected.
HTTP request sent, awaiting response... OK
Length: (.5K) [application/octet-stream]
Saving to: “/etc/yum.repos.d/CentOS-Base.repo”
%[===================================================================================================================>] , --.-K/s in 0s
-- :: ( MB/s) - “/etc/yum.repos.d/CentOS-Base.repo” saved [/]
[kfk@bigdata-pro01 yum.repos.d]$ cd /etc/yum.repos.d
[kfk@bigdata-pro01 yum.repos.d]$ ls
CentOS-Base CentOS-Base.repo CentOS-Debuginfo.repo CentOS-Media.repo CentOS-Vault.repo
[kfk@bigdata-pro01 yum.repos.d]$ yum makecache //生成缓存
Loaded plugins: fastestmirror, refresh-packagekit, security
Determining fastest mirrors
* base: mirrors.aliyun.com
* extras: mirrors.aliyun.com
* updates: mirrors.aliyun.com
base | 3.7 kB :
extras | 3.4 kB :
extras/filelists_db | kB :
extras/prestodelta | 1.7 kB :
extras/primary_db | kB :
extras/other_db | kB :
updates | 3.4 kB :
updates/filelists_db | 2.4 MB :
updates/prestodelta | kB :
updates/primary_db | 3.2 MB :
updates/other_db| 179 kB 00:00
然后在notepad++里打开我们下载的文件,然后将其中的内容拷贝到我们刚才新建的文件中去。
[kfk@bigdata-pro01 yum.repos.d]$ sudo vi CentOS-Base
粘贴内容,然后保存退出。
# CentOS-Base.repo
#
# The mirror system uses the connecting IP address of the client and the
# update status of each mirror to pick mirrors that are updated to and
# geographically close to the client. You should use this for CentOS updates
# unless you are manually picking other mirrors.
#
# If the mirrorlist= does not work for you, as a fall back you can try the
# remarked out baseurl= line instead.
#
# [base]
name=CentOS-$releasever - Base - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/os/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/os/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=os
gpgcheck=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6 #released updates
[updates]
name=CentOS-$releasever - Updates - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/updates/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/updates/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=updates
gpgcheck=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6
#additional packages that may be useful
[extras]
name=CentOS-$releasever - Extras - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/extras/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/extras/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=extras
gpgcheck=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6
#additional packages that extend functionality of existing packages
[centosplus]
name=CentOS-$releasever - Plus - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/centosplus/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/centosplus/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=centosplus
gpgcheck=
enabled=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6 #contrib - packages by Centos Users
[contrib]
name=CentOS-$releasever - Contrib - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/contrib/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/contrib/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=contrib
gpgcheck=
enabled=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6
2.在线安装mysql
[kfk@bigdata-pro01 yum.repos.d]$ yum clean all
Loaded plugins: fastestmirror, refresh-packagekit, security
Cleaning repos: base extras updates
Cleaning up Everything
Cannot remove rpmdb file /var/lib/yum/rpmdb-indexes/file-requires
Cannot remove rpmdb file /var/lib/yum/rpmdb-indexes/version
Cannot remove rpmdb file /var/lib/yum/rpmdb-indexes/conflicts
Cannot remove rpmdb file /var/lib/yum/rpmdb-indexes/pkgtups-checksums
Cleaning up list of fastest mirrors
[kfk@bigdata-pro01 yum.repos.d]$ sudo yum install mysql-server
Loaded plugins: fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile
* base: mirrors.aliyun.com
* extras: mirrors.aliyun.com
* updates: mirrors.aliyun.com
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package mysql-server.x86_64 :5.1.-.el6_8 will be installed
--> Processing Dependency: mysql = 5.1.-.el6_8 for package: mysql-server-5.1.-.el6_8.x86_64
--> Processing Dependency: perl-DBI for package: mysql-server-5.1.-.el6_8.x86_64
--> Processing Dependency: perl-DBD-MySQL for package: mysql-server-5.1.-.el6_8.x86_64
--> Processing Dependency: perl(DBI) for package: mysql-server-5.1.-.el6_8.x86_64
--> Running transaction check
---> Package mysql.x86_64 :5.1.-.el6_8 will be installed
--> Processing Dependency: mysql-libs = 5.1.-.el6_8 for package: mysql-5.1.-.el6_8.x86_64
---> Package perl-DBD-MySQL.x86_64 :4.013-.el6 will be installed
---> Package perl-DBI.x86_64 :1.609-.el6 will be installed
--> Running transaction check
---> Package mysql-libs.x86_64 :5.1.-.el6 will be updated
---> Package mysql-libs.x86_64 :5.1.-.el6_8 will be an update
--> Finished Dependency Resolution
Dependencies Resolved
=============================================================================================================================================================
Package Arch Version Repository Size
=============================================================================================================================================================
Installing:
mysql-server x86_64 5.1.-.el6_8 base 8.6 M
Installing for dependencies:
mysql x86_64 5.1.-.el6_8 base k
perl-DBD-MySQL x86_64 4.013-.el6 base k
perl-DBI x86_64 1.609-.el6 base k
Updating for dependencies:
mysql-libs x86_64 5.1.-.el6_8 base 1.2 M
Transaction Summary
=============================================================================================================================================================
Install Package(s)
Upgrade Package(s)
Total download size: M
Is this ok [y/N]: y
Downloading Packages:
(/): mysql-5.1.-.el6_8.x86_64.rpm | kB :
(/): mysql-libs-5.1.-.el6_8.x86_64.rpm | 1.2 MB :
(/): mysql-server-5.1.-.el6_8.x86_64.rpm | 8.6 MB :
(/): perl-DBD-MySQL-4.013-.el6.x86_64.rpm | kB :
(/): perl-DBI-1.609-.el6.x86_64.rpm | kB :
-------------------------------------------------------------------------------------------------------------------------------------------------------------
Total 4.3 MB/s | MB :
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Updating : mysql-libs-5.1.-.el6_8.x86_64 /
Installing : perl-DBI-1.609-.el6.x86_64 /
Installing : perl-DBD-MySQL-4.013-.el6.x86_64 /
Installing : mysql-5.1.-.el6_8.x86_64 /
Installing : mysql-server-5.1.-.el6_8.x86_64 /
Cleanup : mysql-libs-5.1.-.el6.x86_64 /
Verifying : perl-DBD-MySQL-4.013-.el6.x86_64 /
Verifying : mysql-server-5.1.-.el6_8.x86_64 /
Verifying : perl-DBI-1.609-.el6.x86_64 /
Verifying : mysql-5.1.-.el6_8.x86_64 /
Verifying : mysql-libs-5.1.-.el6_8.x86_64 /
Verifying : mysql-libs-5.1.-.el6.x86_64 /
Installed:
mysql-server.x86_64 :5.1.-.el6_8
Dependency Installed:
mysql.x86_64 :5.1.-.el6_8 perl-DBD-MySQL.x86_64 :4.013-.el6 perl-DBI.x86_64 :1.609-.el6
Dependency Updated:
mysql-libs.x86_64 :5.1.-.el6_8
Complete! [kfk@bigdata-pro01 yum.repos.d]$ which mysql
/usr/bin/mysql
3.mysql 服务启动并测试
1)查看mysql服务状态
[kfk@bigdata-pro01 yum.repos.d]$ service mysqld status
mysqld is stopped
2)启动mysql服务
[kfk@bigdata-pro01 yum.repos.d]$ sudo service mysqld start
Initializing MySQL database: Installing MySQL system tables...
OK
Filling help tables...
OK To start mysqld at boot time you have to copy
support-files/mysql.server to the right place for your system
PLEASE REMEMBER TO SET A PASSWORD FOR THE MySQL root USER !
To do so, start the server, then issue the following commands:
/usr/bin/mysqladmin -u root password 'new-password'
/usr/bin/mysqladmin -u root -h bigdata-pro01.kfk.com password 'new-password'
Alternatively you can run:
/usr/bin/mysql_secure_installation which will also give you the option of removing the test
databases and anonymous user created by default. This is
strongly recommended for production servers. See the manual for more instructions. You can start the MySQL daemon with:
cd /usr ; /usr/bin/mysqld_safe &
You can test the MySQL daemon with mysql-test-run.pl
cd /usr/mysql-test ; perl mysql-test-run.pl
Please report any problems with the /usr/bin/mysqlbug script!
[ OK ]
Starting mysqld: [ OK ]
3)设置mysql密码
[kfk@bigdata-pro01 yum.repos.d]$ /usr/bin/mysqladmin -u root password 'root'
4)连接mysql
[kfk@bigdata-pro01 yum.repos.d]$ mysql -u root -proot Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is Server version: 5.1. Source distribution Copyright (c) , , Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql>
查看数据库
mysql> show databases; +--------------------+ | Database | +--------------------+ | information_schema | | mysql | | test | +--------------------+ rows in set (0.00 sec)
数据库安装成功!
以上就是博主为大家介绍的这一板块的主要内容,这都是博主自己的学习过程,希望能给大家带来一定的指导作用,有用的还望大家点个支持,如果对你没用也望包涵,有错误烦请指出。如有期待可关注博主以第一时间获取更新哦,谢谢!同时也欢迎转载,但必须在博文明显位置标注原文地址,解释权归博主所有!
Spark集群安装MySQL环境的更多相关文章
- CentOS6安装各种大数据软件 第十章:Spark集群安装和部署
相关文章链接 CentOS6安装各种大数据软件 第一章:各个软件版本介绍 CentOS6安装各种大数据软件 第二章:Linux各个软件启动命令 CentOS6安装各种大数据软件 第三章:Linux基础 ...
- [bigdata] spark集群安装及测试
在spark安装之前,应该已经安装了hadoop原生版或者cdh,因为spark基本要基于hdfs来进行计算. 1. 下载 spark: http://mirrors.cnnic.cn/apache ...
- spark集群安装配置
spark集群安装配置 一. Spark简介 Spark是一个通用的并行计算框架,由UCBerkeley的AMP实验室开发.Spark基于map reduce 算法模式实现的分布式计算,拥有Hadoo ...
- 大数据技术之_19_Spark学习_01_Spark 基础解析 + Spark 概述 + Spark 集群安装 + 执行 Spark 程序
第1章 Spark 概述1.1 什么是 Spark1.2 Spark 特点1.3 Spark 的用户和用途第2章 Spark 集群安装2.1 集群角色2.2 机器准备2.3 下载 Spark 安装包2 ...
- Spark入门:第2节 Spark集群安装:1 - 3;第3节 Spark HA高可用部署:1 - 2
三. Spark集群安装 3.1 下载spark安装包 下载地址spark官网:http://spark.apache.org/downloads.html 这里我们使用 spark-2.1.3-bi ...
- 3 Spark 集群安装
第3章 Spark集群安装 3.1 Spark安装地址 1.官网地址 http://spark.apache.org/ 2.文档查看地址 https://spark.apache.org/docs/2 ...
- Spark 个人实战系列(1)--Spark 集群安装
前言: CDH4不带yarn和spark, 因此需要自己搭建spark集群. 这边简单描述spark集群的安装过程, 并讲述spark的standalone模式, 以及对相关的脚本进行简单的分析. s ...
- 大数据平台搭建-spark集群安装
版本要求 java 版本:1.8.*(1.8.0_60) 下载地址:http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downl ...
- Spark集群安装和WordCount编写
一.Spark概述 官网:http://spark.apache.org/ Apache Spark™是用于大规模数据处理的统一分析引擎. 为大数据处理而设计的快速通用的计算引擎. Spark加州大学 ...
随机推荐
- android 设置颜色的三种方法
1.利于系统自带的颜色类 如TextView1.setTextColor(Android.graphics.Color.RED); 2.数字颜色表示法 TextView1.setTextColor(0 ...
- const 在C++中的区别
一.Const作用 如下表所示: No. 作用 说明 参考代码 1 可以定义const常量 const int Max = 100; 2 便于进行类型检查 const常量有数据类型,而宏常量没有 ...
- excel导出工具
介绍 excel导出工具 整个项目的代码结构如下 com \---utils +---demo # 案例相关 | | ExcelExportApplication.java # springboot启 ...
- SPOJ - BALNUM Balanced Numbers(数位dp+三进制状压)
Balanced Numbers Balanced numbers have been used by mathematicians for centuries. A positive integer ...
- 比较get 和post
- Android View部分消失效果实现
本文来自网易云社区 作者:孙有军 老需求 我们经常会有需求就是View消失的效果,这里我们说的消失往往是全部消失,我们可能采用一个alpha动画,在指定的时间内消失掉View,出现则实现相反的动画.我 ...
- Wannafly挑战赛28B(DP,思维,字符串)
#include<bits/stdc++.h>using namespace std;int n;int nxt[3][100007];char buff[100007];const ch ...
- Nginx部署静态页面及引用图片有效访问的两种方式
nginx安装百度一下有很多,直接正题: 静态文件目录结构 file#文件位置 /home/service/file/ css js images html fonts 配置nginx.conf核心代 ...
- php二维数组的某一字段 做分组统计
$country=array_column($order,'country');$countryGP=array_count_values($country);对二维数组的某一字段 做分组统计
- [SinGuLaRiTy] NOIP模拟赛(TSY)-Day 1
[SinGuLaRiTy-1032] Copyright (c) SinGuLaRiTy 2017. All Rights Reserved. ...