GreenPlum数据库安装
第一章 文档概述
本文描述适用于Greenplum4.0以上版本的安装操作。所涉及到的操作系统相关参数调整,主要针对Redhat Linux操作系统。
第二章 安装介质
操作系统:CentOS release 6.5 (Final)。
Greenplum安装版本:greenplum-db-4.3.8.1-build-2-RHEL5-x86_64.zip
第三章 安装前准备
3.1、网络规划
建议在Greenplum数据库系统安装之前,把网络配置规划好
3.2、存储空间规划
首先,需要评估目标数据库数据所需要的空间容量。建议了解客户搭建Greenplum数据库的具体应用。
举例:估计数据库所需空间为U,数据库需要启用Mirror,磁盘阵列总可用空间为D(Raid之后)。空间规划服务和如下公式:
2 * U + U / 3 = D * 70%
磁盘空间D平均分配到各个Segment服务器上。
Master需要相应的空间。使用服务器内置硬盘的计算方式类似。
3.3、数据库实例规划
规划每个Segment服务器上建立的数据库实例的数量(instance数量),通常建议每2个CPU内核(core)对应一个数据库实例
第四章 操作系统设置
4.1 、设置主机名
修改各台主机的主机名称。一般建议的命名规则如下:
Master:mdw
Standby Master:smdw
Segment Host:sdw1、sdw2……sdwn
修改操作:
- 、hostname mdw
- 、修改 /etc/sysconfig/network 配置文件中的hostname
4.2 、设置hosts解析(所有节点,Master和Segments)
通常Master和Standby Master主机都配置外部IP和内部IP。Segment主机可只配置内部IP。所有主机的hosts文件内容必须保持一致
- 127.0.0.1 mdw localhost localhost.localdomain localhost4 localhost4.localdomain4
- 192.168.1.201 mdw
- 192.168.1.202 sdw1
- 192.168.1.203 sdw2
4.3、安装依赖软件(所有节点,Master和Segments)
- yum -y install ed rsync coreutils glib2 lrzsz sysstat e4fsprogs xfsprogs ntp readline-devel zlib zlib-devel openssl openssl-devel pam-devel libxml2-devel libxslt-devel python-devel tcl-devel gcc make smartmontools flex bison OpenIPMI-tools openldap openldap-devel logrotate python-py gcc-c++ apr-devel libcurl-devel bzip2-devel libyaml-devel openssh-clients
【涉及机器】:所有服务器关闭防火墙
- service iptables stop
- chkconfig iptables off
- service ip6tables stop
- chkconfig ip6tables off
4.4、配置NTP时间同步(所有节点)
使用root用户进行操作,涉及所有服务器。
Greenplum推荐使用NTP(Network Time Protocol)同步各台主机的时钟。建议设置一台独立的时钟服务器。例如时钟服务器IP为10.6.220.20
4.4.1、Master服务器配置与时钟服务器同步。
修改配置文件/etc/ntp.conf后,启动ntpd服务。举例:配置文件增加:
- server 10.6.220.20
启动NTP服务:
- service ntpd start;chkconfig ntpd on
#如果没有独立的时钟服务器,则应该以Master服务器做内部的时钟服务器,Master就可以不用修改ntp.conf配置文件,直接启动ntpd服务即可。
4.4.2、所有Segment服务器优先与Master服务器同步,其次与Standby Master服务器同步。
修改配置文件/etc/ntp.conf后,重启ntpd服务。配置文件增加:
- server mdw prefer
- server smdw
启动服务:
- service ntpd start;chkconfig ntpd on
4.4.3、Standby Master服务器优先与Master服务器,其次与始终服务器同步。
修改配置文件/etc/ntp.conf后,重启ntpd服务。配置文件增加:
- server mdw prefer
- server 10.6.220.20
启动服务:
- service ntpd start;chkconfig ntpd on
#如果没有独立的时钟服务器,第二行不用配置。
4.5 修改系统参数(Redhat)
【涉及机器】:所有服务器;使用root用户进行修改,重启后生效。
4.5.1、修改系统参数/etc/sysctl.conf
- kernel.shmmax =
- kernel.shmmni =
- kernel.shmall =
- kernel.sem =
- kernel.sysrq =
- kernel.core_uses_pid =
- kernel.msgmnb =
- kernel.msgmax =
- net.ipv4.tcp_syncookies =
- net.ipv4.ip_forward =
- net.ipv4.conf.default.accept_source_route =
- net.ipv4.tcp_tw_recycle =
- net.ipv4.tcp_max_syn_backlog =
- net.ipv4.conf.all.arp_filter =
- net.ipv4.conf.default.arp_filter =
- net.core.netdev_max_backlog =
- vm.overcommit_memory =
- kernel.msgmni =
- net.ipv4.ip_local_port_range =
4.5.2、修改系统参数/etc/security/limits.conf
Linux PAM中 pam_limits.so 的配置文件
- * soft nofile
- * hard nofile
- * soft nproc
- * hard nproc
4.5.3、修改磁盘预读参数(所有节点,Master和Segments)
通过修改预读扇区数,可以有效磁盘的读性能,特别是顺序读,GPDB数据库要求最小磁盘扇区数为16384,建议设置为65535。
在参数文件/etc/rc.d/rc.local中增加;
- blockdev --setra /dev/sd
4.5.4、修改配置/boot/grub/menu.lst
Linux默认的I/O调度模式是CFQ,通常需要修改I/O调度策略为deadline,可以通过下面的命令查看I/O调度策略。
- cat /sys/block/sda/queue/scheduler
- #临时修改
- echo deadline > /sys/block/sda/queue/scheduler
如果永久修改I/O调度策略,则需要修改/boot/grub/menu.lst文件,在“kernel*”行后面增加elevator=deadline。
4.5.5、修改配置/etc/sysconfig/i18n
增加RC_LANG=en_US.UTF-8
4.6、启动IPMI服务
(IPMI(Intelligent Platform Management Interface)即智能平台管理接口是使硬件管理具备“智能化”的新一代通用接口标准。如果没有安装相关服务,建议安装)
- service ipmi start;chkconfig ipmi on
第五章 配置用户和数据目录
5.1、创建gpadmin用户(所有节点,Master和Segments)
- [root@mdw ~]# groupadd -g gpadmin
- [root@mdw ~]# useradd -u -g gpadmin gpadmin
- [root@mdw ~]# passwd gpadmin
- Changing password for user gpadmin.
- New password:
- BAD PASSWORD: is too simple
- Retype new password:
- passwd: all authentication tokens updated successfully.
5.2、创建软件安装目录(所有节点,Master和Segments)
- [root@mdw ~]# mkdir -p /gpdb/app
- [root@mdw ~]# chown -R gpadmin:gpadmin /gpdb/
/gpdb目录为GPDB的BASE目录,/gpdb/app为GPDB的HOME目录。
第六章 安装Greenplum
6.1、上传并解压GPDB安装文件(仅Master节点)
- [gpadmin@mdw gpdb]$ unzip greenplum-db-4.3.8.1-build--RHEL5-x86_64.zip
- Archive: greenplum-db-4.3.8.1-build--RHEL5-x86_64.zip
- inflating: README_INSTALL
- inflating: greenplum-db-4.3.8.1-build--RHEL5-x86_64.bin
- [gpadmin@mdw gpdb]$ ll
- total
- drwxr-xr-x. gpadmin gpadmin Mar : app
- -rwxr-xr-x. gpadmin gpadmin Apr greenplum-db-4.3.8.1-build--RHEL5-x86_64.bin
- -rw-r--r--. gpadmin gpadmin Mar : greenplum-db-4.3.8.1-build--RHEL5-x86_64.zip
- -rw-r--r--. gpadmin gpadmin Apr README_INSTALL
6.2、运行安装文件
- gpadmin@mdw gpdb]$ ./greenplum-db-4.3.8.1-build--RHEL5-x86_64.bin
- 下面是许可信息后面的内容
- ********************************************************************************
- You must read and accept the Pivotal Database license agreement
- before installing
- ********************************************************************************
- *** IMPORTANT INFORMATION - PLEASE READ CAREFULLY ***
- PIVOTAL GREENPLUM DATABASE END USER LICENSE AGREEMENT
- IMPORTANT - READ CAREFULLY: This Software contains computer programs and
- other proprietary material and information, the use of which is subject to
- and expressly conditioned upon acceptance of this End User License
- Agreement ("EULA").
- This EULA is a legally binding document between you (meaning the person or
- the entity that obtained the Software under the terms and conditions of
- this EULA, is agreeing to be bound by the terms and conditions of this
- EULA, and is referred to below as "You" or "Customer") and Pivotal (meaning
- (i) Pivotal Software, Inc., if Customer is located in the United States;
- and (ii) the local Pivotal sales subsidiary, if Customer is located in a
- country outside the United States in which Pivotal has a local sales
- subsidiary; and (iii) GoPivotal International Limited, if Customer is
- located in a country outside the United States in which Pivotal does not
- have a local sales subsidiary (in each case, referred to herein as
- "Pivotal"). Unless Customer has entered into a written and separately
- signed agreement with Pivotal that is currently in effect with respect to
- the license of the Software and provision of Support Services and
- Subscription Services, this EULA governs Customer's use of the Software and
- the provision of Support Services and Subscription Services. Capitalized
- terms have the meaning stated in the EULA.
- ............
- 必须输入YES才可继续安装。
- ********************************************************************************
- Do you accept the Pivotal Database license agreement? [yes|no]
- ********************************************************************************
- yes
- 默认GPDB的安装路径为/usr/local/greenplum-db-**,确认需要输入YES,如果需要安装到其他路径,直接输入要按照的路径即可
- ********************************************************************************
- Provide the installation path for Greenplum Database or press ENTER to
- accept the default installation path: /usr/local/greenplum-db-4.3.8.1
- ********************************************************************************
- /gpdb/app
- ********************************************************************************
- Install Greenplum Database into </gpdb/app>? [yes|no]
- ********************************************************************************
- yes
- Extracting product to /gpdb/app
安装完成;安装完成会在/gpdb/app目录下生成以下文件。
- [gpadmin@mdw gpdb]$ cd app
- [gpadmin@mdw app]$ ll
- total
- drwxr-xr-x. gpadmin gpadmin Apr bin
- drwxr-xr-x. gpadmin gpadmin Apr demo
- drwxr-xr-x. gpadmin gpadmin Apr docs
- drwxr-xr-x. gpadmin gpadmin Apr etc
- drwxr-xr-x. gpadmin gpadmin Apr ext
- -rw-r--r--. gpadmin gpadmin Apr GPDB-LICENSE.txt
- -rw-rw-r--. gpadmin gpadmin Mar : greenplum_path.sh
- drwxr-xr-x. gpadmin gpadmin Apr include
- drwxr-xr-x. gpadmin gpadmin Apr lib
- -rw-r--r--. gpadmin gpadmin Apr LICENSE.thirdparty
- drwxr-xr-x. gpadmin gpadmin Apr sbin
- drwxr-xr-x. gpadmin gpadmin Apr share
6.3、设置GPDB环境变量(仅Master节点)
安装完成后修改gpadmin用户home的~/.bashrc配置文件,增加
- source /gpdb/app/greenplum_path.sh
6.4、配置hostname文件(用于建立多机信任)
编辑节点信息文件(仅Master节点)。为了管理方便,在app目录下创建config文件夹,将节点信息文件存放在该目录下。需要创建两个文件,其中一个文件(hostlist)存放所有节点信息,seg_host文件只存放segment节点信息
- [gpadmin@mdw app]$ mkdir config
- [gpadmin@mdw app]$ cd config
- [gpadmin@mdw config]$ cat hostlist
- mdw
- sdw1
- sdw2
- [gpadmin@mdw config]$ cat seg_host
- sdw1
- sdw2
6.5、打通所有节点直接的互信(仅Master节点)
GreenPlum数据库提供gpssh-exkeys工具来打开所有节点直接的互信关系,非常方便
- [gpadmin@mdw config]$ gpssh-exkeys -f hostlist
- [STEP of ] create local ID and authorize on local host
- ... /home/gpadmin/.ssh/id_rsa file exists ... key generation skipped
- [STEP of ] keyscan all hosts and update known_hosts file
- [STEP of ] authorize current user on remote hosts
- ... send to mdw
- ... send to sdw1
- ***
- *** Enter password for sdw1:
- ... send to sdw2
- [STEP of ] determine common authentication file content
- [STEP of ] copy authentication files to all remote hosts
- ... finished key exchange with mdw
- ... finished key exchange with sdw1
- ... finished key exchange with sdw2
- [INFO] completed successfully
互信配置完成后,可以通过gpssh工具来验证互信是否成功配置,-e参数后面的是远程登录节点后执行的命令。通过gpssh工具可以在所有节点运行同一命令,非常方便(后续会用到)。
- [gpadmin@mdw config]$ gpssh -f /gpdb/app/config/hostlist -e 'pwd'
- [ mdw] pwd
- [ mdw] /home/gpadmin
- [sdw2] pwd
- [sdw2] /home/gpadmin
- [sdw1] pwd
- [sdw1] /home/gpadmin
6.6、Segment节点安装GreenPlum软件(仅Master节点)
通过gpseginstall命令安装segment软件,使用-u参数指定安装用户,-p参数指定安装用户的密码,这样将不再需要交互式输入密码。
- [gpadmin@mdw config]$ gpseginstall -f hostlist -u gpadmin -p li0924
- :::: gpseginstall:mdw:gpadmin-[INFO]:-Installation Info:
- link_name greenplum-db
- binary_path /gpdb/app
- binary_dir_location /gpdb
- binary_dir_name app
- :::: gpseginstall:mdw:gpadmin-[INFO]:-check cluster password access
- :::: gpseginstall:mdw:gpadmin-[INFO]:-de-duplicate hostnames
- :::: gpseginstall:mdw:gpadmin-[INFO]:-master hostname: mdw
- :::: gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar; rm -f /gpdb/app.tar.gz
- :::: gpseginstall:mdw:gpadmin-[INFO]:-cd /gpdb; tar cf app.tar app
- :::: gpseginstall:mdw:gpadmin-[INFO]:-gzip /gpdb/app.tar
- :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: mkdir -p /gpdb
- :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -rf /gpdb/app
- :::: gpseginstall:mdw:gpadmin-[INFO]:-scp software to remote location
- :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: gzip -f -d /gpdb/app.tar.gz
- :::: gpseginstall:mdw:gpadmin-[INFO]:-md5 check on remote location
- :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; tar xf app.tar
- :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -f /gpdb/app.tar
- :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; rm -f greenplum-db; ln -fs app greenplum-db
- :::: gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar.gz
- :::: gpseginstall:mdw:gpadmin-[INFO]:-version string on master: gpssh version 4.3.8.1 build
- :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/greenplum-db/./greenplum_path.sh; /gpdb/greenplum-db/./bin/gpssh --version
- :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/app/greenplum_path.sh; /gpdb/app/bin/gpssh --version
- :::: gpseginstall:mdw:gpadmin-[INFO]:-SUCCESS -- Requested commands completed
Segment节点会根据Master节点的安装路径安装GreenPlum软件,目录结构和Master一模一样。
6.7、 Segment节点配置环境变量(所有Segment节点)
修改gpadmin用户home的~/.bashrc配置文件,增加
- source /gpdb/app/greenplum_path.sh
第七章 数据库的初始化
7.1、创建数据文件存放目录(所有节点)
- [root@mdw ~]# mkdir -p /data/gpdata/master
- [root@mdw ~]# chown -R gpadmin:gpadmin /data
- [root@sdw1 ~]# mkdir -p /data/gpdata/primary
- [root@sdw1 ~]# mkdir -p /data/gpdata/mirror
- [root@sdw1 ~]# chown -R gpadmin:gpadmin /data
本案例Master节点的数据文件存放在/data/gpdata/master目录,Segment节点的主数据文件存放在/data/gpdata/primary目录;镜像数据文件放在/data/gpdata/mirror目录
7.2、配置时间同步(所有节点)
本案例Master节点的服务器配置为NTP的服务端,Segment节点为NTP的客户端。Master节点使用root用户通过gpssh工具批量调用date命令对比各服务器的时间是否一致。
- [gpadmin@mdw ~]$ gpssh -f /gpdb/app/config/hostlist
- Note: command history unsupported on this machine ...
- => date
- [sdw1] Wed Mar :: CST
- [ mdw] Wed Mar :: CST
- [sdw2] Wed Mar :: CST
7.3、系统检查(仅Master节点)
在初始化数据库之前,需要进行先决条件检查,主要检查磁盘I/O能力、网络带宽、内核参数、limit等条件是否满足GreenPlum数据库的要求。
参数配置检查
- [gpadmin@mdw ~]$ gpcheck -f /gpdb/app/config/hostlist -m mdw
- :::: gpcheck:mdw:gpadmin-[INFO]:-dedupe hostnames
- :::: gpcheck:mdw:gpadmin-[INFO]:-Detected platform: Generic Linux Cluster
- :::: gpcheck:mdw:gpadmin-[INFO]:-generate data on servers
- :::: gpcheck:mdw:gpadmin-[INFO]:-copy data files from servers
- :::: gpcheck:mdw:gpadmin-[INFO]:-delete remote tmp files
- :::: gpcheck:mdw:gpadmin-[INFO]:-Using gpcheck config file: /gpdb/greenplum-db/./etc/gpcheck.cnf
- :::: gpcheck:mdw:gpadmin-[ERROR]:-GPCHECK_ERROR host(None): utility will not check all settings when run as non-root user
- :::: gpcheck:mdw:gpadmin-[INFO]:-gpcheck completing...
参数性能检查
- 参数配置检查
- gpcheck -f /gpdb/app/config/hostlist -m mdw -s smdw
- 核对并修改下你感应系统参数。
- 性能检查
- 2.1 网络性能检查
- gpcheckperf -f /gpdb/app/config/hostlist -r N -d /tmp > checknetwork.out
- 2.2 磁盘性能检查
- gpcheckperf -f /gpdb/app/config/hostlist -r ds -D -d /data/gpdata/primary -d /data/gpdata/mirror r > checkio.out
- 检查磁盘IO的目标目录是数据库的数据文件目录,测试工具会写入系统内存的两倍大小的数据量。
7.4、创建GreenPlum数据库的参数文件(仅Master节点)
在$GPHOME/docs目录下,存在一些参数文件的模版,可以通过这些模版快速配置一些常用的参数文件。比如GreenPlum数据库的参数文件可以参考$GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config文件。
- [gpadmin@mdw ~]$ cp $GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config /gpdb/app/config/gpinitsystem_config
配置参数文件gpinitsystem_config
- [gpadmin@mdw config]$ cat gpinitsystem_config
- # FILE NAME: gpinitsystem_config
- # Configuration file needed by the gpinitsystem
- ################################################
- #### REQUIRED PARAMETERS
- ################################################
- #### Name of this Greenplum system enclosed in quotes.
- ARRAY_NAME="EMC Greenplum DW"
- #### Naming convention for utility-generated data directories.
- SEG_PREFIX=gpseg
- #### Base number by which primary segment port numbers
- #### are calculated.
- PORT_BASE=
- #### File system location(s) where primary segment data directories
- #### will be created. The number of locations in the list dictate
- #### the number of primary segments that will get created per
- #### physical host (if multiple addresses for a host are listed in
- #### the hostfile, the number of segments will be spread evenly across
- #### the specified interface addresses).
- declare -a DATA_DIRECTORY=(/data/gpdata/primary)
- #### OS-configured hostname or IP address of the master host.
- MASTER_HOSTNAME=mdw
- #### File system location where the master data directory
- #### will be created.
- MASTER_DIRECTORY=/data/gpdata/master
- #### Port number for the master instance.
- MASTER_PORT=
- #### Shell utility used to connect to remote hosts.
- TRUSTED_SHELL=ssh
- #### Maximum log file segments between automatic WAL checkpoints.
- CHECK_POINT_SEGMENTS=
- #### Default server-side character set encoding.
- ENCODING=UNICODE
- ################################################
- #### OPTIONAL MIRROR PARAMETERS
- ################################################
- #### Base number by which mirror segment port numbers
- #### are calculated.
- #MIRROR_PORT_BASE=
- #### Base number by which primary file replication port
- #### numbers are calculated.
- #REPLICATION_PORT_BASE=
- #### Base number by which mirror file replication port
- #### numbers are calculated.
- #MIRROR_REPLICATION_PORT_BASE=
- #### File system location(s) where mirror segment data directories
- #### will be created. The number of mirror locations must equal the
- #### number of primary locations as specified in the
- #### DATA_DIRECTORY parameter.
- #declare -a MIRROR_DATA_DIRECTORY=(/data/gpdata/mirror)
- ################################################
- #### OTHER OPTIONAL PARAMETERS
- ################################################
- #### Create a database of this name after initialization.
- #DATABASE_NAME=name_of_database
- #### Specify the location of the host address file here instead of
- #### with the the -h option of gpinitsystem.
- #MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem
7.5、GreenPlum数据库初始化(仅Master节点)
接下来就可以使用gpinitsystem工具初始化数据库了,一些参数文件中没有设置的重要参数,在初始化数据库时会被使用默认值,可以在初始化之后根据需求及主机的配置进行设置。GreenPlum数据库的参数也分为静态参数和动态参数,静态参数需重启数据库才能生效,动态参数不需要重启数据库即可生效。
若需要standby master;可以-s 主机名即可;也可以后续使用gpinitsystem添加。这个后续文章讲解
- [gpadmin@mdw config]$ gpinitsystem -c gpinitsystem_config -h seg_host
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, please wait...
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Reading Greenplum configuration file gpinitsystem_config
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Locale has not been set in gpinitsystem_config, will set to default value
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Locale set to en_US.utf8
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, Completed
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, please wait...
- ..
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Configuring build for standard array
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, Completed
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Building primary segment instance array, please wait...
- ..
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking Master host
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, please wait...
- .:::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw1 is assigned as localhost in /etc/hosts
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw1 from local host line in /etc/hosts
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
- .:::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw2 is assigned as localhost in /etc/hosts
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw2 from local host line in /etc/hosts
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, Completed
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database Creation Parameters
- :::: gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master Configuration
- :::: gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master instance name = EMC Greenplum DW
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master hostname = mdw
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master port =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master instance dir = /data/gpdata/master/gpseg-
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master LOCALE = en_US.utf8
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum segment prefix = gpseg
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master Database =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master connections =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master buffers = 128000kB
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Segment connections =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Segment buffers = 128000kB
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checkpoint segments =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Encoding = UNICODE
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Postgres param file = Off
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Initdb to be used = /gpdb/greenplum-db/./bin/initdb
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /gpdb/greenplum-db/./lib
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Ulimit check = Passed
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Array host connect type = Single hostname per node
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [] = ::
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [] = 192.168.1.201
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [] = fe80::20c:29ff:fe30:f99e
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Standby Master = Not Configured
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Primary segment # =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Total Database segments =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Trusted shell = ssh
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Number segment hosts =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Mirroring config = OFF
- :::: gpinitsystem:mdw:gpadmin-[INFO]:----------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Primary Segment Configuration
- :::: gpinitsystem:mdw:gpadmin-[INFO]:----------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-sdw1 /data/gpdata/primary/gpseg0
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-sdw2 /data/gpdata/primary/gpseg1
- Continue with Greenplum creation Yy/Nn>
- y
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Building the Master instance database, please wait...
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Starting the Master in admin mode
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Commencing parallel build of primary segment instances
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Spawning parallel processes batch [], please wait...
- ..
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Waiting for parallel processes batch [], please wait...
- .............................
- :::: gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Parallel process exit status
- :::: gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as completed =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as killed =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as failed =
- :::: gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Deleting distributed backout files
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Removing back out file
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-No errors generated from parallel processes
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode
- :::: gpstop:mdw:gpadmin-[INFO]:-Starting gpstop with args: -a -i -m -d /data/gpdata/master/gpseg-
- :::: gpstop:mdw:gpadmin-[INFO]:-Gathering information and validating the environment...
- :::: gpstop:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
- :::: gpstop:mdw:gpadmin-[INFO]:-Obtaining Segment details from master...
- :::: gpstop:mdw:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 4.3.8.1 build 1'
- :::: gpstop:mdw:gpadmin-[INFO]:-There are connections to the database
- :::: gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate'
- :::: gpstop:mdw:gpadmin-[INFO]:-Master host=mdw
- :::: gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate
- :::: gpstop:mdw:gpadmin-[INFO]:-Master segment instance directory=/data/gpdata/master/gpseg-
- :::: gpstop:mdw:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process
- :::: gpstop:mdw:gpadmin-[INFO]:-Terminating processes for segment /data/gpdata/master/gpseg-
- :::: gpstart:mdw:gpadmin-[INFO]:-Starting gpstart with args: -a -d /data/gpdata/master/gpseg-
- :::: gpstart:mdw:gpadmin-[INFO]:-Gathering information and validating the environment...
- :::: gpstart:mdw:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 4.3.8.1 build 1'
- :::: gpstart:mdw:gpadmin-[INFO]:-Greenplum Catalog Version: ''
- :::: gpstart:mdw:gpadmin-[INFO]:-Starting Master instance in admin mode
- :::: gpstart:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
- :::: gpstart:mdw:gpadmin-[INFO]:-Obtaining Segment details from master...
- :::: gpstart:mdw:gpadmin-[INFO]:-Setting new master era
- :::: gpstart:mdw:gpadmin-[INFO]:-Master Started...
- :::: gpstart:mdw:gpadmin-[INFO]:-Shutting down master
- :::: gpstart:mdw:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait...
- ....
- :::: gpstart:mdw:gpadmin-[INFO]:-Process results...
- :::: gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
- :::: gpstart:mdw:gpadmin-[INFO]:- Successful segment starts =
- :::: gpstart:mdw:gpadmin-[INFO]:- Failed segment starts =
- :::: gpstart:mdw:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) =
- :::: gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
- :::: gpstart:mdw:gpadmin-[INFO]:-
- :::: gpstart:mdw:gpadmin-[INFO]:-Successfully started of segment instances
- :::: gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
- :::: gpstart:mdw:gpadmin-[INFO]:-Starting Master instance mdw directory /data/gpdata/master/gpseg-
- :::: gpstart:mdw:gpadmin-[INFO]:-Command pg_ctl reports Master mdw instance active
- :::: gpstart:mdw:gpadmin-[INFO]:-No standby master configured. skipping...
- :::: gpstart:mdw:gpadmin-[INFO]:-Database successfully started
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Loading gp_toolkit...
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Scanning utility log file for any warning messages
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-*******************************************************
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-Scan of log file indicates that some warnings or errors
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-were generated during the array creation
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Please review contents of log file
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-/home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-To determine level of criticality
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-These messages could be from a previous run of the utility
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-that was called today!
- :::: gpinitsystem:mdw:gpadmin-[WARN]:-*******************************************************
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database instance successfully created
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-To complete the environment configuration, please
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-update gpadmin .bashrc file with the following
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-. Ensure that the greenplum_path.sh file is sourced
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-. Add "export MASTER_DATA_DIRECTORY=/data/gpdata/master/gpseg-1"
- :::: gpinitsystem:mdw:gpadmin-[INFO]:- to access the Greenplum scripts for this instance:
- :::: gpinitsystem:mdw:gpadmin-[INFO]:- or, use -d /data/gpdata/master/gpseg- option for the Greenplum scripts
- :::: gpinitsystem:mdw:gpadmin-[INFO]:- Example gpstate -d /data/gpdata/master/gpseg-
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-To initialize a Standby Master Segment for this Greenplum instance
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Review options for gpinitstandby
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-The Master /data/gpdata/master/gpseg-/pg_hba.conf post gpinitsystem
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-has been configured to allow all hosts within this new
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-new array must be explicitly added to this file
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-Refer to the Greenplum Admin support guide which is
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-located in the /gpdb/greenplum-db/./docs directory
- :::: gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
GreenPlum数据库安装的更多相关文章
- Greenplum 数据库安装部署(生产环境)
Greenplum 数据库安装部署(生产环境) 硬件配置: 16 台 IBM X3650, 节点配置:CPU 2 * 8core,内存 128GB,硬盘 16 * 900GB,万兆网卡. 万兆交换机. ...
- MPP - GreenPlum数据库安装以及简单使用
一.集群介绍 共3台主机,ip 为193.168.0.93 193.168.0.94 193.168.0.95 集群对应master和segment如下,193.168.0.93为master节 ...
- 转_Greenplum 数据库安装部署(生产环境)
Greenplum 数据库安装部署(生产环境) 硬件配置: 16 台 IBM X3650, 节点配置:CPU 2 * 8core,内存 128GB,硬盘 16 * 900GB,万兆网卡. 万兆交换机. ...
- Greenplum 数据库架构分析
Greenplum 数据库是最先进的分布式开源数据库技术,主要用来处理大规模的数据分析任务,包括数据仓库.商务智能(OLAP)和数据挖掘等.自2015年10月正式开源以来,受到国内外业内人士的广泛关注 ...
- 开源大数据引擎:Greenplum 数据库架构分析
Greenplum 数据库是最先进的分布式开源数据库技术,主要用来处理大规模的数据分析任务,包括数据仓库.商务智能(OLAP)和数据挖掘等.自2015年10月正式开源以来,受到国内外业内人士的广泛关注 ...
- GreenPlum完全安装_GP5.11.3完整安装
1 概述 1.1 背景 1.2 目标 1.3 使用对象 2 配置系统信息 2.1 配置系统信息,做安装Greenplum的准备工作 Greenplum 数据库版本5.11.3 2.1.1 Greenp ...
- [原创]Greenplum数据库集群实践
GreenPlum实践 ============================================== 目录: 一.安装环境准备 二.GP数据库安装 三.集群添加standby节点 四. ...
- GreenPlum 数据库创建用户、文件空间、表空间、数据库
前几篇文章介绍了GreenPlum数据库的安装.启动.关闭.状态检查.登录等操作,数据库已经创建好了,接下来介绍如何使用数据库.按照习惯,需要先创建测试用户.表空间.数据库.先创建测试用户dbdrea ...
- Oracle数据库安装图文操作步骤
一.Oracle 下载 注意Oracle分成两个文件,下载完后,将两个文件解压到同一目录下即可. 路径名称中,最好不要出现中文,也不要出现空格等不规则字符. 官方下地址: http://www.o ...
随机推荐
- 微信小程序——template的循环嵌套
上一篇我们有写到 template的使用方法 .在实际运用中,需要做到template里面再嵌套一层循环.我们先看一下数据结构: 模板是用于循环list,现在的需求是在模板里面嵌套一个orderIte ...
- hash模块 hashlib不可逆加密 和 base64算法加密解密
hashlib模块 用于加密相关的操作,代替md5模块和sha模块,主要提供SHA1,SHA224,SSHA256,SHA384,SHA512,MD5算法 直接看代码案例: ---------md5- ...
- python一天一题(2)
python查询mysql数据库 import pymysql host = '192.168.74.5' user = 'root' passwd ='root' port = 3310 db = ...
- Mybatis set标签
set - 更新语句 当 update 语句中没有使用 if 标签时,如果有一个参数为 null,都会导致错误. 当在 update 语句中使用if标签时,如果前面的if没有执行,则或导致逗号多余错误 ...
- Spring JDBC查询数据
以下示例将展示如何使用Spring jdbc进行查询数据记录,将从student表中查询记录. 语法: String selectQuery = "select * from student ...
- Android开源库项目集锦
一.兼容类库 ActionBarSherlock : Action Bar是Android 3.0后才開始支持的,ActionBarSherlock是让Action Bar功能支持2.X后的全部平台. ...
- C# 判断字符串为空有哪几种方法
Length法:);Empty法:bool isEmpty = (str == String.Empty);General法:bool isEmpty = (str == ""); ...
- php模拟post提交请求与调用接口
/** * 模拟post进行url请求 * @param string $url * @param string $param */ function request_post($url = '', ...
- 使用redis镜像
运行容器 runoob@runoob:~/redis$ docker run -p : -v $PWD/data:/data -d redis:3.2 redis-server --appendonl ...
- 树莓派挂载ntfs优盘
步骤一:解压安装NTFS-3G,使用如下命令. sudo apt-get install ntfs-3g 步骤二:配置挂载NTFS格式的移动硬盘 1. 首先得到NTFS分区的信息 sudo f ...