第一章    文档概述

本文描述适用于Greenplum4.0以上版本的安装操作。所涉及到的操作系统相关参数调整,主要针对Redhat Linux操作系统。

第二章    安装介质

  操作系统:CentOS release 6.5 (Final)。

  Greenplum安装版本:greenplum-db-4.3.8.1-build-2-RHEL5-x86_64.zip

第三章    安装前准备

3.1、网络规划

建议在Greenplum数据库系统安装之前,把网络配置规划好

3.2、存储空间规划

首先,需要评估目标数据库数据所需要的空间容量。建议了解客户搭建Greenplum数据库的具体应用。

举例:估计数据库所需空间为U,数据库需要启用Mirror,磁盘阵列总可用空间为D(Raid之后)。空间规划服务和如下公式:

2 * U + U / 3 = D * 70%

磁盘空间D平均分配到各个Segment服务器上。

Master需要相应的空间。使用服务器内置硬盘的计算方式类似。

3.3、数据库实例规划

规划每个Segment服务器上建立的数据库实例的数量(instance数量),通常建议每2个CPU内核(core)对应一个数据库实例

第四章    操作系统设置

4.1 、设置主机名

  修改各台主机的主机名称。一般建议的命名规则如下:

Master:mdw

Standby Master:smdw

Segment Host:sdw1、sdw2……sdwn

  修改操作:

  1. hostname mdw
  2. 、修改 /etc/sysconfig/network 配置文件中的hostname

4.2 、设置hosts解析(所有节点,Master和Segments)

通常Master和Standby Master主机都配置外部IP和内部IP。Segment主机可只配置内部IP。所有主机的hosts文件内容必须保持一致

  1. 127.0.0.1 mdw localhost localhost.localdomain localhost4 localhost4.localdomain4
  2. 192.168.1.201 mdw
  3. 192.168.1.202 sdw1
  4. 192.168.1.203 sdw2

4.3、安装依赖软件(所有节点,Master和Segments)

  1. yum -y install ed rsync coreutils glib2 lrzsz sysstat e4fsprogs xfsprogs ntp readline-devel zlib zlib-devel openssl openssl-devel pam-devel libxml2-devel libxslt-devel python-devel tcl-devel gcc make smartmontools flex bison OpenIPMI-tools openldap openldap-devel logrotate python-py gcc-c++ apr-devel libcurl-devel bzip2-devel libyaml-devel openssh-clients

  【涉及机器】:所有服务器关闭防火墙

  1. service iptables stop
  2. chkconfig iptables off
  3. service ip6tables stop
  4. chkconfig ip6tables off

4.4、配置NTP时间同步(所有节点)

使用root用户进行操作,涉及所有服务器。

Greenplum推荐使用NTP(Network Time Protocol)同步各台主机的时钟。建议设置一台独立的时钟服务器。例如时钟服务器IP为10.6.220.20

4.4.1、Master服务器配置与时钟服务器同步。

  修改配置文件/etc/ntp.conf后,启动ntpd服务。举例:配置文件增加:

  1. server 10.6.220.20

  启动NTP服务:

  1. service ntpd start;chkconfig ntpd on

  #如果没有独立的时钟服务器,则应该以Master服务器做内部的时钟服务器,Master就可以不用修改ntp.conf配置文件,直接启动ntpd服务即可

4.4.2、所有Segment服务器优先与Master服务器同步,其次与Standby Master服务器同步。

  修改配置文件/etc/ntp.conf后,重启ntpd服务。配置文件增加:

  1. server mdw prefer
  2. server smdw

  启动服务:

  1. service ntpd start;chkconfig ntpd on

4.4.3、Standby Master服务器优先与Master服务器,其次与始终服务器同步。

  修改配置文件/etc/ntp.conf后,重启ntpd服务。配置文件增加:

  1. server mdw prefer
  2. server 10.6.220.20

  启动服务:

  1. service ntpd start;chkconfig ntpd on

  #如果没有独立的时钟服务器,第二行不用配置。

4.5 修改系统参数(Redhat)

  【涉及机器】:所有服务器;使用root用户进行修改,重启后生效。

4.5.1、修改系统参数/etc/sysctl.conf

  1. kernel.shmmax =
  2. kernel.shmmni =
  3. kernel.shmall =
  4. kernel.sem =
  5. kernel.sysrq =
  6. kernel.core_uses_pid =
  7. kernel.msgmnb =
  8. kernel.msgmax =
  9. net.ipv4.tcp_syncookies =
  10. net.ipv4.ip_forward =
  11. net.ipv4.conf.default.accept_source_route =
  12. net.ipv4.tcp_tw_recycle =
  13. net.ipv4.tcp_max_syn_backlog =
  14. net.ipv4.conf.all.arp_filter =
  15. net.ipv4.conf.default.arp_filter =
  16. net.core.netdev_max_backlog =
  17. vm.overcommit_memory =
  18. kernel.msgmni =
  19. net.ipv4.ip_local_port_range =

4.5.2、修改系统参数/etc/security/limits.conf

  Linux PAM中 pam_limits.so 的配置文件

  1. * soft nofile
  2. * hard nofile
  3. * soft nproc
  4. * hard nproc

4.5.3、修改磁盘预读参数(所有节点,Master和Segments)

通过修改预读扇区数,可以有效磁盘的读性能,特别是顺序读,GPDB数据库要求最小磁盘扇区数为16384,建议设置为65535

在参数文件/etc/rc.d/rc.local中增加;

  1. blockdev --setra /dev/sd

4.5.4、修改配置/boot/grub/menu.lst

Linux默认的I/O调度模式是CFQ,通常需要修改I/O调度策略为deadline,可以通过下面的命令查看I/O调度策略。

  1. cat /sys/block/sda/queue/scheduler
  2. #临时修改
  3. echo deadline > /sys/block/sda/queue/scheduler

  如果永久修改I/O调度策略,则需要修改/boot/grub/menu.lst文件,在“kernel*”行后面增加elevator=deadline。

4.5.5、修改配置/etc/sysconfig/i18n

  增加RC_LANG=en_US.UTF-8

4.6、启动IPMI服务

(IPMI(Intelligent Platform Management Interface)即智能平台管理接口是使硬件管理具备“智能化”的新一代通用接口标准。如果没有安装相关服务,建议安装)

  1. service ipmi start;chkconfig ipmi on

第五章    配置用户和数据目录

5.1、创建gpadmin用户(所有节点,Master和Segments)

  1. [root@mdw ~]# groupadd -g gpadmin
  2. [root@mdw ~]# useradd -u -g gpadmin gpadmin
  3. [root@mdw ~]# passwd gpadmin
  4. Changing password for user gpadmin.
  5. New password:
  6. BAD PASSWORD: is too simple
  7. Retype new password:
  8. passwd: all authentication tokens updated successfully.

5.2、创建软件安装目录(所有节点,Master和Segments)

  1. [root@mdw ~]# mkdir -p /gpdb/app
  2. [root@mdw ~]# chown -R gpadmin:gpadmin /gpdb/

  /gpdb目录为GPDB的BASE目录,/gpdb/app为GPDB的HOME目录。

第六章    安装Greenplum

6.1、上传并解压GPDB安装文件(仅Master节点)

  1. [gpadmin@mdw gpdb]$ unzip greenplum-db-4.3.8.1-build--RHEL5-x86_64.zip
  2. Archive: greenplum-db-4.3.8.1-build--RHEL5-x86_64.zip
  3. inflating: README_INSTALL
  4. inflating: greenplum-db-4.3.8.1-build--RHEL5-x86_64.bin
  5. [gpadmin@mdw gpdb]$ ll
  6. total
  7. drwxr-xr-x. gpadmin gpadmin Mar : app
  8. -rwxr-xr-x. gpadmin gpadmin Apr greenplum-db-4.3.8.1-build--RHEL5-x86_64.bin
  9. -rw-r--r--. gpadmin gpadmin Mar : greenplum-db-4.3.8.1-build--RHEL5-x86_64.zip
  10. -rw-r--r--. gpadmin gpadmin Apr README_INSTALL

6.2、运行安装文件

  1. gpadmin@mdw gpdb]$ ./greenplum-db-4.3.8.1-build--RHEL5-x86_64.bin
  2.  
  3. 下面是许可信息后面的内容
  4. ********************************************************************************
  5. You must read and accept the Pivotal Database license agreement
  6. before installing
  7. ********************************************************************************
  8.  
  9. *** IMPORTANT INFORMATION - PLEASE READ CAREFULLY ***
  10.  
  11. PIVOTAL GREENPLUM DATABASE END USER LICENSE AGREEMENT
  12.  
  13. IMPORTANT - READ CAREFULLY: This Software contains computer programs and
  14. other proprietary material and information, the use of which is subject to
  15. and expressly conditioned upon acceptance of this End User License
  16. Agreement ("EULA").
  17.  
  18. This EULA is a legally binding document between you (meaning the person or
  19. the entity that obtained the Software under the terms and conditions of
  20. this EULA, is agreeing to be bound by the terms and conditions of this
  21. EULA, and is referred to below as "You" or "Customer") and Pivotal (meaning
  22. (i) Pivotal Software, Inc., if Customer is located in the United States;
  23. and (ii) the local Pivotal sales subsidiary, if Customer is located in a
  24. country outside the United States in which Pivotal has a local sales
  25. subsidiary; and (iii) GoPivotal International Limited, if Customer is
  26. located in a country outside the United States in which Pivotal does not
  27. have a local sales subsidiary (in each case, referred to herein as
  28. "Pivotal"). Unless Customer has entered into a written and separately
  29. signed agreement with Pivotal that is currently in effect with respect to
  30. the license of the Software and provision of Support Services and
  31. Subscription Services, this EULA governs Customer's use of the Software and
  32. the provision of Support Services and Subscription Services. Capitalized
  33. terms have the meaning stated in the EULA.
  34. ............
  35. 必须输入YES才可继续安装。
  36. ********************************************************************************
  37. Do you accept the Pivotal Database license agreement? [yes|no]
  38. ********************************************************************************
  39.  
  40. yes
  41.  
  42. 默认GPDB的安装路径为/usr/local/greenplum-db-**,确认需要输入YES,如果需要安装到其他路径,直接输入要按照的路径即可
  43. ********************************************************************************
  44. Provide the installation path for Greenplum Database or press ENTER to
  45. accept the default installation path: /usr/local/greenplum-db-4.3.8.1
  46. ********************************************************************************
  47.  
  48. /gpdb/app
  49.  
  50. ********************************************************************************
  51. Install Greenplum Database into </gpdb/app>? [yes|no]
  52. ********************************************************************************
  53.  
  54. yes
  55.  
  56. Extracting product to /gpdb/app

  安装完成;安装完成会在/gpdb/app目录下生成以下文件。

  1. [gpadmin@mdw gpdb]$ cd app
  2. [gpadmin@mdw app]$ ll
  3. total
  4. drwxr-xr-x. gpadmin gpadmin Apr bin
  5. drwxr-xr-x. gpadmin gpadmin Apr demo
  6. drwxr-xr-x. gpadmin gpadmin Apr docs
  7. drwxr-xr-x. gpadmin gpadmin Apr etc
  8. drwxr-xr-x. gpadmin gpadmin Apr ext
  9. -rw-r--r--. gpadmin gpadmin Apr GPDB-LICENSE.txt
  10. -rw-rw-r--. gpadmin gpadmin Mar : greenplum_path.sh
  11. drwxr-xr-x. gpadmin gpadmin Apr include
  12. drwxr-xr-x. gpadmin gpadmin Apr lib
  13. -rw-r--r--. gpadmin gpadmin Apr LICENSE.thirdparty
  14. drwxr-xr-x. gpadmin gpadmin Apr sbin
  15. drwxr-xr-x. gpadmin gpadmin Apr share

6.3、设置GPDB环境变量(仅Master节点)

安装完成后修改gpadmin用户home的~/.bashrc配置文件,增加

  1. source /gpdb/app/greenplum_path.sh

6.4、配置hostname文件(用于建立多机信任)

  编辑节点信息文件(仅Master节点)。为了管理方便,在app目录下创建config文件夹,将节点信息文件存放在该目录下。需要创建两个文件,其中一个文件(hostlist)存放所有节点信息,seg_host文件只存放segment节点信息

  1. [gpadmin@mdw app]$ mkdir config
  2. [gpadmin@mdw app]$ cd config
  3. [gpadmin@mdw config]$ cat hostlist
  4. mdw
  5. sdw1
  6. sdw2
  7. [gpadmin@mdw config]$ cat seg_host
  8. sdw1
  9. sdw2

6.5、打通所有节点直接的互信(仅Master节点)

GreenPlum数据库提供gpssh-exkeys工具来打开所有节点直接的互信关系,非常方便

  1. [gpadmin@mdw config]$ gpssh-exkeys -f hostlist
  2. [STEP of ] create local ID and authorize on local host
  3. ... /home/gpadmin/.ssh/id_rsa file exists ... key generation skipped
  4.  
  5. [STEP of ] keyscan all hosts and update known_hosts file
  6.  
  7. [STEP of ] authorize current user on remote hosts
  8. ... send to mdw
  9. ... send to sdw1
  10. ***
  11. *** Enter password for sdw1:
  12. ... send to sdw2
  13.  
  14. [STEP of ] determine common authentication file content
  15.  
  16. [STEP of ] copy authentication files to all remote hosts
  17. ... finished key exchange with mdw
  18. ... finished key exchange with sdw1
  19. ... finished key exchange with sdw2
  20.  
  21. [INFO] completed successfully

   互信配置完成后,可以通过gpssh工具来验证互信是否成功配置,-e参数后面的是远程登录节点后执行的命令。通过gpssh工具可以在所有节点运行同一命令,非常方便(后续会用到)。

  1. [gpadmin@mdw config]$ gpssh -f /gpdb/app/config/hostlist -e 'pwd'
  2. [ mdw] pwd
  3. [ mdw] /home/gpadmin
  4. [sdw2] pwd
  5. [sdw2] /home/gpadmin
  6. [sdw1] pwd
  7. [sdw1] /home/gpadmin

6.6、Segment节点安装GreenPlum软件(仅Master节点)

通过gpseginstall命令安装segment软件,使用-u参数指定安装用户,-p参数指定安装用户的密码,这样将不再需要交互式输入密码。

  1. [gpadmin@mdw config]$ gpseginstall -f hostlist -u gpadmin -p li0924
  2. :::: gpseginstall:mdw:gpadmin-[INFO]:-Installation Info:
  3. link_name greenplum-db
  4. binary_path /gpdb/app
  5. binary_dir_location /gpdb
  6. binary_dir_name app
  7. :::: gpseginstall:mdw:gpadmin-[INFO]:-check cluster password access
  8. :::: gpseginstall:mdw:gpadmin-[INFO]:-de-duplicate hostnames
  9. :::: gpseginstall:mdw:gpadmin-[INFO]:-master hostname: mdw
  10. :::: gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar; rm -f /gpdb/app.tar.gz
  11. :::: gpseginstall:mdw:gpadmin-[INFO]:-cd /gpdb; tar cf app.tar app
  12. :::: gpseginstall:mdw:gpadmin-[INFO]:-gzip /gpdb/app.tar
  13. :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: mkdir -p /gpdb
  14. :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -rf /gpdb/app
  15. :::: gpseginstall:mdw:gpadmin-[INFO]:-scp software to remote location
  16. :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: gzip -f -d /gpdb/app.tar.gz
  17. :::: gpseginstall:mdw:gpadmin-[INFO]:-md5 check on remote location
  18. :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; tar xf app.tar
  19. :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -f /gpdb/app.tar
  20. :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; rm -f greenplum-db; ln -fs app greenplum-db
  21. :::: gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar.gz
  22. :::: gpseginstall:mdw:gpadmin-[INFO]:-version string on master: gpssh version 4.3.8.1 build
  23. :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/greenplum-db/./greenplum_path.sh; /gpdb/greenplum-db/./bin/gpssh --version
  24. :::: gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/app/greenplum_path.sh; /gpdb/app/bin/gpssh --version
  25. :::: gpseginstall:mdw:gpadmin-[INFO]:-SUCCESS -- Requested commands completed

  Segment节点会根据Master节点的安装路径安装GreenPlum软件,目录结构和Master一模一样。

6.7、 Segment节点配置环境变量(所有Segment节点)

修改gpadmin用户home的~/.bashrc配置文件,增加

  1. source /gpdb/app/greenplum_path.sh

第七章    数据库的初始化

7.1、创建数据文件存放目录(所有节点)

  1. [root@mdw ~]# mkdir -p /data/gpdata/master
  2. [root@mdw ~]# chown -R gpadmin:gpadmin /data
  3. [root@sdw1 ~]# mkdir -p /data/gpdata/primary
  4. [root@sdw1 ~]# mkdir -p /data/gpdata/mirror
  5. [root@sdw1 ~]# chown -R gpadmin:gpadmin /data

  本案例Master节点的数据文件存放在/data/gpdata/master目录,Segment节点的主数据文件存放在/data/gpdata/primary目录;镜像数据文件放在/data/gpdata/mirror目录

7.2、配置时间同步(所有节点)

本案例Master节点的服务器配置为NTP的服务端,Segment节点为NTP的客户端。Master节点使用root用户通过gpssh工具批量调用date命令对比各服务器的时间是否一致。

  1. [gpadmin@mdw ~]$ gpssh -f /gpdb/app/config/hostlist
  2. Note: command history unsupported on this machine ...
  3. => date
  4. [sdw1] Wed Mar :: CST
  5. [ mdw] Wed Mar :: CST
  6. [sdw2] Wed Mar :: CST

7.3、系统检查(仅Master节点)

在初始化数据库之前,需要进行先决条件检查,主要检查磁盘I/O能力、网络带宽、内核参数、limit等条件是否满足GreenPlum数据库的要求。

参数配置检查

  1. [gpadmin@mdw ~]$ gpcheck -f /gpdb/app/config/hostlist -m mdw
  2. :::: gpcheck:mdw:gpadmin-[INFO]:-dedupe hostnames
  3. :::: gpcheck:mdw:gpadmin-[INFO]:-Detected platform: Generic Linux Cluster
  4. :::: gpcheck:mdw:gpadmin-[INFO]:-generate data on servers
  5. :::: gpcheck:mdw:gpadmin-[INFO]:-copy data files from servers
  6. :::: gpcheck:mdw:gpadmin-[INFO]:-delete remote tmp files
  7. :::: gpcheck:mdw:gpadmin-[INFO]:-Using gpcheck config file: /gpdb/greenplum-db/./etc/gpcheck.cnf
  8. :::: gpcheck:mdw:gpadmin-[ERROR]:-GPCHECK_ERROR host(None): utility will not check all settings when run as non-root user
  9. :::: gpcheck:mdw:gpadmin-[INFO]:-gpcheck completing...

参数性能检查

  1. 参数配置检查
  2. gpcheck -f /gpdb/app/config/hostlist -m mdw -s smdw
  3. 核对并修改下你感应系统参数。
  4. 性能检查
  5. 2.1 网络性能检查
  6. gpcheckperf -f /gpdb/app/config/hostlist -r N -d /tmp > checknetwork.out
  7. 2.2 磁盘性能检查
  8. gpcheckperf -f /gpdb/app/config/hostlist -r ds -D -d /data/gpdata/primary -d /data/gpdata/mirror r > checkio.out
  9. 检查磁盘IO的目标目录是数据库的数据文件目录,测试工具会写入系统内存的两倍大小的数据量。

7.4、创建GreenPlum数据库的参数文件(仅Master节点)

在$GPHOME/docs目录下,存在一些参数文件的模版,可以通过这些模版快速配置一些常用的参数文件。比如GreenPlum数据库的参数文件可以参考$GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config文件。

  1. [gpadmin@mdw ~]$ cp $GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config /gpdb/app/config/gpinitsystem_config

  配置参数文件gpinitsystem_config

  1. [gpadmin@mdw config]$ cat gpinitsystem_config
  2. # FILE NAME: gpinitsystem_config
  3.  
  4. # Configuration file needed by the gpinitsystem
  5.  
  6. ################################################
  7. #### REQUIRED PARAMETERS
  8. ################################################
  9.  
  10. #### Name of this Greenplum system enclosed in quotes.
  11. ARRAY_NAME="EMC Greenplum DW"
  12.  
  13. #### Naming convention for utility-generated data directories.
  14. SEG_PREFIX=gpseg
  15.  
  16. #### Base number by which primary segment port numbers
  17. #### are calculated.
  18. PORT_BASE=
  19.  
  20. #### File system location(s) where primary segment data directories
  21. #### will be created. The number of locations in the list dictate
  22. #### the number of primary segments that will get created per
  23. #### physical host (if multiple addresses for a host are listed in
  24. #### the hostfile, the number of segments will be spread evenly across
  25. #### the specified interface addresses).
  26. declare -a DATA_DIRECTORY=(/data/gpdata/primary)
  27.  
  28. #### OS-configured hostname or IP address of the master host.
  29. MASTER_HOSTNAME=mdw
  30.  
  31. #### File system location where the master data directory
  32. #### will be created.
  33. MASTER_DIRECTORY=/data/gpdata/master
  34.  
  35. #### Port number for the master instance.
  36. MASTER_PORT=
  37.  
  38. #### Shell utility used to connect to remote hosts.
  39. TRUSTED_SHELL=ssh
  40.  
  41. #### Maximum log file segments between automatic WAL checkpoints.
  42. CHECK_POINT_SEGMENTS=
  43.  
  44. #### Default server-side character set encoding.
  45. ENCODING=UNICODE
  46.  
  47. ################################################
  48. #### OPTIONAL MIRROR PARAMETERS
  49. ################################################
  50.  
  51. #### Base number by which mirror segment port numbers
  52. #### are calculated.
  53. #MIRROR_PORT_BASE=
  54.  
  55. #### Base number by which primary file replication port
  56. #### numbers are calculated.
  57. #REPLICATION_PORT_BASE=
  58.  
  59. #### Base number by which mirror file replication port
  60. #### numbers are calculated.
  61. #MIRROR_REPLICATION_PORT_BASE=
  62.  
  63. #### File system location(s) where mirror segment data directories
  64. #### will be created. The number of mirror locations must equal the
  65. #### number of primary locations as specified in the
  66. #### DATA_DIRECTORY parameter.
  67. #declare -a MIRROR_DATA_DIRECTORY=(/data/gpdata/mirror)
  68.  
  69. ################################################
  70. #### OTHER OPTIONAL PARAMETERS
  71. ################################################
  72.  
  73. #### Create a database of this name after initialization.
  74. #DATABASE_NAME=name_of_database
  75.  
  76. #### Specify the location of the host address file here instead of
  77. #### with the the -h option of gpinitsystem.
  78. #MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem

7.5、GreenPlum数据库初始化(仅Master节点)

接下来就可以使用gpinitsystem工具初始化数据库了,一些参数文件中没有设置的重要参数,在初始化数据库时会被使用默认值,可以在初始化之后根据需求及主机的配置进行设置。GreenPlum数据库的参数也分为静态参数和动态参数,静态参数需重启数据库才能生效,动态参数不需要重启数据库即可生效。

若需要standby master;可以-s 主机名即可;也可以后续使用gpinitsystem添加。这个后续文章讲解

  1. [gpadmin@mdw config]$ gpinitsystem -c gpinitsystem_config -h seg_host
  2. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, please wait...
  3. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Reading Greenplum configuration file gpinitsystem_config
  4. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Locale has not been set in gpinitsystem_config, will set to default value
  5. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Locale set to en_US.utf8
  6. :::: gpinitsystem:mdw:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates
  7. :::: gpinitsystem:mdw:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value
  8. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, Completed
  9. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, please wait...
  10. ..
  11. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Configuring build for standard array
  12. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, Completed
  13. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Building primary segment instance array, please wait...
  14. ..
  15. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking Master host
  16. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, please wait...
  17. .:::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
  18. :::: gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw1 is assigned as localhost in /etc/hosts
  19. :::: gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures
  20. :::: gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw1 from local host line in /etc/hosts
  21. :::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
  22. .:::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
  23. :::: gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw2 is assigned as localhost in /etc/hosts
  24. :::: gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures
  25. :::: gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw2 from local host line in /etc/hosts
  26. :::: gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
  27.  
  28. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, Completed
  29. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database Creation Parameters
  30. :::: gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------
  31. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master Configuration
  32. :::: gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------
  33. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master instance name = EMC Greenplum DW
  34. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master hostname = mdw
  35. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master port =
  36. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master instance dir = /data/gpdata/master/gpseg-
  37. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master LOCALE = en_US.utf8
  38. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum segment prefix = gpseg
  39. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master Database =
  40. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master connections =
  41. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master buffers = 128000kB
  42. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Segment connections =
  43. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Segment buffers = 128000kB
  44. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Checkpoint segments =
  45. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Encoding = UNICODE
  46. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Postgres param file = Off
  47. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Initdb to be used = /gpdb/greenplum-db/./bin/initdb
  48. :::: gpinitsystem:mdw:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /gpdb/greenplum-db/./lib
  49. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Ulimit check = Passed
  50. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Array host connect type = Single hostname per node
  51. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [] = ::
  52. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [] = 192.168.1.201
  53. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [] = fe80::20c:29ff:fe30:f99e
  54. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Standby Master = Not Configured
  55. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Primary segment # =
  56. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Total Database segments =
  57. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Trusted shell = ssh
  58. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Number segment hosts =
  59. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Mirroring config = OFF
  60. :::: gpinitsystem:mdw:gpadmin-[INFO]:----------------------------------------
  61. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Primary Segment Configuration
  62. :::: gpinitsystem:mdw:gpadmin-[INFO]:----------------------------------------
  63. :::: gpinitsystem:mdw:gpadmin-[INFO]:-sdw1 /data/gpdata/primary/gpseg0
  64. :::: gpinitsystem:mdw:gpadmin-[INFO]:-sdw2 /data/gpdata/primary/gpseg1
  65. Continue with Greenplum creation Yy/Nn>
  66. y
  67. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Building the Master instance database, please wait...
  68. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Starting the Master in admin mode
  69. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Commencing parallel build of primary segment instances
  70. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Spawning parallel processes batch [], please wait...
  71. ..
  72. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Waiting for parallel processes batch [], please wait...
  73. .............................
  74. :::: gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
  75. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Parallel process exit status
  76. :::: gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
  77. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as completed =
  78. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as killed =
  79. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as failed =
  80. :::: gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
  81. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Deleting distributed backout files
  82. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Removing back out file
  83. :::: gpinitsystem:mdw:gpadmin-[INFO]:-No errors generated from parallel processes
  84. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode
  85. :::: gpstop:mdw:gpadmin-[INFO]:-Starting gpstop with args: -a -i -m -d /data/gpdata/master/gpseg-
  86. :::: gpstop:mdw:gpadmin-[INFO]:-Gathering information and validating the environment...
  87. :::: gpstop:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
  88. :::: gpstop:mdw:gpadmin-[INFO]:-Obtaining Segment details from master...
  89. :::: gpstop:mdw:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 4.3.8.1 build 1'
  90. :::: gpstop:mdw:gpadmin-[INFO]:-There are connections to the database
  91. :::: gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate'
  92. :::: gpstop:mdw:gpadmin-[INFO]:-Master host=mdw
  93. :::: gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate
  94. :::: gpstop:mdw:gpadmin-[INFO]:-Master segment instance directory=/data/gpdata/master/gpseg-
  95. :::: gpstop:mdw:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process
  96. :::: gpstop:mdw:gpadmin-[INFO]:-Terminating processes for segment /data/gpdata/master/gpseg-
  97. :::: gpstart:mdw:gpadmin-[INFO]:-Starting gpstart with args: -a -d /data/gpdata/master/gpseg-
  98. :::: gpstart:mdw:gpadmin-[INFO]:-Gathering information and validating the environment...
  99. :::: gpstart:mdw:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 4.3.8.1 build 1'
  100. :::: gpstart:mdw:gpadmin-[INFO]:-Greenplum Catalog Version: ''
  101. :::: gpstart:mdw:gpadmin-[INFO]:-Starting Master instance in admin mode
  102. :::: gpstart:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
  103. :::: gpstart:mdw:gpadmin-[INFO]:-Obtaining Segment details from master...
  104. :::: gpstart:mdw:gpadmin-[INFO]:-Setting new master era
  105. :::: gpstart:mdw:gpadmin-[INFO]:-Master Started...
  106. :::: gpstart:mdw:gpadmin-[INFO]:-Shutting down master
  107. :::: gpstart:mdw:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait...
  108. ....
  109. :::: gpstart:mdw:gpadmin-[INFO]:-Process results...
  110. :::: gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
  111. :::: gpstart:mdw:gpadmin-[INFO]:- Successful segment starts =
  112. :::: gpstart:mdw:gpadmin-[INFO]:- Failed segment starts =
  113. :::: gpstart:mdw:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) =
  114. :::: gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
  115. :::: gpstart:mdw:gpadmin-[INFO]:-
  116. :::: gpstart:mdw:gpadmin-[INFO]:-Successfully started of segment instances
  117. :::: gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
  118. :::: gpstart:mdw:gpadmin-[INFO]:-Starting Master instance mdw directory /data/gpdata/master/gpseg-
  119. :::: gpstart:mdw:gpadmin-[INFO]:-Command pg_ctl reports Master mdw instance active
  120. :::: gpstart:mdw:gpadmin-[INFO]:-No standby master configured. skipping...
  121. :::: gpstart:mdw:gpadmin-[INFO]:-Database successfully started
  122. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode
  123. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Loading gp_toolkit...
  124. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Scanning utility log file for any warning messages
  125. :::: gpinitsystem:mdw:gpadmin-[WARN]:-*******************************************************
  126. :::: gpinitsystem:mdw:gpadmin-[WARN]:-Scan of log file indicates that some warnings or errors
  127. :::: gpinitsystem:mdw:gpadmin-[WARN]:-were generated during the array creation
  128. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Please review contents of log file
  129. :::: gpinitsystem:mdw:gpadmin-[INFO]:-/home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log
  130. :::: gpinitsystem:mdw:gpadmin-[INFO]:-To determine level of criticality
  131. :::: gpinitsystem:mdw:gpadmin-[INFO]:-These messages could be from a previous run of the utility
  132. :::: gpinitsystem:mdw:gpadmin-[INFO]:-that was called today!
  133. :::: gpinitsystem:mdw:gpadmin-[WARN]:-*******************************************************
  134. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database instance successfully created
  135. :::: gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
  136. :::: gpinitsystem:mdw:gpadmin-[INFO]:-To complete the environment configuration, please
  137. :::: gpinitsystem:mdw:gpadmin-[INFO]:-update gpadmin .bashrc file with the following
  138. :::: gpinitsystem:mdw:gpadmin-[INFO]:-. Ensure that the greenplum_path.sh file is sourced
  139. :::: gpinitsystem:mdw:gpadmin-[INFO]:-. Add "export MASTER_DATA_DIRECTORY=/data/gpdata/master/gpseg-1"
  140. :::: gpinitsystem:mdw:gpadmin-[INFO]:- to access the Greenplum scripts for this instance:
  141. :::: gpinitsystem:mdw:gpadmin-[INFO]:- or, use -d /data/gpdata/master/gpseg- option for the Greenplum scripts
  142. :::: gpinitsystem:mdw:gpadmin-[INFO]:- Example gpstate -d /data/gpdata/master/gpseg-
  143. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log
  144. :::: gpinitsystem:mdw:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility
  145. :::: gpinitsystem:mdw:gpadmin-[INFO]:-To initialize a Standby Master Segment for this Greenplum instance
  146. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Review options for gpinitstandby
  147. :::: gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
  148. :::: gpinitsystem:mdw:gpadmin-[INFO]:-The Master /data/gpdata/master/gpseg-/pg_hba.conf post gpinitsystem
  149. :::: gpinitsystem:mdw:gpadmin-[INFO]:-has been configured to allow all hosts within this new
  150. :::: gpinitsystem:mdw:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this
  151. :::: gpinitsystem:mdw:gpadmin-[INFO]:-new array must be explicitly added to this file
  152. :::: gpinitsystem:mdw:gpadmin-[INFO]:-Refer to the Greenplum Admin support guide which is
  153. :::: gpinitsystem:mdw:gpadmin-[INFO]:-located in the /gpdb/greenplum-db/./docs directory
  154. :::: gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------

GreenPlum数据库安装的更多相关文章

  1. Greenplum 数据库安装部署(生产环境)

    Greenplum 数据库安装部署(生产环境) 硬件配置: 16 台 IBM X3650, 节点配置:CPU 2 * 8core,内存 128GB,硬盘 16 * 900GB,万兆网卡. 万兆交换机. ...

  2. MPP - GreenPlum数据库安装以及简单使用

    一.集群介绍 共3台主机,ip 为193.168.0.93   193.168.0.94  193.168.0.95 集群对应master和segment如下,193.168.0.93为master节 ...

  3. 转_Greenplum 数据库安装部署(生产环境)

    Greenplum 数据库安装部署(生产环境) 硬件配置: 16 台 IBM X3650, 节点配置:CPU 2 * 8core,内存 128GB,硬盘 16 * 900GB,万兆网卡. 万兆交换机. ...

  4. Greenplum 数据库架构分析

    Greenplum 数据库是最先进的分布式开源数据库技术,主要用来处理大规模的数据分析任务,包括数据仓库.商务智能(OLAP)和数据挖掘等.自2015年10月正式开源以来,受到国内外业内人士的广泛关注 ...

  5. 开源大数据引擎:Greenplum 数据库架构分析

    Greenplum 数据库是最先进的分布式开源数据库技术,主要用来处理大规模的数据分析任务,包括数据仓库.商务智能(OLAP)和数据挖掘等.自2015年10月正式开源以来,受到国内外业内人士的广泛关注 ...

  6. GreenPlum完全安装_GP5.11.3完整安装

    1 概述 1.1 背景 1.2 目标 1.3 使用对象 2 配置系统信息 2.1 配置系统信息,做安装Greenplum的准备工作 Greenplum 数据库版本5.11.3 2.1.1 Greenp ...

  7. [原创]Greenplum数据库集群实践

    GreenPlum实践 ============================================== 目录: 一.安装环境准备 二.GP数据库安装 三.集群添加standby节点 四. ...

  8. GreenPlum 数据库创建用户、文件空间、表空间、数据库

    前几篇文章介绍了GreenPlum数据库的安装.启动.关闭.状态检查.登录等操作,数据库已经创建好了,接下来介绍如何使用数据库.按照习惯,需要先创建测试用户.表空间.数据库.先创建测试用户dbdrea ...

  9. Oracle数据库安装图文操作步骤

    一.Oracle 下载 注意Oracle分成两个文件,下载完后,将两个文件解压到同一目录下即可. 路径名称中,最好不要出现中文,也不要出现空格等不规则字符.   官方下地址: http://www.o ...

随机推荐

  1. 微信小程序——template的循环嵌套

    上一篇我们有写到 template的使用方法 .在实际运用中,需要做到template里面再嵌套一层循环.我们先看一下数据结构: 模板是用于循环list,现在的需求是在模板里面嵌套一个orderIte ...

  2. hash模块 hashlib不可逆加密 和 base64算法加密解密

    hashlib模块 用于加密相关的操作,代替md5模块和sha模块,主要提供SHA1,SHA224,SSHA256,SHA384,SHA512,MD5算法 直接看代码案例: ---------md5- ...

  3. python一天一题(2)

    python查询mysql数据库 import pymysql host = '192.168.74.5' user = 'root' passwd ='root' port = 3310 db = ...

  4. Mybatis set标签

    set - 更新语句 当 update 语句中没有使用 if 标签时,如果有一个参数为 null,都会导致错误. 当在 update 语句中使用if标签时,如果前面的if没有执行,则或导致逗号多余错误 ...

  5. Spring JDBC查询数据

    以下示例将展示如何使用Spring jdbc进行查询数据记录,将从student表中查询记录. 语法: String selectQuery = "select * from student ...

  6. Android开源库项目集锦

    一.兼容类库 ActionBarSherlock : Action Bar是Android 3.0后才開始支持的,ActionBarSherlock是让Action Bar功能支持2.X后的全部平台. ...

  7. C# 判断字符串为空有哪几种方法

    Length法:);Empty法:bool isEmpty = (str == String.Empty);General法:bool isEmpty = (str == ""); ...

  8. php模拟post提交请求与调用接口

    /** * 模拟post进行url请求 * @param string $url * @param string $param */ function request_post($url = '', ...

  9. 使用redis镜像

    运行容器 runoob@runoob:~/redis$ docker run -p : -v $PWD/data:/data -d redis:3.2 redis-server --appendonl ...

  10. 树莓派挂载ntfs优盘

    步骤一:解压安装NTFS-3G,使用如下命令.    sudo apt-get install ntfs-3g 步骤二:配置挂载NTFS格式的移动硬盘 1. 首先得到NTFS分区的信息  sudo f ...