hci_ceph安装过程
auto lo
iface lo inet loopback
auto enp50s0f0
iface enp50s0f0 inet static
address 192.168.1.6
netmask 255.255.255.0
iface enp46s0f1 inet manual
iface enp0s20f0u1u6 inet manual
iface enp50s0f1 inet manual
iface enp50s0f2 inet manual
iface enp50s0f3 inet manual
iface enp28s0f0 inet manual
iface enp28s0f1 inet manual
iface enp46s0f0 inet manual
auto bond0
iface bond0 inet manual
bond-slaves enp28s0f0 enp46s0f0
bond-miimon 100
bond-mode balance-rr
auto bond0.7
iface bond0.7 inet manual
auto bond0.8
iface bond0.8 inet manual
auto bond1
iface bond1 inet static
address 192.168.3.6
netmask 255.255.255.0
bond-slaves enp28s0f1 enp46s0f1
bond-miimon 100
bond-mode balance-rr
auto vmbr8
iface vmbr8 inet manual
bridge-ports bond0.8
bridge-stp off
bridge-fd 0
auto vmbr7
iface vmbr7 inet static
address 192.168.7.206
netmask 255.255.255.0
gateway 192.168.7.254
bridge-ports bond0.7
bridge-stp off
bridge-fd 0
----------------------------------------------
rm -rf /etc/apt/sources.list.d/pve-enterprise.list
添加社区源
wget -q -O- 'http://download.proxmox.com/debian/pve/dists/stretch/proxmox-ve-release-5.x.gpg' | apt-key add -
echo "deb http://download.proxmox.com/debian/pve stretch pve-no-subscription" > /etc/apt/sources.list.d/pve-no-subscription.list
debian源改为阿里源
> /etc/apt/sources.list
deb http://mirrors.aliyun.com/debian stretch main contrib non-free
deb-src http://mirrors.aliyun.com/debian stretch main contrib non-free
deb http://mirrors.aliyun.com/debian stretch-updates main contrib non-free
deb-src http://mirrors.aliyun.com/debian stretch-updates main contrib non-free
deb http://mirrors.aliyun.com/debian-security stretch/updates main contrib non-free
deb-src http://mirrors.aliyun.com/debian-security stretch/updates main contrib non-free
apt clean all 没有用
apt update && apt dist-upgrade -y
这一步较慢，主要是pve-kernel，用了1个半小时，平均20kB/s，下午15：00-17：00
还有就是ceph-common，ceph-mon,ceph-osd也较慢，平均20kB/s
ceph版本是12.2.12
pve版本是5.4-4
慢的原因主要是这个网站的问题http://download.proxmox.com/debian/ceph-luminous stretch/main
Partition table scan:
MBR: protective
BSD: not present
APM: not present
GPT: present
root@pve04:~# gdisk /dev/sdk
GPT fdisk (gdisk) version 1.0. Partition table scan:
MBR: protective
BSD: not present
APM: not present
GPT: present Found valid GPT with protective MBR; using GPT. Command (? for help): p
Disk /dev/sdk: sectors, 119.2 GiB
Logical sector size: bytes
Disk identifier (GUID): ADDBB660-E1C5--A896-E55C3556BF6D
Partition table holds up to entries
First usable sector is , last usable sector is
Partitions will be aligned on -sector boundaries
Total free space is sectors ( bytes) Number Start (sector) End (sector) Size Code Name
1007.0 KiB EF02
512.0 MiB EF00
118.7 GiB 8E00 root@cu-pve05:~# gdisk /dev/sdk
GPT fdisk (gdisk) version 1.0. Partition table scan:
MBR: protective
BSD: not present
APM: not present
GPT: present Found valid GPT with protective MBR; using GPT. Command (? for help): p
Disk /dev/sdk: sectors, 119.2 GiB
Logical sector size: bytes
Disk identifier (GUID): FE3DB5F2--48C3-BF94-E3AC1A59C97A
Partition table holds up to entries
First usable sector is , last usable sector is
Partitions will be aligned on -sector boundaries
Total free space is sectors ( bytes) Number Start (sector) End (sector) Size Code Name
1007.0 KiB EF02
512.0 MiB EF00
118.7 GiB 8E00 Command (? for help): root@pve04:~#
sdk : .2G disk
├─sdk1 : 1007K part
├─sdk2 : 512M part /boot/efi
└─sdk3 : .7G part
├─pve-swap : 8G lvm [SWAP]
├─pve-root : .5G lvm /
├─pve-data_tmeta : 1G lvm
│ └─pve-data : .4G lvm
└─pve-data_tdata : .4G lvm
└─pve-data : .4G lvm root@cu-pve05:~#
sdk : .2G disk
├─sdk1 : 1007K part
├─sdk2 : 512M part /boot/efi
└─sdk3 : .7G part
├─pve-swap : 8G lvm [SWAP]
├─pve-root : .5G lvm /
├─pve-data_tmeta : 1G lvm
│ └─pve-data : .4G lvm
└─pve-data_tdata : .4G lvm
└─pve-data : .4G lvm root@cu-pve06:~#
sdk : .2G disk
├─sdk1 : 1007K part
├─sdk2 : 512M part /boot/efi
└─sdk3 : .7G part
├─pve-swap : 8G lvm [SWAP]
├─pve-root : .5G lvm /
├─pve-data_tmeta : 1G lvm
│ └─pve-data : .4G lvm
└─pve-data_tdata : .4G lvm
└─pve-data : .4G lvm
清除磁盘分区，以便在web界面上能看到osd，因为之前做过，所以再次做的时候会有这个问题
ceph-disk list
ceph-disk zap /dev/sd[abcdefghij]
root@cu-pve04:~# ceph-disk list
/dev/dm- swap, swap
/dev/dm- other, xfs, mounted on /
/dev/dm- other, unknown
/dev/dm- other, unknown
/dev/dm- other, unknown
/dev/loop0 other, unknown
/dev/loop1 other, unknown
/dev/loop2 other, unknown
/dev/loop3 other, unknown
/dev/loop4 other, unknown
/dev/loop5 other, unknown
/dev/loop6 other, unknown
/dev/loop7 other, unknown
/dev/sda :
/dev/sda1 ceph block.db, for /dev/sdb1
/dev/sda2 ceph block.db, for /dev/sdc1
/dev/sda3 ceph block.db, for /dev/sde1
/dev/sda4 ceph block.db, for /dev/sdf1
/dev/sdb :
/dev/sdb1 ceph data, prepared, unknown cluster 439800b8-b1cd-43bd-b365-8f7b33ba5994, osd., block /dev/sdb2, block.db /dev/sda1
/dev/sdb2 ceph block, for /dev/sdb1
/dev/sdc :
/dev/sdc1 ceph data, prepared, unknown cluster 439800b8-b1cd-43bd-b365-8f7b33ba5994, osd., block /dev/sdc2, block.db /dev/sda2
/dev/sdc2 ceph block, for /dev/sdc1
/dev/sdd :
/dev/sdd1 ceph block.db, for /dev/sdg1
/dev/sdd2 ceph block.db, for /dev/sdh1
/dev/sdd3 ceph block.db, for /dev/sdi1
/dev/sdd4 ceph block.db, for /dev/sdj1
/dev/sde :
/dev/sde1 ceph data, prepared, unknown cluster 439800b8-b1cd-43bd-b365-8f7b33ba5994, osd., block /dev/sde2, block.db /dev/sda3
/dev/sde2 ceph block, for /dev/sde1
/dev/sdf :
/dev/sdf1 ceph data, prepared, unknown cluster 439800b8-b1cd-43bd-b365-8f7b33ba5994, osd., block /dev/sdf2, block.db /dev/sda4
/dev/sdf2 ceph block, for /dev/sdf1
/dev/sdg :
/dev/sdg1 ceph data, prepared, unknown cluster 439800b8-b1cd-43bd-b365-8f7b33ba5994, osd., block /dev/sdg2, block.db /dev/sdd1
/dev/sdg2 ceph block, for /dev/sdg1
/dev/sdh :
/dev/sdh1 ceph data, prepared, unknown cluster 439800b8-b1cd-43bd-b365-8f7b33ba5994, osd., block /dev/sdh2, block.db /dev/sdd2
/dev/sdh2 ceph block, for /dev/sdh1
/dev/sdi :
/dev/sdi1 ceph data, prepared, unknown cluster 439800b8-b1cd-43bd-b365-8f7b33ba5994, osd., block /dev/sdi2, block.db /dev/sdd3
/dev/sdi2 ceph block, for /dev/sdi1
/dev/sdj :
/dev/sdj1 ceph data, prepared, unknown cluster 439800b8-b1cd-43bd-b365-8f7b33ba5994, osd., block /dev/sdj2, block.db /dev/sdd4
/dev/sdj2 ceph block, for /dev/sdj1
/dev/sdk :
/dev/sdk1 other, --6e6f-744e-
/dev/sdk2 other, vfat, mounted on /boot/efi
/dev/sdk3 other, LVM2_member
root@cu-pve04:~#
-------------------------------------------------------------------------- 清除原有分区表
root@cu-pve05:~# ceph-disk zap /dev/sd[abcdefghij]
root@cu-pve04:~# ceph-disk zap /dev/sdb
+ records in
+ records out
bytes ( MB, MiB) copied, 0.989543 s, MB/s
/dev/sdb1: bytes were erased at offset 0x00000000 (xfs):
+ records in
+ records out
bytes ( MB, MiB) copied, 0.475141 s, MB/s
Caution: invalid backup GPT header, but valid main header; regenerating
backup header from main header. Warning! Main and backup partition tables differ! Use the 'c' and 'e' options
on the recovery & transformation menu to examine the two tables. Warning! One or more CRCs don't match. You should repair the disk! ****************************************************************************
Caution: Found protective or hybrid MBR and corrupt GPT. Using GPT, but disk
verification and recovery are STRONGLY recommended.
****************************************************************************
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
Creating new GPT entries.
The operation has completed successfully.
root@cu-pve04:~# -------------------------------------------------------------------------- web界面上创建osd的日志
create OSD on /dev/sdb (bluestore)
using device '/dev/sda' for block.db
wipe disk/partition: /dev/sdb
+ records in
+ records out
bytes ( MB, MiB) copied, 0.921603 s, MB/s
Creating new GPT entries.
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
Creating new GPT entries.
The operation has completed successfully.
Setting name!
partNum is
REALLY setting name!
The operation has completed successfully.
prepare_device: OSD will not be hot-swappable if block.db is not the same device as the osd data
Setting name!
partNum is
REALLY setting name!
The operation has completed successfully.
The operation has completed successfully.
Setting name!
partNum is
REALLY setting name!
The operation has completed successfully.
The operation has completed successfully.
meta-data=/dev/sdb1 isize= agcount=, agsize= blks
= sectsz= attr=, projid32bit=
= crc= finobt=, sparse=, rmapbt=, reflink=
data = bsize= blocks=, imaxpct=
= sunit= swidth= blks
naming =version bsize= ascii-ci= ftype=
log =internal log bsize= blocks=, version=
= sectsz= sunit= blks, lazy-count=
realtime =none extsz= blocks=, rtextents=
Warning: The kernel is still using the old partition table.
The new table will be used at the next reboot or after you
run partprobe() or kpartx()
The operation has completed successfully.
TASK OK 创建8个osd,一个ssd缓存盘对应4个hdd数据盘。
-------------------------------------------------------------------------- root@cu-pve04:~# ceph-disk list
/dev/dm- swap, swap
/dev/dm- other, xfs, mounted on /
/dev/dm- other, unknown
/dev/dm- other, unknown
/dev/dm- other, unknown
/dev/loop0 other, unknown
/dev/loop1 other, unknown
/dev/loop2 other, unknown
/dev/loop3 other, unknown
/dev/loop4 other, unknown
/dev/loop5 other, unknown
/dev/loop6 other, unknown
/dev/loop7 other, unknown
/dev/sda :
/dev/sda1 ceph block.db, for /dev/sdb1
/dev/sda2 ceph block.db, for /dev/sdc1
/dev/sda3 ceph block.db, for /dev/sde1
/dev/sda4 ceph block.db, for /dev/sdf1
/dev/sdb :
/dev/sdb1 ceph data, active, cluster ceph, osd., block /dev/sdb2, block.db /dev/sda1
/dev/sdb2 ceph block, for /dev/sdb1
/dev/sdc :
/dev/sdc1 ceph data, active, cluster ceph, osd., block /dev/sdc2, block.db /dev/sda2
/dev/sdc2 ceph block, for /dev/sdc1
/dev/sdd :
/dev/sdd1 ceph block.db, for /dev/sdg1
/dev/sdd2 ceph block.db, for /dev/sdh1
/dev/sdd3 ceph block.db, for /dev/sdi1
/dev/sdd4 ceph block.db, for /dev/sdj1
/dev/sde :
/dev/sde1 ceph data, active, cluster ceph, osd., block /dev/sde2, block.db /dev/sda3
/dev/sde2 ceph block, for /dev/sde1
/dev/sdf :
/dev/sdf1 ceph data, active, cluster ceph, osd., block /dev/sdf2, block.db /dev/sda4
/dev/sdf2 ceph block, for /dev/sdf1
/dev/sdg :
/dev/sdg1 ceph data, active, cluster ceph, osd., block /dev/sdg2, block.db /dev/sdd1
/dev/sdg2 ceph block, for /dev/sdg1
/dev/sdh :
/dev/sdh1 ceph data, active, cluster ceph, osd., block /dev/sdh2, block.db /dev/sdd2
/dev/sdh2 ceph block, for /dev/sdh1
/dev/sdi :
/dev/sdi1 ceph data, active, cluster ceph, osd., block /dev/sdi2, block.db /dev/sdd3
/dev/sdi2 ceph block, for /dev/sdi1
/dev/sdj :
/dev/sdj1 ceph data, active, cluster ceph, osd., block /dev/sdj2, block.db /dev/sdd4
/dev/sdj2 ceph block, for /dev/sdj1
/dev/sdk :
/dev/sdk1 other, --6e6f-744e-
/dev/sdk2 other, vfat, mounted on /boot/efi
/dev/sdk3 other, LVM2_member
root@cu-pve04:~#
hci_ceph安装过程的更多相关文章
- webstorm下载&&安装过程&&打开项目
一.webstorm下载 WebStorm 是jetbrains公司旗下一款JavaScript 开发工具.被广大中国JS开发者誉为"Web前端开发神器"."最强大的HT ...
- vagrant 1.8.6 安装过程及总结遇到的坑
下面先总结遇到的问题,这些问题如果你也遇到,可能需要搜索很多次才能找到原因. 如果想看安装过程,可以先直接跳到后面第二部分部分. 1 问题汇总: 1.1 vagrant版本过高问题. vagrant ...
- 安装过程错误[INS-30131]
问题:Oracle Database 安装过程错误[INS-30131] 原因:安装用户没有对临时文件夹的读写权限 解决方案: 1.以管理员身份运行cmd.exe 2.输入命令(需启动Se ...
- TortoiseGIT的安装过程详解
TortoiseGIT简介 TortoiseGIT 是Git版本控制系统的一个免费开源客户端,它是git版本控制的 Windows 扩展.可以使你避免使用枯燥而且不方便的命令行.它完全嵌入 Windo ...
- RabbitMQ 集群安装过程详解
一.安装Erlang 1.rabbitMQ是基于erlang的,所以首先必须配置erlang环境. 从erlang官网下载 otp 18.3.下载链接:http://erlang.org/downlo ...
- JAVA安装过程中出现的“javac不是内部或外部指令”的解决方法
近来重新安装了JAVA,安装过程中出现问题,网上找到解决办法,汇总发布. 解决流程: 1.确定自己的环境变量设置没问题,没有出现遗漏 : . 等情况 (具体环境变量设置百度) 2.环境变量设置后 ,d ...
- LNMP安装过程
LNMP一键安装包是什么? LNMP一键安装包是一个用Linux Shell编写的可以为CentOS/RadHat/Fedora.Debian/Ubuntu/Raspbian/Deepin VPS或独 ...
- hbase 1.1.7在centor6.5安装过程
1.自己安装的最新版一直没成功,换成了1.1.7稳定版的.中间遇到的问题记录下 1) jdk 用的1.7版本的,安装过程省略. 2)下载hbase zip包:https://mirrors.tuna ...
- 2016最新cocoapods安装流程，安装过程中遇到的问题及解决方法
现在的cocoapods与之前比较.有很多不一样的地方.自己试了一试,终于搞定.现在大概纪录一下. 1.首先查看ruby是否是最新版的. ruby是通过rvm安装的所以需要先安装rvm后查看ruby是 ...
随机推荐
- Scribd每月共有超过两亿个访客、累积数亿篇以上的文件档案,Alexa全球排名200以内
目前已登上世界300大网站,每月共有超过两亿个访客.累积数亿篇以上的文件档案.透过Flash介面的阅读器-iPaper,使用者可以在网站内浏览各种文件,由于该网站是一个文件分享平台,所有的文件都是由使 ...
- 在RedHat中安装新字体
安装 下载这个字体. http://pan.baidu.com/s/1c23znaS 密码:tldo 在/usr/share/fonts/truetype/, 下建立一个新的目录 YaHei Cons ...
- JS - 模块
# CommonJS - [CommonJS - Wikipedia](https://en.wikipedia.org/wiki/CommonJS) ## 介绍 主要在浏览器之外地方(例如服务器和桌 ...
- 用 Flask 来写个轻博客 (20) — 实现注册表单与应用 reCAPTCHA 来实现验证码
Blog 项目源码:https://github.com/JmilkFan/JmilkFan-s-Blog 目录 目录 前文列表 reCAPTCHA 应用 reCAPTCHA 前文列表 用 Flask ...
- linux主机hang住echo 0 > /proc/sys/kernel/hung_task_timeout_secs disables this message
用dmesg显示如下图信息 问题原因: 默认情况下, Linux会最多使用40%的可用内存作为文件系统缓存.当超过这个阈值后,文件系统会把将缓存中的内存全部写入磁盘, 导致后续的IO请求都是同步的. ...
- 提高redis cluster集群的安全性，增加密码验证
节点设置密码 1.修改配置文件 在配置文件里面增加密码选项,一定要加上masterauth,不然Redirected的时候会失败. masterauth redispassword requirepa ...
- C++中的类与封装
1,类的组合: 1,类不是孤立存在的,类之间都会有一些关系,组合就是类的基本关系之一: 2,电脑一般而言是由 CPU.内存.主板.键盘和硬盘等部件组合而成: 3,学习电脑组装需要多少时间?学习电脑组装 ...
- python系列——文件操作
打开和关闭 示例:python系列——文件操作的代码 打开模式 读取 写入
- Java内存模型之happens-before原则
我们无法就所有场景来规定某个线程修改的变量何时对其他线程可见,但是我们可以指定某些规则,这规则就是happens-before,从JDK 5 开始,JMM就使用happens-before的概念来阐述 ...
- 配置静态IP时候route没有设置的GATEWAY问题
今天在想把虚拟机里RHEL6.5设置成静态IP来着 在 /etc/sysconfig/betwork-scripts/ifcfg-eth0 文件中将"GATEWAY"拼写成了&qu ...