master节点

节点名称 IP地址
master1 192.168.161.128

由于硬件资源有限,这里仅安装一个master节点,会存在单点问题.在实际生产中,尽量不要这样操作.

1.安装zookeeper

https://www.cnblogs.com/gytangyao/p/10172265.html

2.安装Mesos

1)添加mesos yum源

  1. sudo rpm -Uvh http://repos.mesosphere.io/el/7/noarch/RPMS/mesosphere-el-repo-7-1.noarch.rpm
  1. yum -y install mesos marathon

2)更改mesos的zk配置

  1. vi /etc/mesos/zk

写入zookeeper节点的地址,例如:zk://192.168.1.110:2181,192.168.1.111:2181,192.168.1.112:2181/mesos

  1. zk://192.168.161.128:2181/mesos

按需更改quorum,如果zookeeper以单机模式运行则不用修改

设置 --quorum=2 的意思是：至少要有 2 台 master 节点在线，否则集群无法起来，所以至少要两台 master 一起启动。

  1. vi /etc/mesos-master/quorum

3)配置mesos-master和marathon 的hostname和ip

  1. hostname直接配置的本机ip，是为了防止出现dns无法解析的问题；
  1. echo "192.168.161.128" > /etc/mesos-master/ip
  1. echo "192.168.161.128" > /etc/mesos-master/hostname
  1. mkdir -p /etc/marathon/conf/
  1. echo "192.168.161.128" > /etc/marathon/conf/hostname
  1. echo "192.168.161.128 master1" >> /etc/hosts

4)给marathon填加mesos的地址参数

  1. vim /etc/default/marathon
  2.  
  3. MARATHON_MASTER="zk://192.168.161.128:2181/mesos"
  4. MARATHON_ZK="zk://192.168.161.128:2181/marathon"
  5. MARATHON_MESOS_USER="root"

5)启动服务

  1. systemctl start  zookeeper && systemctl start mesos-master && systemctl start marathon && systemctl disable mesos-slave

6)其他配置

Marathon WebUI默认的端口是8080，修改端口的方法：

  1. vi /etc/default/marathon
  2.  
  3. export HTTP_PORT=8181
  4.  
  5. export MARATHON_HTTP_PORT=8181

6)错误排错

  1. Required option 'master' not found    可使用 journalctl -u marathon 查看日志
  1. # journalctl -u marathon
  2. -- Logs begin at Thu 2018-06-14 15:55:28 CST, end at Thu 2018-06-14 19:52:34 CST. --
  3. Jun 14 15:55:35 dev-master-01 systemd[1]: marathon.service holdoff time over, scheduling restart.
  4. Jun 14 15:55:35 dev-master-01 systemd[1]: Starting Scheduler for Apache Mesos...
  5. Jun 14 15:55:35 dev-master-01 systemd[1]: Started Scheduler for Apache Mesos.
  6. Jun 14 15:55:35 dev-master-01 marathon[7966]: No start hook file found ($HOOK_MARATHON_START). Proceeding with the start script.
  7. Jun 14 15:55:36 dev-master-01 marathon[7966]: [scallop] Error: Required option 'master' not found
  8. Jun 14 15:55:36 dev-master-01 systemd[1]: marathon.service: main process exited, code=exited, status=1/FAILURE
  9. Jun 14 15:55:36 dev-master-01 systemd[1]: Unit marathon.service entered failed state.
  10. Jun 14 15:55:36 dev-master-01 systemd[1]: marathon.service failed.
  11. Jun 14 15:56:36 dev-master-01 systemd[1]: marathon.service holdoff time over, scheduling restart.
  12. Jun 14 15:56:36 dev-master-01 systemd[1]: Starting Scheduler for Apache Mesos...
  13. Jun 14 15:56:36 dev-master-01 systemd[1]: Started Scheduler for Apache Mesos.
  14. Jun 14 15:56:36 dev-master-01 marathon[8046]: No start hook file found ($HOOK_MARATHON_START). Proceeding with the start script.
  15. Jun 14 15:56:37 dev-master-01 marathon[8046]: [scallop] Error: Required option 'master' not found
  16. Jun 14 15:56:37 dev-master-01 systemd[1]: marathon.service: main process exited, code=exited, status=1/FAILURE
  17. Jun 14 15:56:37 dev-master-01 systemd[1]: Unit marathon.service entered failed state.
  18. Jun 14 15:56:37 dev-master-01 systemd[1]: marathon.service failed.

如提示:java.lang.IllegalStateException: Multiple election participants have the same ID: master1:8080. This is not allowed.

则可能是多次执行了设置ip或者hostname,需要检查第三步的配置是否正确

  1. 12月 25 12:28:08 master1 marathon[8724]: java.lang.IllegalStateException: Multiple election participants have the same ID: master1:8080. This is not allowed.
  2. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.core.election.CuratorElectionStream$CuratorEventEmitter.emitLeader(CuratorElectionStream.scala:157)
  3. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.core.election.CuratorElectionStream$CuratorEventEmitter.$anonfun$longPollLeaderChange$1(CuratorElectionStream.scala:117)
  4. 12月 25 12:28:08 master1 marathon[8724]: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  5. 12月 25 12:28:08 master1 marathon[8724]: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  6. 12月 25 12:28:08 master1 marathon[8724]: at java.lang.Thread.run(Thread.java:748)
  7. 12月 25 12:28:08 master1 marathon[8724]: [2018-12-25 12:28:08,788] INFO  Closing leader latch (mesosphere.marathon.core.election.CuratorElectionStream$:pool-1-thread-1)
  8. 12月 25 12:28:08 master1 marathon[8724]: [2018-12-25 12:28:08,812] INFO  Shutting down services (mesosphere.marathon.MarathonApp:shutdownHook3)
  9. 12月 25 12:28:08 master1 marathon[8724]: [2018-12-25 12:28:08,819] INFO  Shutdown triggered (mesosphere.marathon.MarathonSchedulerService:shutdownHook3)
  10. 12月 25 12:28:08 master1 marathon[8724]: [2018-12-25 12:28:08,819] ERROR abdicateLeadership was called (mesosphere.marathon.core.election.ElectionServiceImpl:shutdownHook3)
  11. 12月 25 12:28:08 master1 marathon[8724]: mesosphere.marathon.Exception: abdicateLeadership
  12. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.core.election.ElectionServiceImpl.abdicateLeadership(ElectionService.scala:151)
  13. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.MarathonSchedulerService.triggerShutdown(MarathonSchedulerService.scala:169)
  14. 12月 25 12:28:08 master1 marathon[8724]: at com.google.common.util.concurrent.AbstractExecutionThreadService$1.doStop(AbstractExecutionThreadService.java:95)
  15. 12月 25 12:28:08 master1 marathon[8724]: at com.google.common.util.concurrent.AbstractService.stopAsync(AbstractService.java:242)
  16. 12月 25 12:28:08 master1 marathon[8724]: at com.google.common.util.concurrent.AbstractExecutionThreadService.stopAsync(AbstractExecutionThreadService.java:214)
  17. 12月 25 12:28:08 master1 marathon[8724]: at com.google.common.util.concurrent.ServiceManager.stopAsync(ServiceManager.java:331)
  18. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.MarathonApp.$anonfun$shutdown$1(Main.scala:103)
  19. 12月 25 12:28:08 master1 marathon[8724]: at scala.Option.foreach(Option.scala:257)
  20. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.MarathonApp.shutdown(Main.scala:103)
  21. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.MarathonApp.$anonfun$shutdownAndWait$1(Main.scala:108)
  22. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.MarathonApp.$anonfun$shutdownAndWait$1$adapted(Main.scala:107)
  23. 12月 25 12:28:08 master1 marathon[8724]: at scala.Option.foreach(Option.scala:257)
  24. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.MarathonApp.shutdownAndWait(Main.scala:107)
  25. 12月 25 12:28:08 master1 marathon[8724]: at mesosphere.marathon.MarathonApp.$anonfun$start$1(Main.scala:80)
  26. 12月 25 12:28:08 master1 marathon[8724]: at scala.sys.ShutdownHookThread$$anon$1.run(ShutdownHookThread.scala:34)
  27. 12月 25 12:28:08 master1 marathon[8724]: [2018-12-25 12:28:08,822] INFO  backgroundOperationsLoop exiting (org.apache.curator.framework.imps.CuratorFrameworkImpl:Curator-Framework-0)
  28. 12月 25 12:28:10 master1 systemd[1]: marathon.service: main process exited, code=exited, status=137/n/a
  29. 12月 25 12:28:10 master1 systemd[1]: Unit marathon.service entered failed state.
  30. 12月 25 12:28:10 master1 systemd[1]: marathon.service failed.

Slave节点

节点名称 IP地址
slave1 192.168.161.200
slave2 192.168.161.201
slave3 192.168.161.202

1)添加 mesos的yum源

  1. sudo rpm -Uvh http://repos.mesosphere.io/el/7/noarch/RPMS/mesosphere-el-repo-7-1.noarch.rpm

2)安装mesos

  1. yum -y install mesos

3)配置master信息

master信息需要和前面安装的master节点对应

  1. vim /etc/mesos/zk
  1. zk://192.168.161.128:2181/mesos

4）mesos-slave配置ip&hostname

以下需要按照情况各自配置

slave1:

  1. echo "192.168.161.200" > /etc/mesos-slave/ip
  2. echo "192.168.161.200" > /etc/mesos-slave/hostname
  3.  
  4. #修改hosts
  5. echo "192.168.161.200 slave1" >> /etc/hosts

slave2:

  1. echo "192.168.161.201" > /etc/mesos-slave/ip
  2. echo "192.168.161.201" > /etc/mesos-slave/hostname
  3.  
  4. #修改hosts
  5. echo "192.168.161.201 slave2" >> /etc/hosts

slave3:

  1. echo "192.168.161.202" > /etc/mesos-slave/ip
  2. echo "192.168.161.202" > /etc/mesos-slave/hostname
  3.  
  4. #修改hosts
  5. echo "192.168.161.202 slave3" >> /etc/hosts

5)启动mesos-slave

  1. systemctl start  mesos-slave  && systemctl enable  mesos-slave && systemctl disable mesos-master

6)错误排查

如遇到slave连接不上master的情况,如果没有对mesos的日志存放目录进行特殊修改

请在 /var/log/mesos/  下查看日志

  1. 日志信息如下:
  2.  
  3. [root@slave2 ~]# cd /var/log/mesos/
  4. [root@slave2 mesos]# ls
  5. mesos-slave.ERROR                                               mesos-slave.slave2.invalid-user.log.INFO.20181225-141244.8972  mesos-slave.slave2.invalid-user.log.INFO.20181225-181648.8959     mesos-slave.slave2.invalid-user.log.WARNING.20181225-180358.8998
  6. mesos-slave.INFO                                                mesos-slave.slave2.invalid-user.log.INFO.20181225-141514.8965  mesos-slave.slave2.invalid-user.log.WARNING.20181225-115141.9449  mesos-slave.slave2.invalid-user.log.WARNING.20181225-180823.8952
  7. mesos-slave.slave2.invalid-user.log.ERROR.20181225-145851.8960  mesos-slave.slave2.invalid-user.log.INFO.20181225-141841.8986  mesos-slave.slave2.invalid-user.log.WARNING.20181225-115709.8954  mesos-slave.slave2.invalid-user.log.WARNING.20181225-181649.8959
  8. mesos-slave.slave2.invalid-user.log.ERROR.20181225-155517.8987  mesos-slave.slave2.invalid-user.log.INFO.20181225-145406.8960  mesos-slave.slave2.invalid-user.log.WARNING.20181225-141254.8972  mesos-slave.WARNING
  9. mesos-slave.slave2.invalid-user.log.ERROR.20181225-180825.8952  mesos-slave.slave2.invalid-user.log.INFO.20181225-155333.8987  mesos-slave.slave2.invalid-user.log.WARNING.20181225-141852.8986
  10. mesos-slave.slave2.invalid-user.log.INFO.20181225-115131.9449   mesos-slave.slave2.invalid-user.log.INFO.20181225-180357.8998  mesos-slave.slave2.invalid-user.log.WARNING.20181225-145851.8960
  11. mesos-slave.slave2.invalid-user.log.INFO.20181225-115659.8954   mesos-slave.slave2.invalid-user.log.INFO.20181225-180823.8952  mesos-slave.slave2.invalid-user.log.WARNING.20181225-155334.8987
  12. [root@slave2 mesos]#

2.centos7 安装Mesos和marathon的更多相关文章

  1. Mesos+Zookeeper+Marathon的Docker管理平台部署记录（1）

    随着"互联网+"时代的业务增长.变化速度及大规模计算的需求,廉价的.高可扩展的分布式x86集群已成为标准解决方案,如Google已经在几千万台服务器上部署分布式系统.Docker及 ...

  2. Mesos+Zookeeper+Marathon+Docker环境搭建

    相关理论请参考:https://www.cnblogs.com/Bourbon-tian/p/7155054.html,本文基于https://www.cnblogs.com/Bourbon-tian ...

  3. Mesos+Zookeeper+Marathon+Docker分布式集群管理最佳实践

    参考赵班长的unixhot以及马亮blog 笔者QQ:572891887 Linux架构交流群:471443208 1.1Mesos简介 Mesos是Apache下的开源分布式资源管理框架,它被称为分 ...

  4. docker集群——搭建Mesos+Zookeeper+Marathon的Docker管理平台

    服务器架构 机器信息: 这里部属的机器为3个Master控制节点,3个slave运行节点,其中: zookeeper.Mesos-master.marathon运行在Master端:Mesos-sla ...

  5. Mesos以及Marathon安装总结

    安装了将近一周的环境了,终于把Mesos以及Marathon给安装上了,我指的离线安装. 策略1: 严格的按照官网的流程: http://mesos.apache.org/gettingstarted ...

  6. HP服务器 hp 360g5 centos7安装问题

    HP服务器  hp 360g5 centos7安装问题 一 :启动盘无法识别硬盘 1.进入安装光盘,用上下键选择安装centos--Install Centos7(注意不可按Enter键),如图: 2 ...

  7. CentOS7 安装Mono及Jexus

    CentOS7安装Mono及Juxes 1 安装Mono 1.1 安装yum-utils 因为安装要用到yum-config-manager,默认是没有安装的,所以要先安装yum-utils包.命令如 ...

  8. CentOS7安装mysql提示“No package mysql-server available.”

    针对centos7安装mysql,提示"No package mysql-server available."错误,解决方法如下: Centos 7 comes with Mari ...

  9. CentOS7安装Oracle 11gR2 安装

    概述 Oracle 在Linux和window上的安装不太一样,公司又是Linux系统上的Oracle,实在没辙,研究下Linux下Oracle的使用,oracle默认不支持CentOS系统安装,所以 ...

随机推荐

  1. mongoDB的学习

    一:linux下安装mongoDB 1.在linux系统上安装MongoDB 上传安装包mongodb-linux-x86_64-3.0.6.tgz到linux系统的home目录下 tar -zxvf ...

  2. Angular问题01 创建组件时报错、HammerJS找不到

    1 利用ng创建组件时出现错误 1.1 ng g c test/testHome 1.2 问题描述 当angular应用中有多个module.ts文件时,创建组件时会出现冲突,因为有多个module. ...

  3. ruby 【rails在win7_64位操作系统安装】

    gem update --system --source http://production.s3.rubygems.org 安装截图

  4. 什么是FastCGI, PHP-FPM

    CGI,FastCGI都是一套接口标准:是编程语言(比如php,python; python里面也有wsgi)与web服务器(比如Nginx)的通信标准(比如你跟老外交流,那么FastCGI就相当于是 ...

  5. opencv 基本数据结构

    转自:http://www.cnblogs.com/guoqiaojin/p/3176692.html opencv 基本数据结构   DataType : 将C++数据类型转换为对应的opencv数 ...

  6. C和C++中文件读写的区别

    C中采用的主要是文件指针的办法,C++中对文件的操作主要运用了“文件流”(即非标准的输入输出)的思想 eg1": #include<stdio.h> //... FILE* fp ...

  7. Python学习笔记--2--面向对象编程

    面向对象 类和装饰器@ #coding=gbk class student: def __init__(self,name,grand):#初始化构造函数,self相当于java中的this,相当于一 ...

  8. ABP框架应用-MySQL数据库集成

    1.  框架以外依赖包引入 1.1.  Pomelo.EntityFrameworkCore.MySql 1.2.  Pomelo.EntityFrameworkCore.MySql.Design 2 ...

  9. Metasploit 读书笔记-持久控制

    Meterpreter的persisitence脚本允许主任meterpreter代理，以确保系统重启之后Meterpreter还能运行。如果是反弹连接方式，可以设置连接攻击机的时间间隔。如果是绑定方 ...

  10. Summer Holiday 强连通

    Problem Description To see a World in a Grain of Sand And a Heaven in a Wild Flower, Hold Infinity i ...