报错背景:

CDH断电重启后,cloudera-scm-server启动报错,

cloudera-scm-server 已死,但 pid 文件仍存

由于没有成熟的解决方案,于是我就重新安装了MySQL数据库,

并且重新赋予了各种权限。

这个时候cloudera-scm-server可以启动成功,cloudera-scm-agent也可以启动成功。

报错现象:

此时cloudera-scm-server和cloudera-scm-agent都能启动成功,

但是jps一下,没有服务

明明启动了agent,但是下面的服务都起不来。

报错原因:

这个时候就要看一下日志文件cloudera-scm-agent.log

tail -n 100 /opt/cm-5.15.1/log/cloudera-scm-agent/cloudera-scm-agent.log

看到一行报错

[root@master opt]# tail -n  /opt/cm-5.15./log/cloudera-scm-agent/cloudera-scm-agent.log
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop-0.20-mapreduce/sbin/Linux/task-controller']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml httpfs httpfs
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'httpfs:httpfs', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/ssl/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/ssl/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/sqoop2/tomcat-conf.mr1/conf/server.xml sqoop2 sqoop
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'sqoop2:sqoop', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/sqoop2/tomcat-conf.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/sqoop2/tomcat-conf.mr1/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/sqoop2/tomcat-conf.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./lib/hue/desktop hue hue
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./lib/hue/desktop
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml httpfs httpfs
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'httpfs:httpfs', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https/conf/ssl/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https/conf/ssl/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https.mr1/conf/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https.mr1/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/solr/tomcat-conf.https/conf/server.xml solr solr
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'solr:solr', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/solr/tomcat-conf.https/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/solr/tomcat-conf.https/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/solr/tomcat-conf.https/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO Ensuring users/groups exist for new parcel KAFKA-3.1.-1.3.1.1.p0..
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kafka']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kafka']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kafka', '-K', 'UMASK=022', '--home', '/var/lib/kafka', '--comment', 'Kafka', '--shell', '/sbin/nologin', 'kafka']
[/Apr/ :: +] MainThread parcel INFO Ensuring correct file permissions for new parcel KAFKA-3.1.-1.3.1.1.p0..
[/Apr/ :: +] MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <hbase-conf,/etc/hbase/conf.cloudera.hbase> <,>
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <hadoop-conf,/etc/hadoop/conf.cloudera.yarn> <,->
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <kafka-conf,/etc/kafka/conf.cloudera.kafka> <,->
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <hive-conf,/etc/hive/conf.cloudera.hive> <,->
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <hadoop-conf,/etc/hadoop/conf.cloudera.hdfs> <,->
[/Apr/ :: +] MainThread agent ERROR Error, CM server guid updated, expected f4ec230a-2f55-460f-b132-cb45a16c3a1b, received 4760feb5-8e8c-416c--2910fef890a0
[/Apr/ :: +] MainThread agent INFO CM server guid: f4ec230a-2f55-460f-b132-cb45a16c3a1b
[/Apr/ :: +] MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[/Apr/ :: +] MainThread agent WARNING Expected user root for /opt/cloudera/parcels but was cloudera-scm
[/Apr/ :: +] MainThread agent WARNING Expected group root for /opt/cloudera/parcels but was cloudera-scm
[/Apr/ :: +] MainThread parcel INFO Agent does create users/groups and apply file permissions
[/Apr/ :: +] MainThread parcel INFO Loading parcel manifest for: CDH-5.15.-.cdh5.15.1.p0.
[/Apr/ :: +] MainThread parcel INFO Loading parcel manifest for: KAFKA-3.1.-1.3.1.1.p0.
[/Apr/ :: +] MainThread parcel INFO Ensuring users/groups exist for new parcel CDH-5.15.-.cdh5.15.1.p0..
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hadoop']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'flume']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hdfs']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'solr']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'zookeeper']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'llama']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'httpfs']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'mapred']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sqoop']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'yarn']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kms']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hive']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sqoop2']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'oozie']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kudu']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hbase']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sentry']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'impala']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'spark']

日志文件

意思就是:CM服务器guid更新,期望f4ec230a-2f55-460f-b132-cb45a16c3a1b,收到4760feb5-8e8c-416c-8337-2910fef890a0

一看就是和CM的guid有关系,所以就从这方面着手解决问题。

报错解决:

[root@master var]# find / -name cm_guid     # 找到cm_guid这个文件所在的目录

/opt/cm-5.15./lib/cloudera-scm-agent/cm_guid      

[root@master var]# rm -rf /opt/cm-5.15./lib/cloudera-scm-agent/cm_guid  # 删除这个目录(所有节点)

[root@master var]# /opt/cm-5.15./etc/init.d/cloudera-scm-agent restart     # 重启

但是重启之后,jps还是没有各个服务进程

再次查看报错日志

tail -n 100 /opt/cm-5.15.1/log/cloudera-scm-agent/cloudera-scm-agent.log

[/Apr/ :: +]  MainThread parcel       INFO     Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-topics', '/usr/bi-topics', 'bin/kafka-topics', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-consumer-perf-tessr/bin/kafka-consumer-perf-test', 'bin/kafka-consumer-perf-test', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-config', '/usr/bi-config', 'bin/kafka-config', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-consumer-offset-c, '/usr/bin/kafka-consumer-offset-checker', 'bin/kafka-consumer-offset-checker', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-preferred-replicaon', '/usr/bin/kafka-preferred-replica-election', 'bin/kafka-preferred-replica-election', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-producer-perf-tessr/bin/kafka-producer-perf-test', 'bin/kafka-producer-perf-test', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-console-producer'/bin/kafka-console-producer', 'bin/kafka-console-producer', '', 'False']
[/Apr/ :: +] MainThread agent INFO Active parcel list updated; recalculating component info.
[/Apr/ :: +] MainThread throttling_logger WARNING CMF_AGENT_JAVA_HOME environment variable host override will be deprecated in future. JAVA_HOME setting configur CM server takes precedence over host agent override. Configure JAVA_HOME setting from CM server.
[/Apr/ :: +] MainThread throttling_logger INFO Identified java component java8 with full version java version "1.8.0_191" Java(TM) SE Runtime Environment (bui0_191-b12) Java HotSpot(TM) -Bit Server VM (build 25.191-b12, mixed mode) for requested version .
[/Apr/ :: +] MainThread parcel_cache INFO Deleting unmanaged parcel CDH-5.15.-.cdh5.15.1.p0.
[/Apr/ :: +] MainThread parcel_cache INFO Deleting unmanaged parcel KAFKA-3.1.-1.3.1.1.p0.
[/Apr/ :: +] MainThread client_configs INFO Client configs to delete: set([<hadoop-conf,/etc/hadoop/conf.cloudera.yarn>, <hbase-conf,/etc/hbase/conf.cloudera. <kafka-conf,/etc/kafka/conf.cloudera.kafka>, <hive-conf,/etc/hive/conf.cloudera.hive>, <hadoop-conf,/etc/hadoop/conf.cloudera.hdfs>])
[/Apr/ :: +] MainThread client_configs INFO Client configs to deploy: set([])
[/Apr/ :: +] MainThread client_configs INFO Client configs to update: set([])
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: kafka-conf, /etc/kafka/conf.cloudera.kafka
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: hadoop-conf, /etc/hadoop/conf.cloudera.yarn
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: hbase-conf, /etc/hbase/conf.cloudera.hbase
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: hive-conf, /etc/hive/conf.cloudera.hive
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: hadoop-conf, /etc/hadoop/conf.cloudera.hdfs
[/Apr/ :: +] MainThread agent WARNING Long HB processing time: 8.13849806786
[/Apr/ :: +] MainThread agent INFO Stopping agent...
[/Apr/ :: +] MainThread agent INFO No extant cgroups; unmounting any cgroup roots
[/Apr/ :: +] MainThread agent INFO processes are being managed; Supervisor will continue to run.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STOPPING
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('master', )) shut down
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Stopped thread '_TimeoutMonitor'.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STOPPED
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STOPPING
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('master', )) already shut down
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE No thread running for None.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STOPPED
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus EXITING
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus EXITED
[/Apr/ :: +] MainThread agent INFO Agent exiting; caught signal
[/Apr/ :: +] Dummy- daemonize WARNING Stopping daemon.
[/Apr/ :: +] MainThread __init__ INFO Agent UUID file was last modified at -- ::41.829000
[/Apr/ :: +] MainThread agent INFO ================================================================================
[/Apr/ :: +] MainThread agent INFO SCM Agent Version: 5.15.
[/Apr/ :: +] MainThread agent INFO Agent Protocol Version:
[/Apr/ :: +] MainThread agent INFO Using Host ID: 956d89c6-e7df-48c2-916b-f2eefd5a058f
[/Apr/ :: +] MainThread agent INFO Using directory: /opt/cm-5.15./run/cloudera-scm-agent
[/Apr/ :: +] MainThread agent INFO Using supervisor binary path: /opt/cm-5.15./lib64/cmf/agent/build/env/bin/supervisord
[/Apr/ :: +] MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTunication. These options can be configured in this agent's config.ini file to enable certificate validation.
[/Apr/ :: +] MainThread agent INFO Agent Logging Level: INFO
[/Apr/ :: +] MainThread agent INFO No command line vars
[/Apr/ :: +] MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type)
[/Apr/ :: +] MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type)
[/Apr/ :: +] MainThread agent INFO Found database jar: /opt/cm-5.15./share/cmf/lib/postgresql-42.1..jre7.jar
[/Apr/ :: +] MainThread agent INFO Agent starting as pid user root() group root().
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/cgroups
[/Apr/ :: +] MainThread cgroups INFO Found existing subsystem blkio at /sys/fs/cgroup/blkio
[/Apr/ :: +] MainThread cgroups INFO Found existing subsystem cpuacct at /sys/fs/cgroup/cpu,cpuacct
[/Apr/ :: +] MainThread cgroups INFO Found existing subsystem cpu at /sys/fs/cgroup/cpu,cpuacct
[/Apr/ :: +] MainThread cgroups INFO Found existing subsystem memory at /sys/fs/cgroup/memory
[/Apr/ :: +] MainThread cgroups INFO Found cgroups subsystem: cpu
[/Apr/ :: +] MainThread cgroups INFO Found cgroups subsystem: cpuacct
[/Apr/ :: +] MainThread cgroups INFO Found cgroups subsystem: memory
[/Apr/ :: +] MainThread cgroups INFO Found cgroups subsystem: blkio
[/Apr/ :: +] MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes': , 'default_memory_sof_in_bytes': , 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': , 'has_cpu': True, 'default_blkio_weight': , 'default_cpu_shares': , 'has_cpuacue, 'has_blkio': True}
[/Apr/ :: +] MainThread agent INFO Setting up supervisord event monitor.
[/Apr/ :: +] MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[/Apr/ :: +] MainThread filesystem_map INFO Using timeout of 2.000000
[/Apr/ :: +] MainThread filesystem_map INFO Using join timeout of 0.100000
[/Apr/ :: +] MainThread filesystem_map INFO Using tolerance of 60.000000
[/Apr/ :: +] MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs']
[/Apr/ :: +] MainThread kt_renewer INFO Agent wide credential cache set to /opt/cm-5.15./run/cloudera-scm-agent/krb5cc_cm_agent_0
[/Apr/ :: +] MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000
[/Apr/ :: +] MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000
[/Apr/ :: +] MainThread agent INFO Using max_collection_wait_seconds of 10.000000
[/Apr/ :: +] MainThread metrics INFO Importing tasktracker metric schema from file /opt/cm-5.15./lib64/cmf/agent/build/env/lib/python2./site-packages/c.-py2..egg/cmf/monitor/tasktracker/schema.json
[/Apr/ :: +] MainThread ntp_monitor INFO Using timeout of 2.000000
[/Apr/ :: +] MainThread dns_names INFO Using timeout of 30.000000
[/Apr/ :: +] MainThread __init__ INFO Created DNS monitor.
[/Apr/ :: +] MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes:
[/Apr/ :: +] MainThread __init__ INFO Importing metric schema from file /opt/cm-5.15./lib64/cmf/agent/build/env/lib/python2./site-packages/cmf-5.15.-py/cmf/monitor/schema.json
[/Apr/ :: +] MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUE: '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/opt/cm-5.15.1/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/opt/cm-5.15.1cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_'/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_'/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usrytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/opt/cm-5.15.1/share/cmf/libesql-42.1.4.jre7.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.disat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-or-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'ROOT': '/opt/cm-5.15.1/lib64/cmf', 'COP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/ 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[/Apr/ :: +] MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are nothen CDH is installed from parcels.
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/process
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/supervisor
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/flood
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/supervisor/include
[/Apr/ :: +] MainThread agent INFO Supervisor version: 3.0, pid:
[/Apr/ :: +] MainThread agent INFO Connecting to previous supervisor: agent--.
[/Apr/ :: +] MainThread status_server INFO Using maximum impala profile bundle size of bytes.
[/Apr/ :: +] MainThread status_server INFO Using maximum stacks log bundle size of bytes.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STARTING
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Started monitor thread '_TimeoutMonitor'.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Serving on master:
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STARTED
[/Apr/ :: +] MainThread __init__ INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x7ffb5aa8add0>,)
[/Apr/ :: +] MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',)
[/Apr/ :: +] MainThread agent INFO Setting default socket timeout to
[/Apr/ :: +] Monitor-HostMonitor network_interfaces INFO NIC iface eth0 doesn't support ETHTOOL (95)
[/Apr/ :: +] Monitor-HostMonitor throttling_logger ERROR Error getting directory attributes for /opt/cm-5.15./log/cloudera-scm-agent
Traceback (most recent call last):
File "/opt/cm-5.15.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.15.1-py2.7.egg/cmf/monitor/dir_monitor.py", line , in _get_directory_attributes
name = pwd.getpwuid(uid)[]
KeyError: 'getpwuid(): uid not found: 1106'
[/Apr/ :: +] MainThread heartbeat_tracker INFO HB stats (seconds): num: LIFE_MIN:0.03 min:0.03 mean:0.03 max:0.03 LIFE_MAX:0.03
[/Apr/ :: +] MainThread agent INFO CM server guid: 4760feb5-8e8c-416c--2910fef890a0
[/Apr/ :: +] MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[/Apr/ :: +] MainThread agent WARNING Expected user root for /opt/cloudera/parcels but was cloudera-scm
[/Apr/ :: +] MainThread agent WARNING Expected group root for /opt/cloudera/parcels but was cloudera-scm
[/Apr/ :: +] MainThread parcel INFO Agent does create users/groups and apply file permissions
[/Apr/ :: +] MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[/Apr/ :: +] MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[/Apr/ :: +] MainThread agent INFO Flood daemon (re)start attempt
[/Apr/ :: +] MainThread agent INFO Triggering supervisord update.
[/Apr/ :: +] MainThread agent INFO Active parcel list updated; recalculating component info.
[/Apr/ :: +] MainThread throttling_logger WARNING CMF_AGENT_JAVA_HOME environment variable host override will be deprecated in future. JAVA_HOME setting configur CM server takes precedence over host agent override. Configure JAVA_HOME setting from CM server.
[/Apr/ :: +] MainThread throttling_logger INFO Identified java component java8 with full version java version "1.8.0_191" Java(TM) SE Runtime Environment (bui0_191-b12) Java HotSpot(TM) -Bit Server VM (build 25.191-b12, mixed mode) for requested version .

报错日志

报错信息:ERROR    Error getting directory attributes for /opt/cm-5.15.1/log/cloudera-scm-agent

日志翻译:错误获取/opt/cm-5.15.1/log/cloudera-scm-agent的目录属性时出错

这个报错我找了很多资料也没有解决。

但是我发现一个现象,就是进到CDH的Web界面之后,由于uuid的改变,原来的界面都没有了,需要重新安装各种服务。

我看到这里就崩溃了,重装的CDH。

报错:Error, CM server guid updated, expected xxxxx, received xxxxx (未解决)的更多相关文章

  1. CDH5.16.1的agent启动报错:ERROR Error, CM server guid updated, expected d9bcadb4-f983-41b8-a667-66760f47bc91, received a67f5efa-8473-4f6a-94d6-231d1f432ef0

    1 详细错误 0/Oct/2019 14:56:13 +0000] 28577 MainThread agent ERROR Error, CM server guid updated, expect ...

  2. 启动mysql报错 -- ERROR! The server quit without updating PID file

    开发说某个测试环境的mysql,无法重启了,报以下错误提示: # service mysqld restart Shutting down MySQL.. SUCCESS! Starting MySQ ...

  3. mysql启动报错ERROR! The server quit without updating PID file处理

    从其它服务器拷贝编译安装后的MySQL5.7目录后启动时报错如下: ERROR! The server quit without updating PID file(/path/to/XXX.pid) ...

  4. ehcache报错ERROR n.s.e.store.disk.DiskStorageFactory - Disk Write的解决办法

    23:53:44 ERROR n.s.e.store.disk.DiskStorageFactory - Disk Write of com.koal.**.**.**.**.**.***Impl$$ ...

  5. LR报错Error -27780: [GENERAL_MSG_CAT_SSL_ERROR]connect to host "XXX.XXX.com" failed解决方法

  6. Android studio 3.4 新建项目报错Error:unable to resolve dependency for app@。。。解决办法

    试过网上很多的例子,有的设置Go to `File->Settings->Build, Execution, Deployment->Gradle->Uncheck Offli ...

  7. Mysql导入大文件报错(MySQL server has gone away(error 2006))

    前言 我们在导入mysql数据时候,mysql客户端突然报错:MySQL server has gone away(error 2006) 类似这种情况,处理思路为:调节mysql允许导入包的大小即可 ...

  8. window下安装redis报错: creating server tcp listening socket 127.0.0.1:6379: bind No error

    window下安装redis报错: creating server tcp listening socket 127.0.0.1:6379: bind No error 解决: 如果没有配置环境,在安 ...

  9. windows下配置redis集群,启动节点报错:createing server TCP listening socket *:7000:listen:Unknown error

    windows下配置redis集群,启动节点报错:createing server TCP listening socket *:7000:listen:Unknown error 学习了:https ...

随机推荐

  1. Python高级编程和异步IO并发编程(笔记)

    一.魔法函数 # 例子 class Company(object): def __init__(self, employee_list): self.employee = employee_list ...

  2. NISP二级笔记(二) 信息安全管理体系

  3. learning java Math类

    output: //取整,返回小于目标数的最大整数System.out.println(Math.floor(-1.2));// 取整,返回在于目标数的最大整数System.out.println(M ...

  4. C用malloc 向系统申请一个大小为n*4个字节的内存块

    #include <stdio.h> #include <malloc.h> void out(int *p, int n){ int i; for(i=0;i<n;i+ ...

  5. leetcode解题报告(29):Student Attendance Record I

    描述 You are given a string representing an attendance record for a student. The record only contains ...

  6. Vim初学

    实现G++编译 1,首先下载安装MinGW,下载地址在http://sourceforge.net/projects/mingw/.这个是边下载边安装的,下载完成即安装完成.我的安装目录是G:\Min ...

  7. 2017.10.5 国庆清北 D5T2 整除

    80分暴力 /*找规律80分TLE俩点 忘了啥规律了. */ #include<iostream> #include<cstdio> #include<cmath> ...

  8. 《挑战30天C++入门极限》C++类静态数据成员与类静态成员函数

        C++类静态数据成员与类静态成员函数 在没有讲述本章内容之前如果我们想要在一个范围内共享某一个数据,那么我们会设立全局对象,但面向对象的程序是由对象构成的,我们如何才能在类范围内共享数据呢? ...

  9. Django基础(1)-虚拟环境的安装及配置

    virtualenv介绍 (1)做什么的?virtualenv是用于创建独立的python环境,使得多个python应用彼此独立: (2)优点: a)使不同应用开发环境独立 b)环境升级不影响其他应用 ...

  10. js逆向笔记

    1.nodejs运行js的时候 navigator如果找不到可以可设置为空对象 var navigator={}; 2.使用nodejs如果window对象找不到的时候 可以使用jsdom模块 3.顶 ...