报错背景:

CDH断电重启后,cloudera-scm-server启动报错,

cloudera-scm-server 已死,但 pid 文件仍存

由于没有成熟的解决方案,于是我就重新安装了MySQL数据库,

并且重新赋予了各种权限。

这个时候cloudera-scm-server可以启动成功,cloudera-scm-agent也可以启动成功。

报错现象:

此时cloudera-scm-server和cloudera-scm-agent都能启动成功,

但是jps一下,没有服务

明明启动了agent,但是下面的服务都起不来。

报错原因:

这个时候就要看一下日志文件cloudera-scm-agent.log

tail -n 100 /opt/cm-5.15.1/log/cloudera-scm-agent/cloudera-scm-agent.log

看到一行报错

[root@master opt]# tail -n  /opt/cm-5.15./log/cloudera-scm-agent/cloudera-scm-agent.log
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop-0.20-mapreduce/sbin/Linux/task-controller']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml httpfs httpfs
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'httpfs:httpfs', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/ssl/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/ssl/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/sqoop2/tomcat-conf.mr1/conf/server.xml sqoop2 sqoop
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'sqoop2:sqoop', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/sqoop2/tomcat-conf.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/sqoop2/tomcat-conf.mr1/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/sqoop2/tomcat-conf.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./lib/hue/desktop hue hue
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./lib/hue/desktop
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml httpfs httpfs
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'httpfs:httpfs', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https/conf/ssl/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https/conf/ssl/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https.mr1/conf/server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.https.mr1/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/solr/tomcat-conf.https/conf/server.xml solr solr
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'solr:solr', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/solr/tomcat-conf.https/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/solr/tomcat-conf.https/conf/server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/solr/tomcat-conf.https/conf/server.xml']
[/Apr/ :: +] MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml oozie oozie
[/Apr/ :: +] MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml
[/Apr/ :: +] MainThread parcel INFO Executing command ['chmod', '', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml']
[/Apr/ :: +] MainThread parcel INFO Ensuring users/groups exist for new parcel KAFKA-3.1.-1.3.1.1.p0..
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kafka']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kafka']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kafka', '-K', 'UMASK=022', '--home', '/var/lib/kafka', '--comment', 'Kafka', '--shell', '/sbin/nologin', 'kafka']
[/Apr/ :: +] MainThread parcel INFO Ensuring correct file permissions for new parcel KAFKA-3.1.-1.3.1.1.p0..
[/Apr/ :: +] MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <hbase-conf,/etc/hbase/conf.cloudera.hbase> <,>
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <hadoop-conf,/etc/hadoop/conf.cloudera.yarn> <,->
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <kafka-conf,/etc/kafka/conf.cloudera.kafka> <,->
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <hive-conf,/etc/hive/conf.cloudera.hive> <,->
[/Apr/ :: +] MainThread client_configs INFO Loaded client config: <hadoop-conf,/etc/hadoop/conf.cloudera.hdfs> <,->
[/Apr/ :: +] MainThread agent ERROR Error, CM server guid updated, expected f4ec230a-2f55-460f-b132-cb45a16c3a1b, received 4760feb5-8e8c-416c--2910fef890a0
[/Apr/ :: +] MainThread agent INFO CM server guid: f4ec230a-2f55-460f-b132-cb45a16c3a1b
[/Apr/ :: +] MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[/Apr/ :: +] MainThread agent WARNING Expected user root for /opt/cloudera/parcels but was cloudera-scm
[/Apr/ :: +] MainThread agent WARNING Expected group root for /opt/cloudera/parcels but was cloudera-scm
[/Apr/ :: +] MainThread parcel INFO Agent does create users/groups and apply file permissions
[/Apr/ :: +] MainThread parcel INFO Loading parcel manifest for: CDH-5.15.-.cdh5.15.1.p0.
[/Apr/ :: +] MainThread parcel INFO Loading parcel manifest for: KAFKA-3.1.-1.3.1.1.p0.
[/Apr/ :: +] MainThread parcel INFO Ensuring users/groups exist for new parcel CDH-5.15.-.cdh5.15.1.p0..
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hadoop']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'flume']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hdfs']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'solr']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'zookeeper']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'llama']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'httpfs']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'mapred']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sqoop']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'yarn']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kms']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hive']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sqoop2']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'oozie']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kudu']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hbase']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sentry']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'impala']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'spark']

日志文件

意思就是:CM服务器guid更新,期望f4ec230a-2f55-460f-b132-cb45a16c3a1b,收到4760feb5-8e8c-416c-8337-2910fef890a0

一看就是和CM的guid有关系,所以就从这方面着手解决问题。

报错解决:

[root@master var]# find / -name cm_guid     # 找到cm_guid这个文件所在的目录

/opt/cm-5.15./lib/cloudera-scm-agent/cm_guid      

[root@master var]# rm -rf /opt/cm-5.15./lib/cloudera-scm-agent/cm_guid  # 删除这个目录(所有节点)

[root@master var]# /opt/cm-5.15./etc/init.d/cloudera-scm-agent restart     # 重启

但是重启之后,jps还是没有各个服务进程

再次查看报错日志

tail -n 100 /opt/cm-5.15.1/log/cloudera-scm-agent/cloudera-scm-agent.log

[/Apr/ :: +]  MainThread parcel       INFO     Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-topics', '/usr/bi-topics', 'bin/kafka-topics', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-consumer-perf-tessr/bin/kafka-consumer-perf-test', 'bin/kafka-consumer-perf-test', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-config', '/usr/bi-config', 'bin/kafka-config', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-consumer-offset-c, '/usr/bin/kafka-consumer-offset-checker', 'bin/kafka-consumer-offset-checker', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-preferred-replicaon', '/usr/bin/kafka-preferred-replica-election', 'bin/kafka-preferred-replica-election', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-producer-perf-tessr/bin/kafka-producer-perf-test', 'bin/kafka-producer-perf-test', '', 'False']
[/Apr/ :: +] MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-console-producer'/bin/kafka-console-producer', 'bin/kafka-console-producer', '', 'False']
[/Apr/ :: +] MainThread agent INFO Active parcel list updated; recalculating component info.
[/Apr/ :: +] MainThread throttling_logger WARNING CMF_AGENT_JAVA_HOME environment variable host override will be deprecated in future. JAVA_HOME setting configur CM server takes precedence over host agent override. Configure JAVA_HOME setting from CM server.
[/Apr/ :: +] MainThread throttling_logger INFO Identified java component java8 with full version java version "1.8.0_191" Java(TM) SE Runtime Environment (bui0_191-b12) Java HotSpot(TM) -Bit Server VM (build 25.191-b12, mixed mode) for requested version .
[/Apr/ :: +] MainThread parcel_cache INFO Deleting unmanaged parcel CDH-5.15.-.cdh5.15.1.p0.
[/Apr/ :: +] MainThread parcel_cache INFO Deleting unmanaged parcel KAFKA-3.1.-1.3.1.1.p0.
[/Apr/ :: +] MainThread client_configs INFO Client configs to delete: set([<hadoop-conf,/etc/hadoop/conf.cloudera.yarn>, <hbase-conf,/etc/hbase/conf.cloudera. <kafka-conf,/etc/kafka/conf.cloudera.kafka>, <hive-conf,/etc/hive/conf.cloudera.hive>, <hadoop-conf,/etc/hadoop/conf.cloudera.hdfs>])
[/Apr/ :: +] MainThread client_configs INFO Client configs to deploy: set([])
[/Apr/ :: +] MainThread client_configs INFO Client configs to update: set([])
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: kafka-conf, /etc/kafka/conf.cloudera.kafka
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: hadoop-conf, /etc/hadoop/conf.cloudera.yarn
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: hbase-conf, /etc/hbase/conf.cloudera.hbase
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: hive-conf, /etc/hive/conf.cloudera.hive
[/Apr/ :: +] MainThread client_configs INFO Removing alternative: hadoop-conf, /etc/hadoop/conf.cloudera.hdfs
[/Apr/ :: +] MainThread agent WARNING Long HB processing time: 8.13849806786
[/Apr/ :: +] MainThread agent INFO Stopping agent...
[/Apr/ :: +] MainThread agent INFO No extant cgroups; unmounting any cgroup roots
[/Apr/ :: +] MainThread agent INFO processes are being managed; Supervisor will continue to run.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STOPPING
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('master', )) shut down
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Stopped thread '_TimeoutMonitor'.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STOPPED
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STOPPING
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('master', )) already shut down
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE No thread running for None.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STOPPED
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus EXITING
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus EXITED
[/Apr/ :: +] MainThread agent INFO Agent exiting; caught signal
[/Apr/ :: +] Dummy- daemonize WARNING Stopping daemon.
[/Apr/ :: +] MainThread __init__ INFO Agent UUID file was last modified at -- ::41.829000
[/Apr/ :: +] MainThread agent INFO ================================================================================
[/Apr/ :: +] MainThread agent INFO SCM Agent Version: 5.15.
[/Apr/ :: +] MainThread agent INFO Agent Protocol Version:
[/Apr/ :: +] MainThread agent INFO Using Host ID: 956d89c6-e7df-48c2-916b-f2eefd5a058f
[/Apr/ :: +] MainThread agent INFO Using directory: /opt/cm-5.15./run/cloudera-scm-agent
[/Apr/ :: +] MainThread agent INFO Using supervisor binary path: /opt/cm-5.15./lib64/cmf/agent/build/env/bin/supervisord
[/Apr/ :: +] MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTunication. These options can be configured in this agent's config.ini file to enable certificate validation.
[/Apr/ :: +] MainThread agent INFO Agent Logging Level: INFO
[/Apr/ :: +] MainThread agent INFO No command line vars
[/Apr/ :: +] MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type)
[/Apr/ :: +] MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type)
[/Apr/ :: +] MainThread agent INFO Found database jar: /opt/cm-5.15./share/cmf/lib/postgresql-42.1..jre7.jar
[/Apr/ :: +] MainThread agent INFO Agent starting as pid user root() group root().
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/cgroups
[/Apr/ :: +] MainThread cgroups INFO Found existing subsystem blkio at /sys/fs/cgroup/blkio
[/Apr/ :: +] MainThread cgroups INFO Found existing subsystem cpuacct at /sys/fs/cgroup/cpu,cpuacct
[/Apr/ :: +] MainThread cgroups INFO Found existing subsystem cpu at /sys/fs/cgroup/cpu,cpuacct
[/Apr/ :: +] MainThread cgroups INFO Found existing subsystem memory at /sys/fs/cgroup/memory
[/Apr/ :: +] MainThread cgroups INFO Found cgroups subsystem: cpu
[/Apr/ :: +] MainThread cgroups INFO Found cgroups subsystem: cpuacct
[/Apr/ :: +] MainThread cgroups INFO Found cgroups subsystem: memory
[/Apr/ :: +] MainThread cgroups INFO Found cgroups subsystem: blkio
[/Apr/ :: +] MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes': , 'default_memory_sof_in_bytes': , 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': , 'has_cpu': True, 'default_blkio_weight': , 'default_cpu_shares': , 'has_cpuacue, 'has_blkio': True}
[/Apr/ :: +] MainThread agent INFO Setting up supervisord event monitor.
[/Apr/ :: +] MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[/Apr/ :: +] MainThread filesystem_map INFO Using timeout of 2.000000
[/Apr/ :: +] MainThread filesystem_map INFO Using join timeout of 0.100000
[/Apr/ :: +] MainThread filesystem_map INFO Using tolerance of 60.000000
[/Apr/ :: +] MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs']
[/Apr/ :: +] MainThread kt_renewer INFO Agent wide credential cache set to /opt/cm-5.15./run/cloudera-scm-agent/krb5cc_cm_agent_0
[/Apr/ :: +] MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000
[/Apr/ :: +] MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000
[/Apr/ :: +] MainThread agent INFO Using max_collection_wait_seconds of 10.000000
[/Apr/ :: +] MainThread metrics INFO Importing tasktracker metric schema from file /opt/cm-5.15./lib64/cmf/agent/build/env/lib/python2./site-packages/c.-py2..egg/cmf/monitor/tasktracker/schema.json
[/Apr/ :: +] MainThread ntp_monitor INFO Using timeout of 2.000000
[/Apr/ :: +] MainThread dns_names INFO Using timeout of 30.000000
[/Apr/ :: +] MainThread __init__ INFO Created DNS monitor.
[/Apr/ :: +] MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes:
[/Apr/ :: +] MainThread __init__ INFO Importing metric schema from file /opt/cm-5.15./lib64/cmf/agent/build/env/lib/python2./site-packages/cmf-5.15.-py/cmf/monitor/schema.json
[/Apr/ :: +] MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUE: '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/opt/cm-5.15.1/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/opt/cm-5.15.1cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_'/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_'/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usrytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/opt/cm-5.15.1/share/cmf/libesql-42.1.4.jre7.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.disat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-or-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'ROOT': '/opt/cm-5.15.1/lib64/cmf', 'COP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/ 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[/Apr/ :: +] MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are nothen CDH is installed from parcels.
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/process
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/supervisor
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/flood
[/Apr/ :: +] MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15./run/cloudera-scm-agent/supervisor/include
[/Apr/ :: +] MainThread agent INFO Supervisor version: 3.0, pid:
[/Apr/ :: +] MainThread agent INFO Connecting to previous supervisor: agent--.
[/Apr/ :: +] MainThread status_server INFO Using maximum impala profile bundle size of bytes.
[/Apr/ :: +] MainThread status_server INFO Using maximum stacks log bundle size of bytes.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STARTING
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Started monitor thread '_TimeoutMonitor'.
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Serving on master:
[/Apr/ :: +] MainThread _cplogging INFO [/Apr/:::] ENGINE Bus STARTED
[/Apr/ :: +] MainThread __init__ INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x7ffb5aa8add0>,)
[/Apr/ :: +] MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',)
[/Apr/ :: +] MainThread agent INFO Setting default socket timeout to
[/Apr/ :: +] Monitor-HostMonitor network_interfaces INFO NIC iface eth0 doesn't support ETHTOOL (95)
[/Apr/ :: +] Monitor-HostMonitor throttling_logger ERROR Error getting directory attributes for /opt/cm-5.15./log/cloudera-scm-agent
Traceback (most recent call last):
File "/opt/cm-5.15.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.15.1-py2.7.egg/cmf/monitor/dir_monitor.py", line , in _get_directory_attributes
name = pwd.getpwuid(uid)[]
KeyError: 'getpwuid(): uid not found: 1106'
[/Apr/ :: +] MainThread heartbeat_tracker INFO HB stats (seconds): num: LIFE_MIN:0.03 min:0.03 mean:0.03 max:0.03 LIFE_MAX:0.03
[/Apr/ :: +] MainThread agent INFO CM server guid: 4760feb5-8e8c-416c--2910fef890a0
[/Apr/ :: +] MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[/Apr/ :: +] MainThread agent WARNING Expected user root for /opt/cloudera/parcels but was cloudera-scm
[/Apr/ :: +] MainThread agent WARNING Expected group root for /opt/cloudera/parcels but was cloudera-scm
[/Apr/ :: +] MainThread parcel INFO Agent does create users/groups and apply file permissions
[/Apr/ :: +] MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[/Apr/ :: +] MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[/Apr/ :: +] MainThread agent INFO Flood daemon (re)start attempt
[/Apr/ :: +] MainThread agent INFO Triggering supervisord update.
[/Apr/ :: +] MainThread agent INFO Active parcel list updated; recalculating component info.
[/Apr/ :: +] MainThread throttling_logger WARNING CMF_AGENT_JAVA_HOME environment variable host override will be deprecated in future. JAVA_HOME setting configur CM server takes precedence over host agent override. Configure JAVA_HOME setting from CM server.
[/Apr/ :: +] MainThread throttling_logger INFO Identified java component java8 with full version java version "1.8.0_191" Java(TM) SE Runtime Environment (bui0_191-b12) Java HotSpot(TM) -Bit Server VM (build 25.191-b12, mixed mode) for requested version .

报错日志

报错信息:ERROR    Error getting directory attributes for /opt/cm-5.15.1/log/cloudera-scm-agent

日志翻译:错误获取/opt/cm-5.15.1/log/cloudera-scm-agent的目录属性时出错

这个报错我找了很多资料也没有解决。

但是我发现一个现象,就是进到CDH的Web界面之后,由于uuid的改变,原来的界面都没有了,需要重新安装各种服务。

我看到这里就崩溃了,重装的CDH。

报错:Error, CM server guid updated, expected xxxxx, received xxxxx (未解决)的更多相关文章

  1. CDH5.16.1的agent启动报错:ERROR Error, CM server guid updated, expected d9bcadb4-f983-41b8-a667-66760f47bc91, received a67f5efa-8473-4f6a-94d6-231d1f432ef0

    1 详细错误 0/Oct/2019 14:56:13 +0000] 28577 MainThread agent ERROR Error, CM server guid updated, expect ...

  2. 启动mysql报错 -- ERROR! The server quit without updating PID file

    开发说某个测试环境的mysql,无法重启了,报以下错误提示: # service mysqld restart Shutting down MySQL.. SUCCESS! Starting MySQ ...

  3. mysql启动报错ERROR! The server quit without updating PID file处理

    从其它服务器拷贝编译安装后的MySQL5.7目录后启动时报错如下: ERROR! The server quit without updating PID file(/path/to/XXX.pid) ...

  4. ehcache报错ERROR n.s.e.store.disk.DiskStorageFactory - Disk Write的解决办法

    23:53:44 ERROR n.s.e.store.disk.DiskStorageFactory - Disk Write of com.koal.**.**.**.**.**.***Impl$$ ...

  5. LR报错Error -27780: [GENERAL_MSG_CAT_SSL_ERROR]connect to host "XXX.XXX.com" failed解决方法

  6. Android studio 3.4 新建项目报错Error:unable to resolve dependency for app@。。。解决办法

    试过网上很多的例子,有的设置Go to `File->Settings->Build, Execution, Deployment->Gradle->Uncheck Offli ...

  7. Mysql导入大文件报错(MySQL server has gone away(error 2006))

    前言 我们在导入mysql数据时候,mysql客户端突然报错:MySQL server has gone away(error 2006) 类似这种情况,处理思路为:调节mysql允许导入包的大小即可 ...

  8. window下安装redis报错: creating server tcp listening socket 127.0.0.1:6379: bind No error

    window下安装redis报错: creating server tcp listening socket 127.0.0.1:6379: bind No error 解决: 如果没有配置环境,在安 ...

  9. windows下配置redis集群,启动节点报错:createing server TCP listening socket *:7000:listen:Unknown error

    windows下配置redis集群,启动节点报错:createing server TCP listening socket *:7000:listen:Unknown error 学习了:https ...

随机推荐

  1. 向指定URL发送GET和POST请求

    package com.sinosoft.ap.wj.common.util; import java.io.BufferedReader;import java.io.IOException;imp ...

  2. 学习Spring-Data-Jpa(二)---JPA基本注解

    基本注解 1.@Entity :用于添加在实体类上,定义该JAVA类成为被JPA管理的实体,将映射到指定的数据库表.如定义一个实体类Category,它将映射到数据库中的category表中. 2.@ ...

  3. PHP命令行常用参数说明和使用

    -i 打印phpinfo命令 root@DK:/mnt/hgfs/cpp/php# php -i | grep session -v 输出php版本信息 root@DK:/mnt/hgfs/cpp/p ...

  4. linux线程操作

    初始化条件变量 int pthread_cond_init(pthread_cond_t *cv,pthread_cond_attr *cattr); 函数返回值:返回0表示成功,返回其他表示失败. ...

  5. Pytest权威教程22-优质集成实践

    目录 优质集成实践 使用pip安装包 Python测试发现的约定 选择测试布局结构/导入规则 在应用程序代码外测试 测试作为应用程序代码的一部分 tox 返回: Pytest权威教程 优质集成实践 使 ...

  6. Java 产生随机数并写入txt文档中

    源代码: import java.io.*; import java.util.Random; public class AlgorithmTest { public static void main ...

  7. Nodejs技巧之---Exceljs

    工作中我们可能会遇到制作表格的需求,那么针对nodejs如何制作一个汇总表格呢? 今天我们就在此介绍下exceljs的基本使用,应该可以满足我们大部分的需求. 第一部分 下载 npm install ...

  8. git提交报错:Updates were rejected because the tip of your current branch is behind

    提交代码push时报错:上网查询了一下解决办法有很多种,1.使用强制push的方法:(上网查询说这种会使远程修改丢失,一般是不可取的,尤其是多人协作开发的时候.) git push -u origin ...

  9. pyinstaller在64位系统下打包32位程序

    使用环境说明:win10 64位,已安装python3.6-64位版本 遇到的问题:win10 64位打包成exe文件后,不能在32位系统运行 需求:使用python打包生成exe文件,win64位和 ...

  10. Shell脚本——make命令和Makefile文件【转】

    https://blog.csdn.net/twc829/article/details/72729799 make命令是一个常用的编译命令,尤其在C/C++开发中,make命令通过makefile文 ...