【原创】大叔经验分享(64)cloudera manager agent启动组件进程过程
概述
The Agent is started by init.d at start-up. It, in turn, contacts the Cloudera Manager Server and determines which processes should be running. The Agent is monitored as part of Cloudera Manager's host monitoring. If the Agent stops heartbeating, the host is marked as having bad health.
One of the Agent's main responsibilities is to start and stop processes. When the Agent detects a new process from the Server heartbeat, the Agent creates a directory for it in /var/run/cloudera-scm-agent and unpacks the configuration. It then contacts supervisord, which starts the process.
1 生成配置文件目录
[25/May/2019 16:16:36 +0000] 27716 MainThread agent INFO Created /opt/cloudera-manager/cm-5.16.1/run/cloudera
-scm-agent/process/333-kudu-KUDU_TSERVER
[25/May/2019 16:16:36 +0000] 27716 MainThread agent INFO Chowning /opt/cloudera-manager/cm-5.16.1/run/clouder
a-scm-agent/process/333-kudu-KUDU_TSERVER to kudu (982) kudu (978)
[25/May/2019 16:16:36 +0000] 27716 MainThread agent INFO Chmod'ing /opt/cloudera-manager/cm-5.16.1/run/cloude
ra-scm-agent/process/333-kudu-KUDU_TSERVER to 0751
[25/May/2019 16:16:36 +0000] 27716 MainThread agent INFO Created /opt/cloudera-manager/cm-5.16.1/run/cloudera
-scm-agent/process/333-kudu-KUDU_TSERVER/logs
[25/May/2019 16:16:36 +0000] 27716 MainThread agent INFO Chowning /opt/cloudera-manager/cm-5.16.1/run/clouder
a-scm-agent/process/333-kudu-KUDU_TSERVER/logs to kudu (982) kudu (978)
[25/May/2019 16:16:36 +0000] 27716 MainThread agent INFO Chmod'ing /opt/cloudera-manager/cm-5.16.1/run/cloude
ra-scm-agent/process/333-kudu-KUDU_TSERVER/logs to 0751
[25/May/2019 16:16:36 +0000] 27716 MainThread process INFO [333-kudu-KUDU_TSERVER] Refreshing process files: No
ne
[25/May/2019 16:16:36 +0000] 27716 MainThread __init__ INFO Extracted 9 files and 0 dirs to /opt/cloudera-manage
r/cm-5.16.1/run/cloudera-scm-agent/process/333-kudu-KUDU_TSERVER.
[25/May/2019 16:16:36 +0000] 27716 MainThread process INFO reading limits: {u'limit_memlock': None, u'limit_fds
': None}
[25/May/2019 16:16:36 +0000] 27716 MainThread process INFO [333-kudu-KUDU_TSERVER] Launching process. one-off F
alse, command csd/csd.sh, args [u'tserver']
目录:
/opt/cloudera-manager/cm-5.16.1/run/cloudera-scm-agent/process/$index_component_config
配置目录中有proc.json文件包含进程的详细信息,包括启动命令和参数等;
python代码目录
/opt/cloudera-manager/cm-5.16.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.16.1-py2.7.egg/cmf/
agent.py
process.pywrite_configuration
2 设置环境变量
CONF_DIR=/opt/cloudera-manager/cm-5.16.1/run/cloudera-scm-agent/process/341-hdfs-DATANODE
CMF_CONF_DIR=/opt/cloudera-manager/cm-5.16.1/etc/cloudera-scm-agent/opt/cloudera/parcels/CDH-5.16.1-1.cdh5.16.1.p0.3/meta/cdh_env.sh
3 启动
/opt/cloudera/parcels/CDH-5.16.1-1.cdh5.16.1.p0.3/lib/hadoop-hdfs/bin/hdfs --config /opt/cloudera-manager/cm-5.16.1/run/cloudera-scm-agent/process/341-hdfs-DATANODE datanode
4 其他
agent uuid目录
/opt/cloudera-manager/cm-5.16.1/lib/cloudera-scm-agent/
参考:
https://www.cloudera.com/documentation/enterprise/5-6-x/topics/admin_cloudera_manager_agents.html
【原创】大叔经验分享(64)cloudera manager agent启动组件进程过程的更多相关文章
- 【原创】大叔经验分享(66)docker启动tomcat不输出catalina.out
docker启动tomcat默认是: Run the default Tomcat server (CMD ["catalina.sh", "run"]): 查 ...
- 【原创】大叔经验分享(57)hue启动coordinator时报错
hue启动coordinator时报错,页面返回undefinied错误框: 后台日志报错: runcpserver.log [13/May/2019 04:34:55 -0700] middlewa ...
- 【原创】大叔经验分享(89)docker启动openjdk执行jmap报错
docker启动openjdk后,可以查看进程 # docker exec -it XXX jps 10 XXX.jar 可见启动的java进程id一直为10,然后可以执行jvm命令,比如 # doc ...
- 【原创】大叔经验分享(69)docker启动java应用的时区问题
在docker中启动tomcat或java类应用,获取时间默认是UTC时间,这是因为容器内的locale没有设置为东8区,最简单的方式是增加JAVA_OPTS 如果是java,直接在java命令后增加 ...
- 安装Cloudera manager agent步骤详解
安装Cloudera manager agent步骤详解 作者:尹正杰 版权声明:原创作品,谢绝转载!否则将追究法律责任. 本篇博客主要是针对:https://www.cnblogs.com/yinz ...
- 基于yum的方式安装Cloudera Manager Agent(使用Mysql 8.0版本)
基于yum的方式安装Cloudera Manager Agent(使用Mysql 8.0版本) 作者:尹正杰 版权声明:原创作品,谢绝转载!否则将追究法律责任. 一.选择CDH版本 1>.确认 ...
- 【原创】经验分享:一个小小emoji尽然牵扯出来这么多东西?
前言 之前也分享过很多工作中踩坑的经验: 一个线上问题的思考:Eureka注册中心集群如何实现客户端请求负载及故障转移? [原创]经验分享:一个Content-Length引发的血案(almost.. ...
- 【原创】大叔经验分享(50)hue访问mysql(librdbms)
cloudera manager安装hue后想开启访问mysql(librdbms)需要在这里配置(hue_safety_valve.ini) 添加配置如下 [librdbms] # The RDBM ...
- 【原创】大叔经验分享(37)CM清理磁盘空间
定期清理cloudera manager server的磁盘空间 1 停止Service Monitor和Host Monitor 2 删除日志 # /bin/rm /var/lib/cloudera ...
随机推荐
- 简易总结react-hook三大基础
react-hook的最重要的三大基础 import { useEffect, useState, useContext } from 'react' 1.每一个简单的一句话总结 useEffect ...
- leetcode25 K 个一组翻转链表
这道题关于链表的操作,中间指针操作略复杂. /** * Definition for singly-linked list. * struct ListNode { * int val; * List ...
- xpath定位元素
@ 表示包含的属性,如@id表示包含id属性的标签[] 表示索引.. 表示父节点 --------------------------------------------------- //* #定位 ...
- 小D课堂-SpringBoot 2.x微信支付在线教育网站项目实战_5-3.微信Oauth2.0交互流程讲解
笔记 3.微信Oauth2.0交互流程讲解 简介:讲解微信Oauth2.0交互流程 参考:https://open.weixin.qq.com/cgi-bin/sho ...
- centos6 安装docker
docker 安装要求内核大于3.10 , 而centos6 机器上内核一般是2.6 , 除了升级内核外, 还可以安装低版本的docker , 本文介绍docker 1.7的安装. 机器 环境 [ro ...
- 分布式存储ceph--添加/删除osd(5)
一.添加osd: 当前ceph集群中有如下osd,现在准备新添加osd:
- Windows10系统python环境下安装Dlib库(转载,蔡军帅亲测可用)
Dlib是一个很优秀的机器学习库,最近做人脸识别要用到这个库,简要记录一下配置过程,准备工作: 1.python环境 2.安装好pip(这里有个简单的安装教程) 3.Dlib包,贴一个我安装的版本,链 ...
- Java泛型(5):擦除与补偿
先看一个例子: Class<?> c1 = new ArrayList<String>().getClass(); Class<?> c2 = new ArrayL ...
- 撸了一个简易的工具库: jeasy
一年前,发现在工作的项目中存在大量使用monment的情况,但仅使用到最基础的format功能.monment的体积直接导致项目体积成倍增加,于是jeasy就诞生了. jeasy实现了monment最 ...
- 【VS开发】CFormView
原文地址:CFormView作者:罗纳尔多 CFormView是MFC使用无模式对话框的一个典型例子.CFormView是基于对话框模板创建的视,它的直接基类是CSrcollView,CSrcollV ...