tcp  通信

[root@hadoop2 logs]# netstat --numeric-ports -a -t
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 *:9864 *:* LISTEN
tcp 0 0 *:25672 *:* LISTEN
tcp 0 0 localhost:9000 *:* LISTEN
tcp 0 0 *:9866 *:* LISTEN
tcp 0 0 *:9867 *:* LISTEN
tcp 0 0 *:111 *:* LISTEN
tcp 0 0 *:80 *:* LISTEN
tcp 0 0 localhost:45105 *:* LISTEN
tcp 0 0 *:81 *:* LISTEN
tcp 0 0 *:4369 *:* LISTEN
tcp 0 0 *:82 *:* LISTEN
tcp 0 0 *:83 *:* LISTEN
tcp 0 0 *:22 *:* LISTEN
tcp 0 0 localhost:631 *:* LISTEN
tcp 0 0 *:15672 *:* LISTEN
tcp 0 0 localhost:25 *:* LISTEN
tcp 0 0 *:37051 *:* LISTEN
tcp 0 0 localhost:4369 localhost:38801 ESTABLISHED
tcp 0 0 hadoop2:4369 hadoop2:41207 TIME_WAIT
tcp 0 0 hadoop2:58050 hadoop1:27017 ESTABLISHED
tcp 0 64 hadoop2:22 192.168.2.102:51676 ESTABLISHED
tcp 0 0 localhost:38801 localhost:4369 ESTABLISHED
tcp 0 0 hadoop2:22 192.168.2.95:50018 ESTABLISHED
tcp 0 0 *:5672 *:* LISTEN
tcp 0 0 *:111 *:* LISTEN
tcp 0 0 *:22 *:* LISTEN
tcp 0 0 localhost:631 *:* LISTEN
tcp 0 0 *:52887 *:* LISTEN
[root@hadoop2 logs]#

端口号记录
[root@hadoop3 hadoop]# cat etc/hadoop/hdfs-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>dfs.replication</name>
<value>3</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>file:///usr/local/hadoop/mydatanode</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:///usr/local/hadoop/mynamenode</value>
</property>
<property>
<name>dfs.namenode.rpc-address</name>
<value>hadoop3:9933</value>
</property>
<property>
<name>dfs.namenode.servicerpc-address</name>
<value>hadoop3:9666</value>
</property>

</configuration>
[root@hadoop3 hadoop]#

hadoop2
tcp 0 0 hadoop2:56312 hadoop3:9666 ESTABLISHED

hadoop1
tcp 0 0 hadoop1:57227 hadoop3:9666 ESTABLISHED

hadoop3
tcp 0 0 hadoop3:9666 0.0.0.0:* LISTEN

tcp 0 0 hadoop3:9666 hadoop1:57227 ESTABLISHED

tcp 0 0 hadoop3:60667 hadoop3:9666 ESTABLISHED

tcp 0 0 hadoop3:9666 hadoop2:56312 ESTABLISHED

而日志记录为

Caused by: java.net.BindException: Problem binding to [hadoop3:8096] java.net.BindException: 无法指定被请求的地址; For more details see: http://wiki.apache.org/hadoop/BindException

但是主节点

tcp 0 0 hadoop3:8096 0.0.0.0:* LISTEN

8096端口再监听任意ip的任意端口

[root@hadoop3 hadoop]# cat etc/hadoop/yarn-site.xml
<?xml version="1.0"?>

<configuration>

<!-- Site specific YARN configuration properties -->
<property>
<name>yarn.resourcemanager.address</name>
<value>hadoop3:8032</value>
</property>
<property>
<name>yarn.nodemanager.address</name>
<value>hadoop3:8096</value>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>2048</value>
</property>
</configuration>
[root@hadoop3 hadoop]#

yarn.nodemanager出现了问题

netstat -atp

netstat -a -t -p

netstat --numeric-ports -a -t -p 排查hadoop主从节点是否建立通信的更多相关文章

  1. hadoop的节点间的通信

    一个DataNode上的Block是唯一的,多个DataNode可能有相同的Block. 2)通信场景: (1)NameNode的映射表上不永久保存每个DataNode所对应的block信息,而是通过 ...

  2. 实验-hadoop新增节点

    关于hadoop新增节点网上的说法都有些差别,自己来实践一把 1.建立一个namenode一个datanode的集群 master:192.168.126.130 slave1:192.168.126 ...

  3. Hadoop Datanode节点无法启动(All directories in dfs.data.dir are invalid)

    Hadoop Datanode节点无法启动(All directories in dfs.data.dir are invalid) java.io.IOException: All director ...

  4. 一、hadoop单节点安装测试

    一.hadoop简介 相信你或多或少都听过hadoop这个名字,hadoop是一个开源的.分布式软件平台.它主要解决了分布式存储(hdfs)和分布式计算(mapReduce)两个大数据的痛点问题,在h ...

  5. 当Hadoop 启动节点Datanode失败解决

    Hadoop 启动节点Datanode失败解决 [日期:2014-11-01] 来源:Linux社区  作者:shuideyidi [字体:大 中 小] 当我动态添加一个Hadoop从节点的之后,出现 ...

  6. 【Hadoop】Hadoop DataNode节点超时时间设置

    hadoop datanode节点超时时间设置 datanode进程死亡或者网络故障造成datanode无法与namenode通信,namenode不会立即把该节点判定为死亡,要经过一段时间,这段时间 ...

  7. Hadoop添加节点datanode(生产环境)

    Hadoop添加节点datanode 博客分类: hadoop HadoopSSHJDKXML工作  1.部署hadoop    和普通的datanode一样.安装jdk,ssh  2.修改host  ...

  8. Hadoop多节点Cluster

    Hadoop多节点集群规划 服务起名称 内网IP HDFS YARN master 192.168.1.155 NameNode ResourceManager slave1 192.168.1.11 ...

  9. hadoop中节点上的nodemanager一直启动不起来

    当我们启动Hadoop集群的时候,发现有一台机器的nodemanager启动后自动关闭, 查看日志的时候发现有错误:yarn-root-nodemanager-log 解决办法: netstat  a ...

随机推荐

  1. 杭电 2120 Ice_cream's world I (并查集求环数)

    Description ice_cream's world is a rich country, it has many fertile lands. Today, the queen of ice_ ...

  2. ORACLE-023:令人烦恼的 ora-01722 无效数字

    https://blog.csdn.net/yysyangyangyangshan/article/details/51762746

  3. JavaScript变量声明提升

    JavaScript代码在被解析引擎执行前,会被“编译”把变量声明等放在合适的作用域中,如果不了解这一点,会让人产生很多疑惑. 文章:详解js变量声明提升

  4. 获得HttpServletRequest 和HttpSession对象

    package org.jeecgframework.core.util; import java.util.HashMap; import java.util.Map; import javax.s ...

  5. codeforces 1041 c 乱搞

    #include <bits/stdc++.h> using namespace std; struct po { int val; int id; }; po a[]; vector&l ...

  6. Intersection of Two Linked Lists(链表)

    Write a program to find the node at which the intersection of two singly linked lists begins. For ex ...

  7. final finally finalize 区别及用法

    final 1,final修饰的class,代表不可以继承扩展. 2.final的方法也是不可以重写的. 3.final修饰的变量是不可以修改的.这里所谓的不可修改对于基本类型来来,的确是不可以修改. ...

  8. java IO与NIO

    场景:IO适用于大而少,NIO适用于小而多 转载:https://www.cnblogs.com/kzfy/p/5063467.html 传统的socket IO中,需要为每个连接创建一个线程,当并发 ...

  9. Eclipse通过Maven构建时出现: Fatal error compiling: tools.jar not found: Fatal error compiling: tools.jar not found: C:\Program Files\Java\jre1.8.0_31\..\lib\tools.jar

    错误: Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-com ...

  10. intelliJ IDEA工具快捷键

    F9            resume programe 恢复程序 Alt+F10        show execution point 显示执行断点 F8            Step Ove ...