1、虽然，不是大错，还说要贴一下，由于我运行run-example streaming.NetworkWordCount localhost 9999的测试案例，出现的错误，第一感觉就是Spark没有启动导致的：

 // :: ERROR SparkContext: Error initializing SparkContext.

 java.net.ConnectException: Call From slaver1/192.168.19.131 to slaver1: failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

     at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:)

     at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:)

     at java.lang.reflect.Constructor.newInstance(Constructor.java:)

     at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:)

     at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:)

     at org.apache.hadoop.ipc.Client.call(Client.java:)

     at org.apache.hadoop.ipc.Client.call(Client.java:)

     at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:)

     at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)

     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)

     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)

     at java.lang.reflect.Method.invoke(Method.java:)

     at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:)

     at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:)

     at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)

     at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:)

     at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:)

     at org.apache.hadoop.hdfs.DistributedFileSystem$.doCall(DistributedFileSystem.java:)

     at org.apache.hadoop.hdfs.DistributedFileSystem$.doCall(DistributedFileSystem.java:)

     at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:)

     at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:)

     at org.apache.spark.scheduler.EventLoggingListener.start(EventLoggingListener.scala:)

     at org.apache.spark.SparkContext.<init>(SparkContext.scala:)

     at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:)

     at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:)

     at org.apache.spark.examples.streaming.NetworkWordCount$.main(NetworkWordCount.scala:)

     at org.apache.spark.examples.streaming.NetworkWordCount.main(NetworkWordCount.scala)

     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)

     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)

     at java.lang.reflect.Method.invoke(Method.java:)

     at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:)

     at org.apache.spark.deploy.SparkSubmit$.doRunMain$(SparkSubmit.scala:)

     at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:)

     at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:)

     at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

 Caused by: java.net.ConnectException: Connection refused

     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

     at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:)

     at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:)

     at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:)

     at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:)

     at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:)

     at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:)

     at org.apache.hadoop.ipc.Client$Connection.access$(Client.java:)

     at org.apache.hadoop.ipc.Client.getConnection(Client.java:)

     at org.apache.hadoop.ipc.Client.call(Client.java:)

     ...  more

 // :: INFO SparkUI: Stopped Spark web UI at http://192.168.19.131:4040

 // :: INFO DAGScheduler: Stopping DAGScheduler

 // :: INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!

 // :: INFO MemoryStore: MemoryStore cleared

 // :: INFO BlockManager: BlockManager stopped

 // :: INFO BlockManagerMaster: BlockManagerMaster stopped

 // :: INFO SparkContext: Successfully stopped SparkContext

 Exception in thread "main" java.net.ConnectException: Call From slaver1/192.168.19.131 to slaver1: failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

     at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:)

     at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:)

     at java.lang.reflect.Constructor.newInstance(Constructor.java:)

     at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:)

     at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:)

     at org.apache.hadoop.ipc.Client.call(Client.java:)

     at org.apache.hadoop.ipc.Client.call(Client.java:)

     at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:)

     at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)

     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)

     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)

     at java.lang.reflect.Method.invoke(Method.java:)

     at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:)

     at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:)

     at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)

     at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:)

     at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:)

     at org.apache.hadoop.hdfs.DistributedFileSystem$.doCall(DistributedFileSystem.java:)

     at org.apache.hadoop.hdfs.DistributedFileSystem$.doCall(DistributedFileSystem.java:)

     at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:)

     at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:)

     at org.apache.spark.scheduler.EventLoggingListener.start(EventLoggingListener.scala:)

     at org.apache.spark.SparkContext.<init>(SparkContext.scala:)

     at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:)

     at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:)

     at org.apache.spark.examples.streaming.NetworkWordCount$.main(NetworkWordCount.scala:)

     at org.apache.spark.examples.streaming.NetworkWordCount.main(NetworkWordCount.scala)

     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)

     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)

     at java.lang.reflect.Method.invoke(Method.java:)

     at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:)

     at org.apache.spark.deploy.SparkSubmit$.doRunMain$(SparkSubmit.scala:)

     at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:)

     at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:)

     at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

 Caused by: java.net.ConnectException: Connection refused

     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

     at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:)

     at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:)

     at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:)

     at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:)

     at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:)

     at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:)

     at org.apache.hadoop.ipc.Client$Connection.access$(Client.java:)

     at org.apache.hadoop.ipc.Client.getConnection(Client.java:)

     at org.apache.hadoop.ipc.Client.call(Client.java:)

     ...  more

 // :: INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!

 // :: INFO RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon.

 // :: INFO ShutdownHookManager: Shutdown hook called

 // :: INFO ShutdownHookManager: Deleting directory /tmp/spark-7ef5c2da-0b57--a9f9-6e215885c7ba

 // :: INFO RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports.

2、启动Spark的脚本命令：

[hadoop@slaver1 spark-1.5.1-bin-hadoop2.4]$ sbin/start-all.sh

[hadoop@slaver2 ~]$ run-example streaming.NetworkWordCount localhost 9999

exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused的更多相关文章

  1. java.net.ConnectException: Call From slaver1/192.168.19.128 to slaver1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org

    1:练习spark的时候,操作大概如我读取hdfs上面的文件,然后spark懒加载以后,我读取详细信息出现如下所示的错误,错误虽然不大,我感觉有必要记录一下,因为错误的起因是对命令的不熟悉造成的,错误 ...

  2. Caused by: java.net.ConnectException: Call From master/192.168.199.130 to master:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.

    1:安装好hive,准备启动的时候出现下面的错误(由于hive是基于Hadoop的,所以必须先将你的集群启动起来,我就是没有启动集群,直接启动hive导致的错误): [root@master bin] ...

  3. Call From master/192.168.128.135 to master:8485 failed on connection exception: java.net.ConnectException: Connection refused

    hadoop集群搭建了ha,初次启动正常,最近几天启动时偶尔发现,namenode1节点启动后一段时间(大约10几秒-半分钟左右),namenode1上namenode进程停掉,查看日志: -- :: ...

  4. Bad connection to FS. command aborted. exception: Call to chaoren/192.168.80.100:9000 failed on connection exception: java.net.ConnectException: Connection refused

    Bad connection to FS. command aborted. exception: Call to chaoren/192.168.80.100:9000 failed on conn ...

  5. 异常: Call From * 9000 failed on connection exception: java.net.ConnectException: Connection refused: no further information; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused

    场景: eclipse链接不上阿里云hadoop解决: 将hadoop的配置文件中的ip改为内网IP即可

  6. error: not found: value sqlContext/import sqlContext.implicits._/error: not found: value sqlContext /import sqlContext.sql/Caused by: java.net.ConnectException: Connection refused

    1.今天启动启动spark的spark-shell命令的时候报下面的错误,百度了很多,也没解决问题,最后想着是不是没有启动hadoop集群的问题 ,可是之前启动spark-shell命令是不用启动ha ...

  7. ls: Call From hdoop2/192.168.18.87 to hdoop2:8020 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see

    场景:  预发环境中,同事已经搭建了一套hadoop集群,由于版本与所需不符,所以需要替换版本 问题描述: 在配置文件都准确的情况下,启动hadoop,出现以下报错: 启动之前初始化:   初始化目录 ...

  8. Hadoop: failed on connection exception: java.net.ConnectException: Connection refuse

    ssh那些都已经搞了,跑一个书上的例子出现了Connection Refused异常,如下: 12/04/09 01:00:54 INFO ipc.Client: Retrying connect t ...

  9. Exception in thread "main" redis.clients.jedis.exceptions.JedisConnectionException: java.net.ConnectException: Connection refused (Connection refused)

    一.linux中配置redis,使用java连接测试时报错: Exception in thread "main" redis.clients.jedis.exceptions.J ...

随机推荐

  1. Learning Discriminative Features with Class Encoder

    近来论文看了许多,但没多少时间总结下来.今天暂时记录一篇比较旧的论文,选择理由是 Discriminative features. 做图像说白了就是希望有足够有判别性的特征,这样在分类或者匹配.检索的 ...

  2. js变量的解构赋值

    今天在学习时看到几段代码,让我感叹JS的灵活,特此一记: let stateObj = {a:1,b:3}; let newObj = {b:13,c:4} ; stateObj = {...stat ...

  3. 002_运维SOP

    一. <1>SOP:运维工作的标准化 <2>回滚:代码回滚 <3>降级:是利用有限资源,保障系统核心功能高可用.有损的架构方法 <4>多活切换:多机房切 ...

  4. selenium中，8种 find element 方法

    -*- coding;utf-8 -*- from selenium import webdriver dr = webdriver.Chrome() dr.get("https://www ...

  5. fpm定制化RPM包之nginx rpm包的制作

    fpm定制化RPM包之nginx rpm包的制作 1.安装ruby模块 # yum -y install ruby rubygems ruby-devel 2.添加阿里云的Rubygems仓库,国外资 ...

  6. T-SQL ORDER BY子句 排序方式

    MS SQL Server ORDER BY子句用于根据一个或多个列以升序或降序对数据进行排序. 默认情况下,一些数据库排序查询结果按升序排列. 语法 以下是ORDER BY子句的基本语法. SELE ...

  7. gstreamer

    Abstract Ogg Vorbis is a completely open, patent-free, professional audio encoding and streaming tec ...

  8. form表单公用

    <?php /** * 后台总控制器 */ namespace app\common\controller; use think\Controller; use app\common\servi ...

  9. hdu2602 Bone Collector 01背包

    Many years ago , in Teddy’s hometown there was a man who was called “Bone Collector”. This man like ...

  10. 彻底完全卸载 SQL Server 2005 的图文教程

    彻底完全卸载 SQL Server 2005 的图文教程 SQL SERVER 2005不象SERVER 2000所有组件都汇总在一起,所以卸载时特别麻烦,如果不按正常的方法卸载,重新安装是不可能安装 ...