spark on yarn :state: ACCEPTED一直 出现
今天运行spark on yarn 一直出现
16/09/20 18:40:41 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:42 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:43 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:44 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:45 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:46 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:47 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:48 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:49 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:50 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:51 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:52 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:53 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:54 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:55 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:56 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:57 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:58 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:40:59 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:00 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:01 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:02 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:03 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:04 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:05 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:06 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:07 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:08 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:09 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:10 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:11 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
16/09/20 18:41:12 INFO yarn.Client: Application report for application_1474179312027_0002 (state: ACCEPTED)
不知道是 什么问题,on yarn 上也没有日志提示。
spark on yarn :state: ACCEPTED一直 出现的更多相关文章
- spark跑YARN模式或Client模式提交任务不成功(application state: ACCEPTED)
不多说,直接上干货! 问题详情 电脑8G,目前搭建3节点的spark集群,采用YARN模式. master分配2G,slave1分配1G,slave2分配1G.(在安装虚拟机时) export SPA ...
- spark跑YARN模式或Client模式提交任务不成功(application state: ACCEPTED)(转)
不多说,直接上干货! 问题详情 电脑8G,目前搭建3节点的spark集群,采用YARN模式. master分配2G,slave1分配1G,slave2分配1G.(在安装虚拟机时) export SPA ...
- spark利用yarn提交任务报:YARN application has exited unexpectedly with state UNDEFINED
spark用yarn提交任务会报ERROR cluster.YarnClientSchedulerBackend: YARN application has exited unexpectedly w ...
- Spark on Yarn遇到的问题及解决思路
原文:http://www.aboutyun.com/thread-9425-1-1.html 问题导读1.Connection Refused可能原因是什么?2.如何判断内存溢出,该如何解决?扩展: ...
- Spark on YARN模式的安装(spark-1.6.1-bin-hadoop2.6.tgz + hadoop-2.6.0.tar.gz)(master、slave1和slave2)(博主推荐)
说白了 Spark on YARN模式的安装,它是非常的简单,只需要下载编译好Spark安装包,在一台带有Hadoop YARN客户端的的机器上运行即可. Spark on YARN简介与运行wor ...
- spark on yarn模式里需要有时手工释放linux内存
为什么要提出这个问题? spark跑YARN模式或Client模式提交任务不成功(application state: ACCEPTED) 然后执行 [spark@master spark--bin- ...
- spark on yarn,client模式时,执行spark-submit命令后命令行日志和YARN AM日志
[root@linux-node1 bin]# ./spark-submit \> --class com.kou.List2Hive \> --master yarn \> --d ...
- spark on yarn,cluster模式时,执行spark-submit命令后命令行日志和YARN AM日志
[root@linux-node1 bin]# ./spark-submit \> --class com.kou.List2Hive \> --master yarn \> --d ...
- Spark通过YARN提交任务不成功(包含YARN cluster和YARN client)
无论用YARN cluster和YARN client来跑,均会出现如下问题. [spark@master spark-1.6.1-bin-hadoop2.6]$ jps 2049 NameNode ...
随机推荐
- C语言的面向对象设计 —— 对 X264/FFMPEG 架构探讨
1.为什么要用C语言 直到今天,C语言虽然不是使用人数最多的语言了,但是C没有老去,在很多的核心系统代码里,依然跑的是设计精美的C,绝大多数的嵌入式开发核心库软件是C开发的,多数标准算法是基于标准C设 ...
- Android项目能运行,上传svn后再下载却不能运行
今天遇到一个比较奇怪的问题,android项目上传到svn之前,可以运行,但是上传到svn后再check, 就出错. 搜索了一下,发现真的解决了问题. svn 不知道是出于什么原因,不能上传.so文件 ...
- node.js实践第二天
使用Express框架搭建一个网站 1.安装Express 首先要用全局模式安装Express,因为只有这样才能在命令行中使用它.使用下述命令在伪dos命令窗口安装express. $ npm ins ...
- Linux下 输入 env 而得到的环境变量解读
HOSTNAME=Master.Hadoop MAHOUT_HOME=/usr/hadoop/mahout-distribution-0.8 TERM=linux SHELL=/bin/bash HA ...
- SQL创建/修改数据库、表
--创建表 create table 表(a1 varchar(10),a2 char(2)) --为表添加描述信息 EXECUTE sp_addextendedproperty N'MS_Descr ...
- 使用FMDB,libqrencode实现二维码的生成并且保存到数据库
/** * 1.首先导入第三方库FMDB和libqrencode,添加库libsqlite3.tbd
- [jquery] 图片热区随图片大小自由缩放
在图片上直接画出带超级链接热区元素map和area相信大家并不陌生,Dreamweaver等网页制作软件都有直接在图片上绘制带超级链接的热区工具,但是直接绘制的热区是不能随着图片自适应放大和缩小的,现 ...
- (Access denied for user 'root'@'localhost' (using password: NO))
先记一下遇到的问题: 项目使用mySql服务器,用户名密码正常,权限齐全,mySql服务已启动,但运行java web程序时显示: 目前正在解决 解决方案: 1.打开MySQL目录下的my.ini文件 ...
- 2015.4.16-SQL-内连接与外连接
1.内连接 如图: 关键字 inner join 2.外连接 分为左外连接 和右外连接,即如果是左外连接,即使左面没有值,也会显示为null, 右外连接也如此 关键字 left join ; righ ...
- Win7 64位 php+Apache+mysql 配置
注明:此文转载至 http://www.cnblogs.com/isyouth/p/3778045.html 一 :准备阶段 1:php php下载链接:http://windows.php.net/ ...