spark on yarn(ERROR client.TransportClient: Failed to send RPC)
2017-04-05 22:01
881 查看
主要是给节点分配的内存少，yarn kill了spark application。
给yarn-site.xml增加配置：
<property>
<name>yarn.nodemanager.pmem-check-enabled</name>
<value>false</value>
</property>
<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
</property>
重启hadoop。然后再重新提交spark application即可。
给yarn-site.xml增加配置：
<property>
<name>yarn.nodemanager.pmem-check-enabled</name>
<value>false</value>
</property>
<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
</property>
重启hadoop。然后再重新提交spark application即可。
内容来自用户分享和网络整理，不保证内容的准确性，如有侵权内容，可联系管理员处理 
相关文章推荐
- 【Flume】Rpc sink XX closing Rpc client:NettyAvroRpcClient {xx} …… Failed to send events 问题解决
- [RPC Fault faultString="Send failed" faultCode="Client.Error.MessageSend" faultDetail="Channel.Connect.Failed error NetC
- AJAX请求在微信环境报错：NetworkError: Failed to execute 'send' on 'XMLHttpRequest': Failed to load
- 【Flume】Rpc sink XX closing Rpc client:NettyAvroRpcClient {xx} …… Failed to send events 问题解决
- [RPC Fault faultString="Send failed" faultCode="Client.Error.MessageSend" faultDetail="Channel.Connect.Failed error NetConnectio
- [RPC Fault faultString="Send failed" faultCode="Client.Error.MessageSend" faultDetail="Channel.Connect.Failed error NetC
- [RPC Fault faultString="Send failed" faultCode="Client.Error.MessageSend"
- RPC Fault faultString="Send failed" faultCode="Client.Error.MessageSend"
- RPC Fault faultString="Send failed" faultCode="Client.Error.MessageSend" 解决方案
- Android project on Eclipse: Type Conversion to Dalvik format failed with error 1
- How to Check RPC over HTTP Connection Status on Outlook Client
- 解决 ERROR: JDWP Transport dt_socket failed to initialize, TRANSPORT_INIT(510)异常
- 在Eclipse中运行Android程序报 Failed to write core dump. Minidumps are not enabled by default on client versions of Windows 解决方法
- 真机上 Android error: Failed to install *.apk on device *: timeout
- faultCode:Client.Error.MessageSend faultString:'Send failed' faultDetail:'Channel.Connect.Failed error NetConnection.Call.Failed
- Android:Android Failed to install HelloWorld.apk on device (null) Error
- VMWare虚拟机实例拷贝到另一台服务器后出现Error in the RPC receive loop: RpcIn: Unable to send.错误的解决
- JDWP了解 与解决 ERROR: JDWP Transport dt_socket failed to initialize, TRANSPORT_INIT(510)异常
- ASP.NET development server failed to start listening on port (dynamic port) & Error Unable to connect to Visual Stutio's localhost web server
- 解决 ERROR: JDWP Transport dt_socket failed to initialize, TRANSPORT_INIT(510)异常