Spark2.2出现异常：ERROR SparkUI: Failed to bind SparkUI

详细错误信息如下：

// :: INFO util.log: Logging initialized @5402ms
// :: INFO server.Server: jetty-9.3.z-SNAPSHOT
// :: INFO server.Server: Started @5604ms
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: WARN util.Utils: Service 'SparkUI' could not bind on port . Attempting port .
// :: ERROR ui.SparkUI: Failed to bind SparkUI
java.net.BindException: 地址已在使用: Service 'SparkUI' failed after  retries (starting from )! Consider explicitly setting the appropriate port for the service 'SparkUI' (for example spark.ui.port for SparkUI) to an available port or increasing spark.port.maxRetries.
        at sun.nio.ch.Net.bind0(Native Method)
        at sun.nio.ch.Net.bind(Net.java:)
        at sun.nio.ch.Net.bind(Net.java:)
        at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:)
        at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:)
        at org.spark_project.jetty.server.ServerConnector.open(ServerConnector.java:)
        at org.spark_project.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:)
        at org.spark_project.jetty.server.ServerConnector.doStart(ServerConnector.java:)
        at org.spark_project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:)
        at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$newConnector$(JettyUtils.scala:)
        at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$httpConnect$(JettyUtils.scala:)
        at org.apache.spark.ui.JettyUtils$$anonfun$.apply(JettyUtils.scala:)
        at org.apache.spark.ui.JettyUtils$$anonfun$.apply(JettyUtils.scala:)
        at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$.apply$mcVI$sp(Utils.scala:)
        at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:)
        at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:)
        at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:)
        at org.apache.spark.ui.WebUI.bind(WebUI.scala:)
        at org.apache.spark.SparkContext$$anonfun$.apply(SparkContext.scala:)
        at org.apache.spark.SparkContext$$anonfun$.apply(SparkContext.scala:)
        at scala.Option.foreach(Option.scala:)
        at org.apache.spark.SparkContext.<init>(SparkContext.scala:)
        at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:)
        at org.apache.spark.sql.SparkSession$Builder$$anonfun$.apply(SparkSession.scala:)
        at org.apache.spark.sql.SparkSession$Builder$$anonfun$.apply(SparkSession.scala:)
        at scala.Option.getOrElse(Option.scala:)
        at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:)
        at com.dx.b.streaming.domain.perf.SparkHelper.getAndConfigureSparkSession(SparkHelper.java:)
        at com.dx.b.streaming.Main.main(Main.java:)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)
        at java.lang.reflect.Method.invoke(Method.java:)
        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$(SparkSubmit.scala:)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

错误原因：

每一个Spark任务都会占用一个SparkUI端口，默认为4040，如果被占用则依次递增端口重试。但是有个默认重试次数，为16次。16次重试都失败后，会放弃该任务的运行。

解决方法

初始化SparkConf时，添加conf.set(“spark.port.maxRetries”,“100”)语句；使用spark-submit提交任务时，在命令行中添加-Dspark.port.maxRetries=100；在spark-defaults.conf中添加spark.port.maxRetries=100