[SPARK-29112][YARN] Expose more details when ApplicationMaster reporter faces a fatal exception

[LantaoJin]

What changes were proposed in this pull request?

In ApplicationMaster.Reporter thread, fatal exception information is swallowed. It's better to expose it.
We found our thrift server was shutdown due to a fatal exception but no useful information from log.

19/09/16 06:59:54,498 INFO [Reporter] yarn.ApplicationMaster:54 : Final app status: FAILED, exitCode: 12, (reason: Exception was thrown 1 time(s) from Reporter thread.)
19/09/16 06:59:54,500 ERROR [Driver] thriftserver.HiveThriftServer2:91 : Error starting HiveThriftServer2
java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2$.main(HiveThriftServer2.scala:160)
at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.main(HiveThriftServer2.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$4.run(ApplicationMaster.scala:708)

Does this PR introduce any user-facing change?

No

How was this patch tested?

Manual test

[LantaoJin]

@jerryshao Could you have a time to review?

[wangyum]

ok to test

[SparkQA]

Test build #110741 has finished for PR 25810 at commit 8b14afe.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[wangyum]

add to whitelist

[LantaoJin]

retest this please

[SparkQA]

Test build #110766 has finished for PR 25810 at commit 8b14afe.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #110763 has finished for PR 25810 at commit 8b14afe.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[jerryshao]

+1

[jerryshao]

Jenkins, retest this please.

[SparkQA]

Test build #110856 has finished for PR 25810 at commit 8b14afe.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[jerryshao]

LGTM, merging to master branch.