[SPARK-3629] [YARN] [DOCS]: Improvement of the "Running Spark on YARN" document

[nssalian]

As per the description in the JIRA, I moved the contents of the page and added a few additional content.

[AmplabJenkins]

Can one of the admins verify this patch?

[nssalian]

@srowen, could you please review when you get the chance?

Thank you.

[srowen]

@nssalian you don't need me specifically to review it, but I can.

There was a previous pull request for this issue, and the feedback was that this diff doesn't expose what if anything you edited in the text? is it just a move, or also an edit? Ideally, if it's also an edit, you'd make two commits: one to edit and one to move. Then it's easy to browse the changes separately.

Overall I think it's still OK to honor Matei's request here and move the text, yes. I am not sure if the help text still needs updating, but that's beyond just a doc update right? I don't see that here. Maybe I missed the intent.

[nssalian]

@srowen makes sense. Made 2 commits to reflect the updates.
@mateiz, please let me know if there are any additional changes that need to go.

Thank you.

[mateiz]

Yeah, moving the text seems fine. I'm going to make a few small comments on the text itself.

[mateiz]

'the dfs' -> 'HDFS'

[nssalian]

@mateiz made the changes. Not sure about the master yarn sentence.
Please let me know what do you think about it.

Thank you.

[srowen]

--master yarn-cluster should be the same as --master yarn and --deploy-mode cluster. I thought the latter was less-used, and none of the examples show it on this page. Therefore how about removing this reference to --deploy-mode here?

[nssalian]

Makes sense. Changed it.

[srowen]

I think this looks pretty good; let's leave it open a day or so.
The rest of the changes were just moving text right? so the only text changes were addressing the master / yarn option docs, and formatting.

[nssalian]

That is correct. I moved the texts a few commits ago. The latter commits were just formatting and changing yarn.

[nssalian]

@mateiz, does this PR need any more changes?

Please let me know.
Thanks.

[srowen]

I've eyeballed the change again and looks like it's consistent with everyone's intentions. I'll merge after checking that docs build after this doc-only change.