-
Notifications
You must be signed in to change notification settings - Fork 28.5k
[SPARK-2558][DOCS] Add --queue example to YARN doc #2218
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Put original YARN queue spark-submit arg description in running-on-yarn html table and example command line
Can one of the admins verify this patch? |
I just checked, Looks good. |
Jenkins, test this please |
QA tests have started for PR 2218 at commit
|
@@ -125,6 +125,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes | |||
the environment of the executor launcher. | |||
</td> | |||
</tr> | |||
<tr> | |||
<td><code>spark.yarn.queue</code></td> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This config is only supported in yarn client mode right now. Its more because of backwards compatibility and being able to pass it around in client mode then anything. In general you can use the spark-submit --queue option. If we want to make it available as a config then we should make it available in both modes.
So I would prefer to leave this config undocumented and tell people to use the --queue option until support for both modes is added.
QA tests have finished for PR 2218 at commit
|
Can one of the admins verify this patch? |
ok to test |
The title of this PR is now a little outdated. Can you update it to include |
QA tests have started for PR 2218 at commit
|
QA tests have finished for PR 2218 at commit
|
+1, thanks @kramimus! |
Put original YARN queue spark-submit arg description in
running-on-yarn html table and example command line