-
Notifications
You must be signed in to change notification settings - Fork 9.1k
MAPREDUCE-7279. Adds RM host name to history server web page #2028
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: trunk
Are you sure you want to change the base?
Conversation
Change-Id: I59a467a49d417aa76548fb8e00f1582b09b9e041
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @Gaurangi94 for the contribution. I left a comment inline, can you help to resolve?
JHAdminConfig.MR_HISTORY_APPEND_RM_HOST_TO_HISTORY_FILE_NAME_ENABLED, | ||
JHAdminConfig.DEFAULT_MR_HISTORY_APPEND_RM_HOST_TO_HISTORY_FILE_NAME_ENABLED)) { | ||
|
||
String hostName = getConfig().get(YarnConfiguration.RM_HOSTNAME, ""); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If we don't config the yarn.resourcemanager.address
in client, how do we get the right address? And if enabled the federation feature, how can we ensure this?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If we don't config it, it will not show up on the UI.
Could you tell me what federation feature you are referring to?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I means the YARN Federation feature. As I know in the federation cluster has only one JobHistory server, but maybe has more YARN physical clusters.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I see that YARN federation feature can have multiple RMs.
I created a high availability cluster to check my changes, and noticed that one of the RMs (job-cluster-m-0) was listed as the host.
Is it safe to assume that YARN federation will behave similarly? Please note that I used Hadoop 3.2.1 to test this.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't think so. In federation cluster, the app can be routed to any physical cluster.
NOTICE
Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute