YARN-11505. [Federation] Add Steps To Set up a Test Cluster. #5751
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
💔 -1 overall
This message was automatically generated. |
goiri
reviewed
Jun 15, 2023
|
|
||
| | Machine | Role | | ||
| |:----------|:--------------| | ||
| | Machine A | RM1\NM1\ZK1 | | |
There was a problem hiding this comment.
Thank you very much for your help in reviewing the code! I will improve this paragraph.
|
|
||
| Example of Machine-Role Mapping(Exclude HDFS): | ||
|
|
||
| | Machine | Role | |
There was a problem hiding this comment.
Warning blank at the end of the line.
| </property> | ||
|
|
||
| <!-- | ||
| This configuration option is used to specify the configuration file for FairScheduler. |
There was a problem hiding this comment.
Fix all the end of line blank warnings.
|
|
||
| After we have finished configuring the `YARN-2` cluster, we can proceed with starting the `YARN-2` cluster. | ||
|
|
||
| ### ROUTER |
There was a problem hiding this comment.
Should we use capitals? Probably better "Router"
There was a problem hiding this comment.
I will modify it to Router.
| The purpose of this document is to help users quickly set up a testing environment for YARN Federation. With this testing environment, users can utilize the core functionality of YARN Federation. This is the simplest test cluster setup (based on Linux) with only essential configurations (YARN non-HA mode). We require 3 machines, and each machine should have at least <4C, 8GB> of resources. We only cover YARN configuration in this document. For information on configuring HDFS and ZooKeeper, please refer to other documentation sources. | ||
|
|
||
| Test Environment Description: | ||
| - We need to build a HDFS test environment, this part can refer to HDFS documentation. |
There was a problem hiding this comment.
I will add the setup HDFS link.
| Test Environment Description: | ||
| - We need to build a HDFS test environment, this part can refer to HDFS documentation. | ||
| - We need two YARN clusters, each YARN cluster has one RM and one NM, The RM and NM on the same node. | ||
| - We need one ZK cluster(We only need one ZooKeeper node.), this part can refer to Zookeeper documentation. |
There was a problem hiding this comment.
The parenthesis needs proper capitalization and the period at the end is weird.
Add link to the ZooKeeper setup.
|
🎊 +1 overall
This message was automatically generated. |
goiri
approved these changes
Jun 16, 2023
|
🎊 +1 overall
This message was automatically generated. |
|
@goiri Thank you very much for your help in reviewing the code! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description of PR
JIRA: YARN-11505. [Federation] Add Steps To Set up a Test Cluster.
According to the current YARN Federation documentation, users have difficulties setting up a test cluster (due to too many configurations that are needed). This JIRA will improve the documentation so that users can quickly set up a YARN Federation test cluster by following the steps in the documentation.
We can check this link:
https://issues.apache.org/jira/secure/attachment/13059110/Federation-v2-1.png
How was this patch tested?
For code changes:
LICENSE,LICENSE-binary,NOTICE-binaryfiles?