HDFS-16173.Improve CopyCommands#Put#executor queue configurability. #3302

jianghuazhu · 2021-08-13T12:01:56Z

NOTICE

Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute

jianghuazhu · 2021-08-13T12:25:48Z

There are some exceptions in CI/CD:
1.org.jenkinsci.plugins.workflow.steps.MissingContextVariableException: Required context class hudson.FilePath is missing
Perhaps you forgot to surround the code with a step that provides this, such as: node
2.java.nio.file.FileSystemException: /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-3302: Read-only file system
It seems to be related to the jenkins environment.

jianghuazhu · 2021-08-16T01:52:37Z

@aajisaka , can you help review the code I submitted.
thank you very much.

jianghuazhu · 2021-08-17T01:54:00Z

@jojochuang, @virajjasani, can you help review the code.
If there are some imperfections, welcome to communicate, and I will work hard to promote improvement.
thank you very much.

ayushtkn

Need to update the newly added param in FileSystemShell.md as well

jianghuazhu · 2021-08-17T05:57:40Z

@ayushtkn , thanks for your comment. I will continue to improve.

virajjasani

+1 (non-binding), thanks @jianghuazhu

jianghuazhu · 2021-08-17T07:30:55Z

Thanks @virajjasani for the comment.

ferhui · 2021-08-18T01:49:33Z

@jianghuazhu Thanks for contribution! @virajjasani Thanks for review!

hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommands.java

hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md

ayushtkn · 2021-08-18T06:28:22Z

hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommands.java

+        if (parsedValue < 1) {
+          threadPoolQueueSize = 1024;


Better to add a warn log line here, to denote the thread pool queue size was misconfigured and we are now using the default.

Thanks @ayushtkn for the comment.
I will make some changes later.

hadoop-yetus · 2021-08-18T07:36:00Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 41s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	markdownlint	0m 0s		markdownlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	32m 54s		trunk passed
+1 💚	compile	28m 23s		trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	compile	23m 53s		trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	checkstyle	1m 12s		trunk passed
+1 💚	mvnsite	1m 46s		trunk passed
+1 💚	javadoc	1m 15s		trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javadoc	1m 50s		trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	spotbugs	2m 53s		trunk passed
+1 💚	shadedclient	20m 50s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	1m 6s		the patch passed
+1 💚	compile	27m 51s		the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javac	27m 51s		the patch passed
+1 💚	compile	24m 22s		the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	javac	24m 22s		the patch passed
-1 ❌	blanks	0m 1s	/blanks-eol.txt	The patch has 1 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1 💚	checkstyle	1m 9s		the patch passed
+1 💚	mvnsite	1m 49s		the patch passed
+1 💚	javadoc	1m 11s		the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javadoc	1m 51s		the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	spotbugs	2m 53s		the patch passed
+1 💚	shadedclient	16m 34s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	17m 44s	/patch-unit-hadoop-common-project_hadoop-common.txt	hadoop-common in the patch passed.
+1 💚	asflicense	0m 52s		The patch does not generate ASF License warnings.
		212m 53s

Reason	Tests
Failed junit tests	hadoop.cli.TestCLI

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/4/artifact/out/Dockerfile
GITHUB PR	#3302
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell markdownlint
uname	Linux dd64c000cc47 4.15.0-136-generic #140-Ubuntu SMP Thu Jan 28 05:20:47 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / c4387749221e1d1c5259acad51a9b217f4321a36
Default Java	Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/4/testReport/
Max. process+thread count	3125 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/4/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2021-08-18T10:20:03Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	1m 35s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	markdownlint	0m 0s		markdownlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	31m 35s		trunk passed
-1 ❌	compile	17m 52s	/branch-compile-root-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt	root in trunk failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.
+1 💚	compile	18m 30s		trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	checkstyle	1m 7s		trunk passed
+1 💚	mvnsite	1m 37s		trunk passed
+1 💚	javadoc	1m 9s		trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javadoc	1m 41s		trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	spotbugs	2m 24s		trunk passed
+1 💚	shadedclient	15m 51s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 56s		the patch passed
+1 💚	compile	20m 33s		the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
-1 ❌	javac	20m 33s	/results-compile-javac-root-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt	root-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 generated 200 new + 1720 unchanged - 0 fixed = 1920 total (was 1720)
+1 💚	compile	18m 28s		the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	javac	18m 28s		the patch passed
-1 ❌	blanks	0m 0s	/blanks-eol.txt	The patch has 1 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1 💚	checkstyle	1m 6s		the patch passed
+1 💚	mvnsite	1m 38s		the patch passed
+1 💚	javadoc	1m 6s		the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javadoc	1m 41s		the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	spotbugs	2m 33s		the patch passed
+1 💚	shadedclient	16m 6s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	17m 6s	/patch-unit-hadoop-common-project_hadoop-common.txt	hadoop-common in the patch passed.
+1 💚	asflicense	0m 58s		The patch does not generate ASF License warnings.
		176m 25s

Reason	Tests
Failed junit tests	hadoop.cli.TestCLI

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/5/artifact/out/Dockerfile
GITHUB PR	#3302
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell markdownlint
uname	Linux f683d58fe1e6 4.15.0-136-generic #140-Ubuntu SMP Thu Jan 28 05:20:47 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / 9a4658a6c0b3abc8eae85dd213a2ee78f0a609d9
Default Java	Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/5/testReport/
Max. process+thread count	3152 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/5/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2021-08-19T06:22:18Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	53m 29s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 3s		codespell was not available.
+0 🆗	markdownlint	0m 3s		markdownlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	41m 6s		trunk passed
+1 💚	compile	30m 31s		trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	compile	19m 23s		trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	checkstyle	0m 59s		trunk passed
+1 💚	mvnsite	1m 32s		trunk passed
+1 💚	javadoc	1m 1s		trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javadoc	1m 34s		trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	spotbugs	2m 27s		trunk passed
+1 💚	shadedclient	18m 12s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 56s		the patch passed
+1 💚	compile	23m 5s		the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javac	23m 5s		the patch passed
+1 💚	compile	20m 13s		the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	javac	20m 13s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 59s		the patch passed
+1 💚	mvnsite	1m 45s		the patch passed
+1 💚	javadoc	1m 23s		the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javadoc	1m 49s		the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	spotbugs	2m 38s		the patch passed
+1 💚	shadedclient	18m 50s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	20m 29s	/patch-unit-hadoop-common-project_hadoop-common.txt	hadoop-common in the patch passed.
+1 💚	asflicense	0m 51s		The patch does not generate ASF License warnings.
		263m 57s

Reason	Tests
Failed junit tests	hadoop.cli.TestCLI

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/6/artifact/out/Dockerfile
GITHUB PR	#3302
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell markdownlint
uname	Linux 673e639c01ad 4.15.0-153-generic #160-Ubuntu SMP Thu Jul 29 06:54:29 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / 7abf2a2b408e129c0c0c577bc6cf7aa18e18cf54
Default Java	Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/6/testReport/
Max. process+thread count	2282 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/6/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

jianghuazhu · 2021-08-19T08:08:12Z

Some exceptions occurred here, related to UT:
hadoop.cli.TestCLI
But it has nothing to do with the code I submitted.

ayushtkn · 2021-08-19T08:18:31Z

hmm,
Not sure why the Test Result Link is also not working for most PRs:
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/6/testReport/

@jojochuang are you aware of some thread/jira disabling it?

jianghuazhu · 2021-08-25T09:07:48Z

@ayushtkn , thanks for your help.
I don't know if this PR request can be merged into the trunk branch. If can, can you help me deal with it?
thank you very much. (I'm not sure if I should make such request.)

jojochuang · 2021-08-25T09:32:35Z

@jianghuazhu could you help verify TestCLI isn't broken by this change? We'll have to verify it manually. Thanks.

jianghuazhu · 2021-08-25T09:49:34Z

Thanks @jojochuang for the comment. I will continue to work.

aajisaka · 2021-08-25T12:28:16Z

hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommands.java

+    }
+
+    @VisibleForTesting
+    public int getThreadPoolQueueSize() {


This method can be package-private

Thanks @aajisaka for the suggestion, I will continue to work.

hadoop-yetus · 2021-08-26T09:28:48Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	1m 9s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	markdownlint	0m 0s		markdownlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 2 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	29m 58s		trunk passed
+1 💚	compile	22m 14s		trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	compile	19m 18s		trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	checkstyle	1m 1s		trunk passed
+1 💚	mvnsite	1m 36s		trunk passed
+1 💚	javadoc	1m 7s		trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javadoc	1m 40s		trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	spotbugs	2m 25s		trunk passed
+1 💚	shadedclient	15m 59s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 57s		the patch passed
+1 💚	compile	21m 28s		the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javac	21m 28s		the patch passed
+1 💚	compile	19m 0s		the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	javac	19m 0s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	1m 6s		the patch passed
+1 💚	mvnsite	1m 35s		the patch passed
+1 💚	xml	0m 1s		The patch has no ill-formed XML file.
+1 💚	javadoc	1m 6s		the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚	javadoc	1m 46s		the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚	spotbugs	2m 32s		the patch passed
+1 💚	shadedclient	16m 7s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	17m 16s		hadoop-common in the patch passed.
+1 💚	asflicense	0m 56s		The patch does not generate ASF License warnings.
		181m 6s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/7/artifact/out/Dockerfile
GITHUB PR	#3302
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell markdownlint xml
uname	Linux 790bd14567a1 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `80bb9d8`
Default Java	Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/7/testReport/
Max. process+thread count	1282 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3302/7/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

jianghuazhu · 2021-08-26T09:45:20Z

@jojochuang , I'm very sorry, I previously overlooked a hidden detail in testConf.xml. I have solved it now.
Can you help review again.
thank you very much.

jojochuang · 2021-08-27T03:39:29Z

+1 we're good to go. Thanks @jianghuazhu !

…3302) Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local> Reviewed-by: Hui Fei <ferhui@apache.org> Reviewed-by: Viraj Jasani <vjasani@apache.org> (cherry picked from commit 4c94831)

…3302) Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local> Reviewed-by: Hui Fei <ferhui@apache.org> Reviewed-by: Viraj Jasani <vjasani@apache.org> (cherry picked from commit 4c94831) (cherry picked from commit 7c66304)

…3302) Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local> Reviewed-by: Hui Fei <ferhui@apache.org> Reviewed-by: Viraj Jasani <vjasani@apache.org> (cherry picked from commit 4c94831) (cherry picked from commit 7c66304) (cherry picked from commit dac74b0)

…pache#3302) Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local> Reviewed-by: Hui Fei <ferhui@apache.org> Reviewed-by: Viraj Jasani <vjasani@apache.org>

jianghuazhu force-pushed the HDFS-16173 branch from 0d05d96 to cb5b634 Compare August 13, 2021 12:14

ayushtkn reviewed Aug 17, 2021

View reviewed changes

jianghuazhu force-pushed the HDFS-16173 branch from cb5b634 to 9870dda Compare August 17, 2021 06:11

virajjasani approved these changes Aug 17, 2021

View reviewed changes

ferhui approved these changes Aug 18, 2021

View reviewed changes

jojochuang reviewed Aug 18, 2021

View reviewed changes

hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommands.java Outdated Show resolved Hide resolved

jojochuang reviewed Aug 18, 2021

View reviewed changes

hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md Outdated Show resolved Hide resolved

jianghuazhu force-pushed the HDFS-16173 branch from 9870dda to c438774 Compare August 18, 2021 04:01

ayushtkn reviewed Aug 18, 2021

View reviewed changes

jianghuazhu force-pushed the HDFS-16173 branch from c438774 to 9a4658a Compare August 18, 2021 07:21

jianghuazhu force-pushed the HDFS-16173 branch from 9a4658a to 7abf2a2 Compare August 19, 2021 01:56

aajisaka reviewed Aug 25, 2021

View reviewed changes

HDFS-16173.Improve CopyCommands#Put#executor queue configurability.

80bb9d8

jianghuazhu force-pushed the HDFS-16173 branch from 7abf2a2 to 80bb9d8 Compare August 26, 2021 06:26

jojochuang merged commit 4c94831 into apache:trunk Aug 27, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HDFS-16173.Improve CopyCommands#Put#executor queue configurability. #3302

HDFS-16173.Improve CopyCommands#Put#executor queue configurability. #3302

jianghuazhu commented Aug 13, 2021 •

edited by aajisaka

Loading

jianghuazhu commented Aug 13, 2021

jianghuazhu commented Aug 16, 2021

jianghuazhu commented Aug 17, 2021

ayushtkn left a comment

jianghuazhu commented Aug 17, 2021

virajjasani left a comment

jianghuazhu commented Aug 17, 2021

ferhui commented Aug 18, 2021

ayushtkn Aug 18, 2021

jianghuazhu Aug 18, 2021

hadoop-yetus commented Aug 18, 2021

hadoop-yetus commented Aug 18, 2021

hadoop-yetus commented Aug 19, 2021

jianghuazhu commented Aug 19, 2021

ayushtkn commented Aug 19, 2021

jianghuazhu commented Aug 25, 2021

jojochuang commented Aug 25, 2021

jianghuazhu commented Aug 25, 2021

aajisaka Aug 25, 2021

jianghuazhu Aug 26, 2021

hadoop-yetus commented Aug 26, 2021

jianghuazhu commented Aug 26, 2021 •

edited

Loading

jojochuang commented Aug 27, 2021

HDFS-16173.Improve CopyCommands#Put#executor queue configurability. #3302

HDFS-16173.Improve CopyCommands#Put#executor queue configurability. #3302

Conversation

jianghuazhu commented Aug 13, 2021 • edited by aajisaka Loading

NOTICE

jianghuazhu commented Aug 13, 2021

jianghuazhu commented Aug 16, 2021

jianghuazhu commented Aug 17, 2021

ayushtkn left a comment

Choose a reason for hiding this comment

jianghuazhu commented Aug 17, 2021

virajjasani left a comment

Choose a reason for hiding this comment

jianghuazhu commented Aug 17, 2021

ferhui commented Aug 18, 2021

ayushtkn Aug 18, 2021

Choose a reason for hiding this comment

jianghuazhu Aug 18, 2021

Choose a reason for hiding this comment

hadoop-yetus commented Aug 18, 2021

hadoop-yetus commented Aug 18, 2021

hadoop-yetus commented Aug 19, 2021

jianghuazhu commented Aug 19, 2021

ayushtkn commented Aug 19, 2021

jianghuazhu commented Aug 25, 2021

jojochuang commented Aug 25, 2021

jianghuazhu commented Aug 25, 2021

aajisaka Aug 25, 2021

Choose a reason for hiding this comment

jianghuazhu Aug 26, 2021

Choose a reason for hiding this comment

hadoop-yetus commented Aug 26, 2021

jianghuazhu commented Aug 26, 2021 • edited Loading

jojochuang commented Aug 27, 2021

jianghuazhu commented Aug 13, 2021 •

edited by aajisaka

Loading

jianghuazhu commented Aug 26, 2021 •

edited

Loading