Skip to content

Conversation

@bhji123
Copy link
Owner

@bhji123 bhji123 commented Jun 18, 2020

NOTICE

Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute

jlowe and others added 30 commits April 1, 2020 07:46
…pl. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Contributed by Bilwa S T.
…gurationStore. Contributed by Siddharth Ahuja
…orrupted) aggregated logs on the JobHistoryServer Web UI. Contributed by Siddharth Ahuja
…il against S3 (#1936)


Contributed by Steve Loughran.

This strips out all the -p preservation options which have already been
processed when uploading a file before deciding whether or not to query
the far end for the status of the (existing/uploaded) file to see if any
other attributes need changing.

This will avoid 404 caching-related issues in S3, wherein a newly created
file can have a 404 entry in the S3 load balancer's cache from the
probes for the file's existence prior to the upload.

It partially addresses a regression caused by HADOOP-8143,
"Change distcp to have -pb on by default" that causes a resurfacing
of HADOOP-13145, "In DistCp, prevent unnecessary getFileStatus call when
not preserving metadata"
… provide more diagnostics. Contributed by Siddharth Ahuja
…nside JobHistoryServer. Contributed by Siddharth Ahuja
#1945)

Reviewed-by: Takanobu Asanuma <tasanuma@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
ayushtkn and others added 29 commits June 5, 2020 19:15
…rnal directories in ViewFs. Contributed by Abhishek Das.
…rBandwidth should work with ViewFSOverloadScheme. Contributed by Ayush Saxena
…e>.impl classes in core-default.xml bydefault. Contributed by Uma Maheswara Rao G.
…t#testListStatusRootDir. Contributed by Ayush Saxena.
…6223 is already fixed. Contributed by Rungroj Maipradit
… contents. Contributed by Jon Eagles (jeagles)."

This reverts commit e2322e1.
…ring updatePipeline. Contributed by Ayush Saxena.

*Added missed test file.
Contributed by Steve Loughran.

S3A delegation token providers will be asked for any additional
token issuers, an array can be returned,
each one will be asked for tokens when DelegationTokenIssuer collects
all the tokens for a filesystem.
…ils before first heartbeat. Contributed by Eric Badger (ebadger).
…tent in the case of ViewFs implementation for isDirectory. Contributed by Uma Maheswara Rao G.
… other nodes in CandidateNodeSet for MultiNodePlacement. Contributed by Prabhu Joseph.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
…ssions. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
…e and AppNameMappingPlacementRule. Contributed by Gergely Pollak
Contributed by : Mehakmeet Singh

Co-authored-by: Rajesh Balamohan
Co-authored-by: Mehakmeet Singh
Contributed by Thomas Marquardt.

DETAILS:
1) The authentication version in the service has been updated from Dec19 to Feb20, so need to update the client.
2) Add support and test cases for getXattr and setXAttr.
3) Update DelegationSASGenerator and related to use Duration instead of int for time periods.
4) Cleanup DelegationSASGenerator switch/case statement that maps operations to permissions.
5) Cleanup SASGenerator classes to use String.equals instead of ==.

TESTS:
Added tests for getXAttr and setXAttr.

All tests are passing against my account in eastus2euap:

 $mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify
 Tests run: 76, Failures: 0, Errors: 0, Skipped: 0
 Tests run: 441, Failures: 0, Errors: 0, Skipped: 33
 Tests run: 206, Failures: 0, Errors: 0, Skipped: 24
@bhji123 bhji123 merged commit 84be348 into bhji123:trunk Jun 18, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.