Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE] native hdfs client for rust #1414

Closed
3 tasks done
Tracked by #1407
zuston opened this issue Jan 3, 2024 · 0 comments · Fixed by #1415
Closed
3 tasks done
Tracked by #1407

[FEATURE] native hdfs client for rust #1414

zuston opened this issue Jan 3, 2024 · 0 comments · Fixed by #1415

Comments

@zuston
Copy link
Member

zuston commented Jan 3, 2024

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

Describe the feature

hdfs-native is ready for production. Let's rock it

Motivation

No response

Describe the solution

No response

Additional context

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@zuston zuston mentioned this issue Jan 3, 2024
Merged
@zuston zuston linked a pull request Jan 3, 2024 that will close this issue
[#1414] feat(rust): introduce native hdfs client #1415
Merged
zuston added a commit that referenced this issue Jan 4, 2024
@zuston
[#1414] feat(rust): introduce native hdfs client (#1415)
602611c 
### What changes were proposed in this pull request?

Introduce hdfs-native crate as the native integration.

### Why are the changes needed?

For: #1414 

Native rust hdfs client could simplify the hadoop dependency and avoid JNI invoking cost.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Internal tests on Hadoop 3.1.2
@zuston zuston mentioned this issue Jan 4, 2024
Closed
17 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[#1414] feat(rust): introduce native hdfs client zuston/incubator-uniffle
1 participant
@zuston