Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE] Support limit maximum scan file size #4641

Closed
3 of 4 tasks
wForget opened this issue Mar 31, 2023 · 1 comment
Closed
3 of 4 tasks

[FEATURE] Support limit maximum scan file size #4641

wForget opened this issue Mar 31, 2023 · 1 comment
Labels
kind:feature Feature request priority:major

Comments

@wForget
Copy link
Member

wForget commented Mar 31, 2023

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

Describe the feature

I want to reject large queries by limiting the size of scanned files.

Motivation

When using a shared engine, large queries take up more resources and block other queries.

Describe the solution

Refer to the implementation of maxPartitions in watchdog

Additional context

No response

Are you willing to submit PR?

  • Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
  • No. I cannot submit a PR at this time.
@wForget wForget mentioned this issue Mar 31, 2023
Closed
3 tasks
@bowenliang123
Copy link
Contributor

Nice work on this rule for maximum scanned file size.
Is it possible to promote this feature for limiting the total size of the data which is about to be written? @wForget

beryllw pushed a commit to beryllw/incubator-kyuubi that referenced this issue Jan 11, 2024
@wForget
[Backport][KYUUBI apache#4641] Add MaxFileSizeStrategy to limit max s…
421e2f3 
…can file size
beryllw pushed a commit to beryllw/incubator-kyuubi that referenced this issue Jan 11, 2024
Merge branch 'branch-1.4.0' into 'branch-1.4.0'
6a5b7ad 
[Backport][KYUUBI apache#4641] Add MaxFileSizeStrategy to limit max scan file size

See merge request !24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind:feature Feature request priority:major
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[KYUUBI #4641] Add MaxFileSizeStrategy to limit max scan file size wForget/kyuubi
2 participants
@bowenliang123 @wForget