Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support batch session limiter and user white list #3957

Closed
wants to merge 2 commits into from

Conversation

turboFei
Copy link
Member

@turboFei turboFei commented Dec 9, 2022

Why are the changes needed?

Support dedicated limiter for batch session.

Support user white list.

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before make a pull request

@turboFei turboFei changed the title Support batch session limiter and support user white list Support batch session limiter and user white list Dec 9, 2022
@turboFei turboFei force-pushed the batch_session_limiter branch 2 times, most recently from 73a0668 to 6aa11ef Compare December 9, 2022 15:18
@turboFei turboFei requested review from wForget and pan3793 December 9, 2022 15:21
@turboFei turboFei self-assigned this Dec 9, 2022
@turboFei turboFei added this to the v1.7.0 milestone Dec 9, 2022
@turboFei turboFei changed the title Support batch session limiter and user white list [WIP] Support batch session limiter and user white list Dec 10, 2022
@turboFei turboFei force-pushed the batch_session_limiter branch from 6aa11ef to 55db79e Compare December 10, 2022 08:01
@turboFei turboFei changed the title [WIP] Support batch session limiter and user white list Support batch session limiter and user white list Dec 10, 2022
@codecov-commenter
Copy link

Codecov Report

Merging #3957 (6aa11ef) into master (7aa3445) will decrease coverage by 0.01%.
The diff coverage is 96.00%.

❗ Current head 6aa11ef differs from pull request most recent head 55db79e. Consider uploading reports for the commit 55db79e to get more accurate results

@@             Coverage Diff              @@
##             master    #3957      +/-   ##
============================================
- Coverage     51.96%   51.94%   -0.02%     
  Complexity       13       13              
============================================
  Files           522      522              
  Lines         28870    28916      +46     
  Branches       3864     3866       +2     
============================================
+ Hits          15001    15021      +20     
- Misses        12498    12518      +20     
- Partials       1371     1377       +6     
Impacted Files Coverage Δ
...g/apache/kyuubi/session/KyuubiSessionManager.scala 94.02% <88.88%> (+0.75%) ⬆️
...in/scala/org/apache/kyuubi/config/KyuubiConf.scala 97.47% <100.00%> (-0.04%) ⬇️
...ala/org/apache/kyuubi/session/SessionLimiter.scala 82.14% <100.00%> (+4.87%) ⬆️
...client/exception/RetryableKyuubiRestException.java 0.00% <0.00%> (-100.00%) ⬇️
.../org/apache/kyuubi/client/RetryableRestClient.java 48.78% <0.00%> (-24.40%) ⬇️
.../kyuubi/server/mysql/constant/MySQLErrorCode.scala 13.84% <0.00%> (-6.16%) ⬇️
...ache/kyuubi/server/mysql/MySQLCommandHandler.scala 77.77% <0.00%> (-4.05%) ⬇️
...main/java/org/apache/kyuubi/client/RestClient.java 82.75% <0.00%> (-3.45%) ⬇️
...ache/kyuubi/server/mysql/MySQLGenericPackets.scala 76.59% <0.00%> (-2.13%) ⬇️
...rg/apache/kyuubi/ctl/cmd/log/LogBatchCommand.scala 60.00% <0.00%> (-1.54%) ⬇️
... and 7 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@turboFei turboFei closed this in e320179 Dec 12, 2022
@turboFei
Copy link
Member Author

thanks, merged to master

@turboFei turboFei deleted the batch_session_limiter branch December 12, 2022 04:32
kyuubi.server.info.provider|ENGINE|The server information provider name, some clients may rely on this information to check the server compatibilities and functionalities. <li>SERVER: Return Kyuubi server information.</li> <li>ENGINE: Return Kyuubi engine information.</li>|string|1.6.1
kyuubi.server.limit.connections.per.ipaddress|&lt;undefined&gt;|Maximum kyuubi server connections per ipaddress. Any user exceeding this limit will not be allowed to connect.|int|1.6.0
kyuubi.server.limit.connections.per.user|&lt;undefined&gt;|Maximum kyuubi server connections per user. Any user exceeding this limit will not be allowed to connect.|int|1.6.0
kyuubi.server.limit.connections.per.user.ipaddress|&lt;undefined&gt;|Maximum kyuubi server connections per user:ipaddress combination. Any user-ipaddress exceeding this limit will not be allowed to connect.|int|1.6.0
kyuubi.server.limit.connections.user.white.list||The maximin connections of the user in the white list will not be limited.|seq|1.7.0
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

white => unlimited

turboFei added a commit to turboFei/kyuubi that referenced this pull request Dec 12, 2022
turboFei added a commit that referenced this pull request Dec 12, 2022
…er list config

### _Why are the changes needed?_

Followup for #3957 comments

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #3963 from turboFei/unlimited_user.

Closes #3957

987b71f [fwang12] refactor
e0c6ca5 [fwang12] [KYUUBI #3957][FOLLOWUP] Refactor the session connection unlimited user list config

Authored-by: fwang12 <fwang12@ebay.com>
Signed-off-by: fwang12 <fwang12@ebay.com>
turboFei added a commit that referenced this pull request Feb 23, 2023
…batch.limit to kyuubi.server.limit.batch

### _Why are the changes needed?_

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #4398 from turboFei/rename_batch_limit.

Closes #3957

28228e4 [fwang12] 3957 followup
ef1ad6e [fwang12] save

Authored-by: fwang12 <fwang12@ebay.com>
Signed-off-by: fwang12 <fwang12@ebay.com>
turboFei added a commit to turboFei/kyuubi that referenced this pull request Feb 23, 2023
…erver.batch.limit to kyuubi.server.limit.batch
turboFei added a commit that referenced this pull request Feb 23, 2023
…rver.batch.limit to kyuubi.server.limit.batch

### _Why are the changes needed?_

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #4400 from turboFei/4398_1.7.

Closes #3957

66c0064 [fwang12] [KYUUBI #3957][FOLLOWUP] Rename the config prefix from kyuubi.server.batch.limit to kyuubi.server.limit.batch

Authored-by: fwang12 <fwang12@ebay.com>
Signed-off-by: fwang12 <fwang12@ebay.com>
turboFei added a commit that referenced this pull request Feb 23, 2023
…rver.batch.limit to kyuubi.server.limit.batch

### _Why are the changes needed?_

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #4400 from turboFei/4398_1.7.

Closes #3957

e12bd93 [fwang12] save
66c0064 [fwang12] [KYUUBI #3957][FOLLOWUP] Rename the config prefix from kyuubi.server.batch.limit to kyuubi.server.limit.batch

Authored-by: fwang12 <fwang12@ebay.com>
Signed-off-by: fwang12 <fwang12@ebay.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants