Add default cluster flow control implementation #294

sczyh30 · 2018-12-10T05:55:43Z

Describe what this PR does / why we need it

Add default cluster flow control implementation.

Does this pull request fix one issue?

Closes #293

Also related to #207

Describe how you did it

// TBD: detailed design and description notes

Architecture overview (transport):

Describe how to verify it

See test cases and demo.

Special notes for reviews

This is a very large PR containing features of multiple modules. It's NOT a good idea to submit such a large PR, but it's hard to separate this into small branches.

codecov-io · 2018-12-13T16:25:50Z

Codecov Report

Merging #294 into master will decrease coverage by 7.55%.
The diff coverage is 2.84%.

@@             Coverage Diff              @@
##             master     #294      +/-   ##
============================================
- Coverage     45.78%   38.23%   -7.56%     
- Complexity      921      930       +9     
============================================
  Files           181      219      +38     
  Lines          5753     6921    +1168     
  Branches        832      939     +107     
============================================
+ Hits           2634     2646      +12     
- Misses         2787     3941    +1154     
- Partials        332      334       +2

Impacted Files	Coverage Δ	Complexity Δ
...tinel/slots/statistic/metric/MetricsLeapArray.java	`100% <ø> (ø)`	`3 <0> (ø)`	⬇️
...p/sentinel/slots/statistic/metric/ArrayMetric.java	`64.28% <ø> (ø)`	`20 <0> (ø)`	⬇️
...ster/server/codec/data/FlowResponseDataWriter.java	`0% <0%> (ø)`	`0 <0> (?)`
...luster/server/codec/netty/NettyRequestDecoder.java	`0% <0%> (ø)`	`0 <0> (?)`
...luster/flow/statistic/ClusterMetricStatistics.java	`0% <0%> (ø)`	`0 <0> (?)`
...ter/server/processor/RequestProcessorProvider.java	`0% <0%> (ø)`	`0 <0> (?)`
...l/cluster/server/log/ClusterServerStatLogUtil.java	`0% <0%> (ø)`	`0 <0> (?)`
...mmand/handler/FetchClusterServerConfigHandler.java	`0% <0%> (ø)`	`0 <0> (?)`
...ster/server/config/ClusterServerConfigManager.java	`0% <0%> (ø)`	`0 <0> (?)`
...ster/server/codec/DefaultResponseEntityWriter.java	`0% <0%> (ø)`	`0 <0> (?)`
... and 151 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 512b27b...465b44b. Read the comment docs.

- Add a universal `TokenService` SPI interface for both local flow control and distributed flow control - Add TokenResult entity to represents result of acquiring token - Add `ClusterTokenClient` as the SPI interface for client of Sentinel cluster flow control Signed-off-by: Eric Zhao <sczyh16@gmail.com>

- Add new field `clusterMode` and `clusterConfig` for cluster mode - Add a `ClusterFlowConfig` class for specific items for cluster flow control - Update FlowRuleChecker to support cluster mode - Extract valid rule checking and rule map generating logic to FlowRuleUtil Signed-off-by: Eric Zhao <sczyh16@gmail.com>

…util class - Update ParamFlowRule to support cluster mode - Add `ParamFlowClusterConfig` to provide cluster mode items for the rule - Update ParamFlowChecker to support cluster flow mode - Extract ParamFlowRuleUtil class - Change type of `flowId` from Integer to Long Signed-off-by: Eric Zhao <sczyh16@gmail.com>

- Add a `ClusterTransportClient` for transport abstraction of Sentinel cluster - Add universal request/response interface and common ClusterRequest/ClusterResponse abstraction - Add common request/response data entity - Add basic abstraction of codec (EntityWriter and EntityDecoder) Signed-off-by: Eric Zhao <sczyh16@gmail.com>

- Add Netty transport client implementation and default cluster token client - Add config manager for cluster client - Add codec SPI mechanism for client entity decoder / writer Signed-off-by: Eric Zhao <sczyh16@gmail.com>