-
Notifications
You must be signed in to change notification settings - Fork 244
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
tispark 3.x version read speed is slower than tispark 2.5 #2573
Comments
I have found the reasion.It is because the v3.x version nowhere to call the 'StatisticsManager.loadStatisticsInfo' method,so the 'statisticsMap' in StatisticsManager is not filled, it cause inside the method 'TiStrategy.filterToDAGRequest'
User can set spark.tispark.plan.allow_index_read=false to avoid |
So sounds like it's a bug? |
tidb version is 5.4.2
spark version 3.0 to 3.2
tispark version 3.0 to 3.1
I used tispark2.5 before, but when i upgrade tispark version to 3.x ,I find it is slow when read tikv than tispark 2.5 version。
table info :
spark conf :
tispark 2.5:
tispark 3.x:
The text was updated successfully, but these errors were encountered: