Cleanup metadata with batch size and interval

[turboFei]

Why are the changes needed?

Cleanup metadata with batch size and interval to prevent hold the lock for long time if the metadata size is huge.

How was this patch tested?

GA.

Was this patch authored or co-authored using generative AI tooling?

No.

[codecov-commenter]

Codecov Report

❌ Patch coverage is 0% with 41 lines in your changes missing coverage. Please review.
✅ Project coverage is 0.00%. Comparing base (f7e10e6) to head (37e82cc).

Files with missing lines	Patch %	Lines
...pache/kyuubi/server/metadata/MetadataManager.scala	0.00%	19 Missing ⚠️
...in/scala/org/apache/kyuubi/config/KyuubiConf.scala	0.00%	9 Missing ⚠️
...yuubi/server/metadata/jdbc/JDBCMetadataStore.scala	0.00%	9 Missing ⚠️
.../apache/kyuubi/server/metadata/MetadataStore.scala	0.00%	2 Missing ⚠️
...ubi/server/metadata/jdbc/JdbcDatabaseDialect.scala	0.00%	2 Missing ⚠️

Additional details and impacted files

@@          Coverage Diff           @@
##           master   #7176   +/-   ##
======================================
  Coverage    0.00%   0.00%           
======================================
  Files         701     701           
  Lines       43565   43601   +36     
  Branches     5911    5917    +6     
======================================
- Misses      43565   43601   +36     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.