feat: support icu and language identifier tokenizer

[aoiasd]

relate: #41213

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 80.59%. Comparing base (afb1b85) to head (57abef2).
Report is 46 commits behind head on master.

Additional details and impacted files

@@             Coverage Diff             @@
##           master   #41214       +/-   ##
===========================================
+ Coverage   72.32%   80.59%    +8.26%     
===========================================
  Files         310     1475     +1165     
  Lines       28670   209720   +181050     
===========================================
+ Hits        20736   169021   +148285     
- Misses       7934    34578    +26644     
- Partials        0     6121     +6121     

Components	Coverage Δ
Client	79.59% <ø> (∅)
Core	72.32% <ø> (ø)
Go	82.01% <ø> (∅)

see 1165 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[sunby]

/lgtm

[congqixia]

/approve

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: aoiasd, congqixia

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• internal/core/OWNERS [congqixia]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment