[infer] Support infer cache impl#7150

Jintao-Huang wants to merge 2 commits intomodelscope:mainmodelscope/ms-swift:mainfrom

Jintao-Huang:support_infer_cache_implJintao-Huang/llmscope:support_infer_cache_implCopy head branch name to clipboard