[Feature] Support for request-level speculative decoding metrics monitoring.#5518

freeliuzc merged 4 commits into

PaddlePaddle:developPaddlePaddle/FastDeploy:developfrom

Deleter-D:dev_acc_ratioDeleter-D/FastDeploy:dev_acc_ratioCopy head branch name to clipboard