Skip to content

Conversation

@LiuLi1998
Copy link
Contributor

@LiuLi1998 LiuLi1998 commented Jun 3, 2025

FIX: #19056

@github-actions
Copy link

github-actions bot commented Jun 3, 2025

👋 Hi! Thank you for contributing to the vLLM project.

💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels.

Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can either: Add ready label to the PR or enable auto-merge.

🚀

@LiuLi1998 LiuLi1998 changed the title [Bug]: Hermes tool parser stream output error in Qwen3 case #19056 [BugFix]: Hermes tool parser stream output error in Qwen3 case #19056 Jun 3, 2025
@LiuLi1998 LiuLi1998 force-pushed the dev/qwen3_hermes branch 2 times, most recently from 0013ae8 to e01da93 Compare June 3, 2025 08:18
@LiuLi1998
Copy link
Contributor Author

@aarnphm Could you please review the code, thanks.

@mergify mergify bot added the qwen Related to Qwen models label Jun 19, 2025
@LiuLi1998 LiuLi1998 changed the title [BugFix]: Hermes tool parser stream output error in Qwen3 case #19056 [BugFix]: Hermes tool parser stream output error #19056 Jul 25, 2025
@qq745639151
Copy link

qq745639151 commented Aug 18, 2025

我尝试了下这个修复,使用langchain进行模型请求,流式输出情况下,偶尔会输出如下字段:
iNdEx {"name": "tool_9d5e7cec5025417b86d2ecb860787761", "arguments": {"query": "2025年6月1日各地区的电力负荷数据"}} </tool_call> 。

模型使用的是千问2.5-14b

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

frontend qwen Related to Qwen models tool-calling

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

[Bug]: Hermes tool parser stream output error in Qwen3 case

3 participants