One of Direct Replies behind Question Classifier is alway exported on the top of regular LLM answer.

[mikegong]

Self Checks

• This is only for bug report, if you would like to ask a question, please head to Discussions.
• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• Please do not modify this template :) and fill in all the required fields.

Dify version

0.8

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Create a Question Classifier with 3 Classes, 2 of them are direct reply and one will go to LLM. Even the Classifier decided the class to LLM but one of the Direct Reply will respone first and then LLM answer will be displayed. If the showed Direct Reply is removed, then the other Direct Reply will be showed first and then LLM answer.

✔️ Expected Behavior

LLM answer only instead of mixed answer.

❌ Actual Behavior

Direct Reply is always displayed even the class that Question Classifier decided is other one.

[dosubot]

@mikegong Hello! I'm here to assist you with any bugs, questions, or contributions. Feel free to ask for help while waiting for a human maintainer.

The issue you're experiencing with Direct Replies always being displayed first, even when the Question Classifier decides the class should go to the LLM, is due to the annotated replies feature. When this feature is enabled, the system vectorizes the user's question and searches for similar annotated questions. If a match is found, the corresponding answer from the annotation is returned directly, bypassing the LLM or RAG process ^[1][2].

To achieve the expected behavior where only the LLM answer is displayed, you may need to disable or adjust the annotated replies feature. This will ensure that the Question Classifier's decision to route the question to the LLM is respected without being overridden by direct replies.

To continue talking to Dosu, mention @dosu.

[crazywoola]

Duplicated, please upgrade to v0.8.1. Fixed in #8225