a problem of Chinese coding

[yuydev]

[martindevans]

Could you please paste the characters that you typed here as text? I can't investigate the problem otherwise since I can't type those characters!

[yuydev]

你好--你好。我今天能为?????????么? used the UTF-8 character set ;

[yuydev]

你好--你好。我今天能为?????????么? used the UTF-8 character set ;

[AsakusaRinne]

are u using Baichuan model?

[yuydev]

uesd the ggml-vic13b-q5_1.bin

[yuydev]

[Jiahui-Young]

hello，are u fix this problem now？I meet the same problem. thx~

[AsakusaRinne]

hello，are u fix this problem now？I meet the same problem. thx~

Some time ago I met a case that the response went wrong when Chinese and English mixed in the prompt but it was okay when using pure Chinese as prompt. Could you please change the prompt to have a try?

[martindevans]

This should be fixed in LLamaSharp 0.7.0 for the StatelessExecutor (only the stateless executor, the others need more work). Can you confirm if it's fixed for you?

[chenzanyu]

InteractiveExecutor，I have the same problem, is there a solution

[martindevans]

Unfortunately no, not yet. Someone needs to go in and modify the InteractiveExecutor to use the new StreamingTokenDecoder.

[AsakusaRinne]

I've located as the problem as GB2312 encoding. I'll fix it soon with a partial refactor of the executor with StreamingTokenDecoder as Martin mentioned. And I'll appreciate for any help about it (next week I'll have some busy days). :)