model is giving answer in russian

[Sanchit-404]

I coded an automatic pipeline to pass questions to the model. But the model is giving answers in russian. I tried manualprompting, the answer is still in russian.

Is there some paramter i need to change to get the answer in english.

[xjohnxjohn]

me too!

[Sanchit-404]

It gives english answers on some questions but russain for others. Is it some encoding mistake?

[skbaur]

Not sure if this has been discussed elsewhere, but I keep getting 100% russian answers (maybe from russian wikipedia) when I prompt only with an eos token. Could this be some issue with the training data?

Example output:

'</s> В Амурской области.\n\n## География\n\nРасположен в 10 км к юго-западу от районного центра.\n\n## История\n\nОснован в 1909 году. В 1926 году в посёлке имелось 10 хозяйств и проживало 49 человек (24 мужчины и 25 женщин). В национальном составе населения того периода пре'

[CrackerHax]

Same