token length incorrect using --latin1 option

[chrismshelton]

The template files assume UTF-8 in the alex_scan_tkn function, even when the --latin1 option is given.

In templates/GenericTemplate.hs:

alex_scan_tkn user orig_input (if c < 0x80 || c >= 0xC0 then PLUS(len,ILIT(1)) else len)

This leads to an incorrect length being given to the lexer actions for tokens containing bytes between 0x80 and 0xC0

[hvr]

do you happen to have a small test-case for this?

[chrismshelton]

Sorry, my bad, now that I'm trying to come up with a test case I can't reproduce the error