in verbose mode could you include the token position and character position in the sentence as well?
e.g. given "Hello World", "Hello" is at token position 1 (assuming starting at 0), and character position 6. This shouldn't impact performance and would help to eliminate some processing in the wordmap lexer.
in verbose mode could you include the token position and character position in the sentence as well?
e.g. given "Hello World", "Hello" is at token position 1 (assuming starting at 0), and character position 6. This shouldn't impact performance and would help to eliminate some processing in the wordmap lexer.