Closed
Description
jflex 1.9.0 is out and
jflex-de/jflex#203
got fixed and jflex now introduces:
(jflex-de/jflex#197 jflex-de/jflex#1045 )
%token_size_limit (<identifier>|<number>)
which makes the workaround of manually patching generated lexical scanner obsolete,
though I see @vladak removed it ?!?!?
d051e17
(I don't see 1.8 fixes it ... )
so it needs to be set where applicable so OpenGrok is in sync with lucene limits and their tokenizers
also jflex-de/jflex#542 is fixed so https://github.com/oracle/opengrok/blob/master/pom.xml#L348
can be cleaned up