sqlparse.split can't split sqls correctly in one case

for example:

sqls2="grant insert,update,delete on test.test1 to lili@192.168.11.23; grant update,insert,select on test1.test2 to lili2@10.10.11.12;"
for st in sp.split(sqls2):
... print(st)
...
grant insert,update,delete on test.test1 to lili@192.168.11.23; grant update,insert,select on test1.test2 to lili2@10.10.11.12; ---------in one line still

sqls2="grant insert,update,delete on test.test1 to lili@192.%; grant update,insert,select on test1.test2 to lili2@10.10.11.12;"
for st in sp.split(sqls2):
... print(st)
...
grant insert,update,delete on test.test1 to lili@192.%;
grant update,insert,select on test1.test2 to lili2@10.10.11.12; ----have been splited into. two lines

the differnence between two sqls is :

first sqls2 : lili@192.168.11.23
second sqls2: lili@192.%

sqlparse version is:

print(sp.version)
0.4.1

[andialbrecht]

hm... I can't reproduce this issue:

>>> import sqlparse
>>> sqls2="grant insert,update,delete on test.test1 to lili@192.168.11.23; grant update,insert,select on test1.test2 to lili2@10.10.11.12;"
>>> for st in sqlparse.split(sqls2):
...     print(st)
...
grant insert,update,delete on test.test1 to lili@192.168.11.23;
grant update,insert,select on test1.test2 to lili2@10.10.11.12;
>>> print(len(sqlparse.split(sqls2)))
2
>>>

it doesn't work with ` backtick quotes.

import sqlparse
sqls2="grant insert,update,delete on test.test1 to lili@`192.168.11.23`; grant update,insert,select on test1.test2 to lili2@10.10.11.12;"
for st in sqlparse.split(sqls2):
... print(st)
...
grant insert,update,delete on test.test1 to lili@`192.168.11.23`; grant update,insert,select on test1.test2 to lili2@10.10.11.12;
print(len(sqlparse.split(sqls2)))
1

[andialbrecht]

ah! Thanks! They were eaten up by githubs markdown machinery 😋

[andialbrecht]

hm... but still not reproducable by me 🤔

>>> import sqlparse
>>> sqls2="grant insert,update,delete on test.test1 to lili@`192.168.11.23`; grant update,insert,select on test1.test2 to lili2@10.10.11.12;"
>>> for st in sqlparse.split(sqls2):
...     print(st)
...
grant insert,update,delete on test.test1 to lili@`192.168.11.23`;
grant update,insert,select on test1.test2 to lili2@10.10.11.12;
>>> print(len(sqlparse.split(sqls2)))
2

could you test with sqls2="grant insert,update,delete on `test`.`test1` to `lili`@`192.168.11.23`; grant update,insert,select on `test1`.`test2` to `lili2`@`10.10.11.12`;" ?

[andialbrecht]

Thanks! I can reproduce it with the statement above. Here's a little bit more simplified example:

>>> sqlparse.split("grant foo to user1@`myhost`; grant bar to user1@`myhost`;")
['grant foo to user1@`myhost`; grant bar to user1@`myhost`;']