[Question]: Parsing is too slow and cannot be done in parallel

[y0ung-y]

Describe your problem

Is there a way to improve the parsing speed of documents？it is too slow, the gpu memory only ran more than 2GB
Can it be parsed in parallel？

[KevinHuSh]

You could start multiple task executors in docker container by python rag/svr/task_executor.py 1

[dassio]

You could start multiple task executors in docker container by python rag/svr/task_executor.py 1

it seems like the new executor will close after one file parsing is finished, how can i config it at startup ?

[KevinHuSh]

Increase the value of WS in entrypoint.sh.

[Ilyessbsf]

I increased the value of WS in entrypoint.sh but when parsing 1 file in 3 account at the same time, it doesnt process in parallel even with WS=3. Should I modify something else ?

[KevinHuSh]

Go into container and python rag/svr/task_executor.py 1,2,3...