Data produced by crawler should be public

[sebbalex]

Data produced by crawler are stored server side and CircleCI on each commit tries to rsync them to make a fresh and aligned build. When PR comes from external branch CCI doesn't set env vars for security reasons and that rsync will fail. Data are used to create page/card which are public thus we should consider to publish them too. This will allow us to have a more simplified CI pipeline and will simplify local testing too.

@alranel @libremente

[libremente]

What do you mean by "publish them"? @sebbalex

[sebbalex]

What do you mean by "publish them"? @sebbalex

we could think to serve them under a static folder in webserver

[libremente]

👍

[libremente]

Let's serve the public folder via nginx @sebbalex