You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For the very long term, it could be nice to have a way to refresh data dumps, ideally in a incremental fashion. Currently, dumps have to be downloaded, parsed and uploaded and that data get outdated with the past of the time.
The best approach will be to have a smart DB and some periodical scripts that add to that database the downloaded data. Something like InfluxDB can serve as an inspiration.
Another simpler approach is to just have some scripts that periodically download the data, processes it, upload to the DATA_DIR folder and restart WikiChron automatically. Note that it can be tricky to make them incremental and that downloading and processing large wikis can take a lot of time.
The text was updated successfully, but these errors were encountered:
For the very long term, it could be nice to have a way to refresh data dumps, ideally in a incremental fashion. Currently, dumps have to be downloaded, parsed and uploaded and that data get outdated with the past of the time.
The best approach will be to have a smart DB and some periodical scripts that add to that database the downloaded data. Something like InfluxDB can serve as an inspiration.
Another simpler approach is to just have some scripts that periodically download the data, processes it, upload to the DATA_DIR folder and restart WikiChron automatically. Note that it can be tricky to make them incremental and that downloading and processing large wikis can take a lot of time.
The text was updated successfully, but these errors were encountered: