The entire cleaned json is written as a single file, after completion

[Ran4]

It would be better to save it little by little (perhaps a few thousand lines at a time?).

[didriklundberg]

In my opinion it runs fast enough that this is not needed.