error "Could not locate data" when adding a lot of files to dat.archive

[derhuerst]

This looks very similar to joehand/dat-next#122, but as suggested I'm cross-posting here, because I use dat-node directly.

In build-wikipedia-feed, I'm directly calling dat.archive.writeFile. It fails reproducibly after 128 pages with the following error:

Error: Could not locate data
    at /root/wiki-dumps/build-wikipedia-feed/node_modules/dat-storage/index.js:61:30
    at loop (/root/wiki-dumps/build-wikipedia-feed/node_modules/dat-storage/index.js:132:19)
    at /root/wiki-dumps/build-wikipedia-feed/node_modules/dat-storage/index.js:97:5
    at /root/wiki-dumps/build-wikipedia-feed/node_modules/hypercore/index.js:1107:5
    at onread (/root/wiki-dumps/build-wikipedia-feed/node_modules/random-access-file/index.js:130:14)
    at FSReqWrap.wrapper [as oncomplete] (fs.js:665:17)

[derhuerst]

turns out I already reported this once at holepunchto/hyperdrive#154 (comment) . also, the link to project-related #165 might be useful.

[derhuerst]

To give you more details, this is the full log with env 'DEBUG=*': errlog.txt