Skip to content

Natural-Neighbour and Shapefile size limit #41

Open
@cpWWS

Description

@cpWWS

I am trying to run the natural-neighbour module in Saga 9.2 and ran into a block, which I assume is due to the size of the shapefile limit:

input is a set of points in gpkg format (about 200 million points)
output desired is a grid of 12000x12000 pixels.

The program (natural neighbour - same for thin plate) first saves the gpkg file into a shapefile into a temp directory.
I note that the program seems to proceed well but stays put at 100% complete and nothing seems to happen, even though the CPU and memory continue to operate - no error message is indicated in the log.

I tried to conver the gpkg file to a shapefile, but QGIS gives an error as the shapefile exceeds 4Gb.

Is there a solution? I wish Natural Neighbour could take multiple input point files, but that does not seem to be possible.
Perhaps I need to break up the problem into smaller grids and join them later... but that is not ideal (edges will need to be smoothed etc).

Perhaps eventually the gridding routines could be improved to handle such large datasets.

Any suggestion welcome.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions