Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Export failing for a form with 250K records #923

Open
ukanga opened this issue Feb 15, 2017 · 2 comments · Fixed by #922
Open

Export failing for a form with 250K records #923

ukanga opened this issue Feb 15, 2017 · 2 comments · Fixed by #922
Assignees
@ukanga @faith-mutua
Labels
Error Has-PR Module: Exports Performance

Comments

@ukanga
Copy link
Member

ukanga commented Feb 15, 2017 •
edited by imkingrobi
Loading

Results in a segmentation fault and running out of memory
@ukanga ukanga added this to the Week 8 milestone Feb 15, 2017
@ukanga ukanga mentioned this issue Feb 15, 2017
Merged
@ukanga ukanga added the Has-PR label Feb 15, 2017
@ukanga ukanga self-assigned this Feb 16, 2017
@skambo skambo reopened this Mar 2, 2017
@skambo skambo modified the milestones: Week 12, Week 8 Mar 2, 2017
@skambo
Copy link
Contributor

skambo commented Mar 2, 2017

CSV exports and Excel exports are downloaded, but the files are blank, issue needs more looking into ( on a dataset of about 600k records)

@skambo
Copy link
Contributor

skambo commented Mar 6, 2017

From @ukanga temporary workaround to this issue is using the filtered dataset for export, each of these datasets with less than 200k submissions should allow you to export all your data, albeit in multiple files.

@ukanga ukanga modified the milestone: Week 14 Apr 10, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ukanga ukanga

@faith-mutua faith-mutua

Labels
Error Has-PR Module: Exports Performance
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Export optimization, using a queryset iterator to reduce memory usage onaio/onadata
3 participants
@ukanga @skambo @faith-mutua