Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[R-Forge #4649] fread files with more than 4 billion rows #570

Open
arunsrinivasan opened this issue Jun 8, 2014 · 2 comments
Open

[R-Forge #4649] fread files with more than 4 billion rows #570

arunsrinivasan opened this issue Jun 8, 2014 · 2 comments
Labels

Comments

@arunsrinivasan
Copy link
Member

Submitted by: Roby Joehanes; Assigned to: Nobody; R-Forge link

I have a huge table with 4+ billion rows. fread has an integer overflow problem and only read about 73M rows.

@mattdowle mattdowle added this to the v1.9.6 milestone Oct 25, 2014
@mattdowle
Copy link
Member

This will need data.table itself to support more than 2 billion rows.
But the integer overflow when counting rows should be caught in the meantime.

@mattdowle
Copy link
Member

The integer overflow at 2bn is now caught by e15facd.
Pushing supporting for >2bn rows to v1.9.8

@mattdowle mattdowle modified the milestones: v1.9.8, v1.9.6 Nov 15, 2014
@arunsrinivasan arunsrinivasan modified the milestones: v2.0.0, v1.9.8 Mar 8, 2016
@mattdowle mattdowle removed this from the Candidate milestone May 10, 2018
@jangorecki jangorecki added the longvec Long Vector support label Jan 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants