Skip to content

Performance for df.items and other iterators #1598

@devin-petersohn

Description

@devin-petersohn

Looping over the Modin dataframe is slow when you use df.items and other iterators. Part of this is because we are still materializing the data in the driver. This does not scale.

Since we have better indexing performance, we should take advantage of that here.

Metadata

Metadata

Labels

Performance 🚀Performance related issues and pull requests.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions