Skip to content

Optimize rebuildIndex memory allocation #517

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 0 commits into from

Conversation

Axlgrep
Copy link

@Axlgrep Axlgrep commented Oct 27, 2023

  1. The current data_level0_memory_ continuous memory block design can result in memory doubling during large index resize, which is very unfriendly to memory and performance(the realloc operation may trigger an expensive data copy action),so we redesigned data_level0_memory_ (using multiple small memory blocks linked together).
  2. In addition, we found some obvious _mm_prefetch out-of-bounds access issues and fixed them (there may be other hidden issues, please check them as well).

#510

@Axlgrep Axlgrep force-pushed the optimize_memory_allocation branch from d8c300f to 67fb961 Compare July 11, 2024 12:23
@Axlgrep Axlgrep closed this Jul 11, 2024
@Axlgrep Axlgrep force-pushed the optimize_memory_allocation branch from 67fb961 to c1b9b79 Compare July 11, 2024 12:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant