zoekt-git-index too many branches error

[simonsmh]

[backend] | Error: Command failed: zoekt-git-index -allow_missing_branches -index /data/.sourcebot/index -file_limit 2097152 -branches * /data/.sourcebot/repos/ URL
[backend] | 2024/12/26 06:46:24 indexGitRepo(/data/.sourcebot/repos/\.git, delta=false): build.NewBuilder: too many branches

``

[brendan-kellam]

Heya - how many branches are you indexing? iirc, zoekt can index a maximum of 64 branches

[simonsmh]

Above 64. What about making separate indexes? Or just make index of 1-64 branches instead of error.

[brendan-kellam]

Are you wanting to search across more than 64 branches? Or are you using a glob pattern so a ton of branches are getting included?

I would need to dig through the zoekt codebase a bit, but I imagine it could get tricky to support >64 branches (afaik, a uint64 is used as a bitmask to represent what files appear in which branches. See here).

Making separate indexes per 64 branch chunk is interesting - I will test that out and see if it's possible without overriding existing indexes.

[thespad]

As an example: https://github.com/linuxserver/docker-mods/, currently clocking in at an unwieldy 99 branches.

A use case here would be something like "Search all branches for Dockerfiles where the FROM is a given image"