Skip to content

increase the default max Cholesky size to 50000#117

Open
kayween wants to merge 1 commit intocornellius-gp:mainfrom
kayween:increase-max-cholesky-size
Open

increase the default max Cholesky size to 50000#117
kayween wants to merge 1 commit intocornellius-gp:mainfrom
kayween:increase-max-cholesky-size

Conversation

@kayween
Copy link
Collaborator

@kayween kayween commented Nov 26, 2025

as titled

@kayween kayween linked an issue Nov 26, 2025 that may be closed by this pull request
@gpleiss
Copy link
Member

gpleiss commented Nov 26, 2025

50000 seems like too much for older GPUs. Is there some way we could try 50000, and then adjust if we get OOM errors?

@kayween
Copy link
Collaborator Author

kayween commented Nov 26, 2025

Sounds reasonable. I will put together a prototype and update this PR.

@Balandat
Copy link
Collaborator

Also, lots of people run stuff on CPU and so we definitely want to be careful about cranking the size up too much by default...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Inference] The Default Threshold for Cholesky Decomposition

3 participants