Skip to content

Is the context loaded into VRAM or RAM? Will a 24GB 4090 be able to handle 128K context? #173

aimms321 started this conversation in General
Discussion options

You must be logged in to vote

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants