Skip to content

Opt #40

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Opt #40

wants to merge 4 commits into from

Conversation

kaselby
Copy link
Contributor

@kaselby kaselby commented Jun 24, 2025

Description

Adds support for OPT. As this model is significantly different than the others, this requires a new cpp kernel and weight cache. I'd appreciate if this could be looked over by someone with more experience in this area than me, as I am not sure I implemented this in the most elegant way possible.

kaselby added 4 commits June 23, 2025 10:10
Signed-off-by: Kira Selby <kaselby@uwaterloo.ca>
Signed-off-by: Kira Selby <kaselby@uwaterloo.ca>
Signed-off-by: Kira Selby <kaselby@uwaterloo.ca>
Signed-off-by: Kira Selby <kaselby@uwaterloo.ca>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant