-
Couldn't load subscription status.
- Fork 574
Add --checkforupdates argument, hipBLAS autopicking and hipBLAS .kcpps bug fixes #571
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add --checkforupdates argument, hipBLAS autopicking and hipBLAS .kcpps bug fixes #571
Conversation
When importing a .kcpps file with the backend Use hipBLAS chosen, it would not select Use hipBLAS. This change corrects that
If enabled, the argument --checkforupdates will fetch the KoboldCpp release page one time on start up via HTTPS and compare the latest version number with the current version number and notify the user if a new version is available. A GUI button is shown on the Network tab.
since sometimes/most of the time AMD GPU info is fetched with OpenCL, requiring ``CUDevicesNames[0]!=""`` prevents hipBLAS from being selected. Only check ``CUDevicesNames[0]!=""`` if Use CuBLAS in runopts
|
can I modify this to grab the fix PR for the HIPBlas bug fixes first? I'm not so sure about the update checking stuff cause:
|
1fa014b to
c05d195
Compare
|
Cherry picked the HIPBlas fixes in 852ca78 |
The reason I made the check for updates argument was because the update button doesn't change color or notify when an update is available. I thought it only needed urllib3 added? Whats the second dependency? |
urllib is fine as it's part of the default actually, the extra ones are
ah probably because I added and merged the specific changes as a patch instead of a whole commit. If you'd like, you can resubmit the changes as a separate PR and I'll merge that so you get the contrib. |
0617bd8 to
e2e8da0
Compare
When importing a .kcpps file with the backend Use hipBLAS chosen, it would not select Use hipBLAS. This change corrects that.
If enabled, the argument --checkforupdates will fetch the KoboldCpp release page(via Github API) one time on start up via HTTPS and compare the latest version number with the current version number and notify the user if a new version is available.
A GUI button is shown on the Network tab. Disabled by default.
Fixed a mistake preventing hipBLAS from being autopicked on startup