Skip to content

Adaption of kernel optimizer#279

Merged
David-Kreplin merged 21 commits intosQUlearn:developfrom
DennisKleinhans:adaption-of-kernel-optimizer
Sep 6, 2024
Merged

Adaption of kernel optimizer#279
David-Kreplin merged 21 commits intosQUlearn:developfrom
DennisKleinhans:adaption-of-kernel-optimizer

Conversation

@DennisKleinhans
Copy link
Collaborator

  • The KernelOptimizer extends the KernelMatrixBase so that it can be used as a kernel in the high-level methods.
  • The KernelOptimizer now accepts a KernelMatrix, a loss function and an optimizer.
  • The KernelOptimizer automatically optimizes the provided KernelMatrix when the fit method is called by checking the is_trainable property.

closes #274

Copy link
Collaborator

@David-Kreplin David-Kreplin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work so far! I've added only minor remarks.
Could you also please add a small testjob for the kernel optimizer

MoritzWillmann and others added 3 commits July 12, 2024 09:29
- Implement parameterized tests for regression and classification high-level classes.
- Note: Classification tests are not fully complete due to "LinAlgError: 17-th leading minor of the array is not positive definite" during Cholesky decomposition.
- Further investigation and fixes needed to ensure the matrix is always positive definite.
@David-Kreplin
Copy link
Collaborator

I did some adjustments, maybe you can check them @MoritzWillmann

@David-Kreplin David-Kreplin marked this pull request as draft August 15, 2024 15:18
@David-Kreplin
Copy link
Collaborator

I’ll take it from here. Most of the work looks great, but there are a few specifics that are a bit tedious to explain and fix, such as regularization.

@David-Kreplin David-Kreplin marked this pull request as ready for review August 16, 2024 13:30
@David-Kreplin David-Kreplin merged commit 7b6c981 into sQUlearn:develop Sep 6, 2024
@DennisKleinhans DennisKleinhans deleted the adaption-of-kernel-optimizer branch September 9, 2024 12:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants