KEP-2839: Kubeflow Dynamic LLM Trainer Framework

[Electronic-Waste]

What you would like to be added?

I would like to add Kubeflow Dynamic LLM Trainer Framework to:

1. Streamline LLM Fine-tuning on Kubernetes with a simple yet efficient Python SDK
2. Allow dynamic and extensible registration of popular post-training frameworks
3. Make it possible for day0&day1 model support

Google Doc: http://bit.ly/4nyrQS8 (work in progress)

Upstream KEP: #2401

Appreciate your feedbacks! @kubeflow/kubeflow-trainer-team @kubeflow/kubeflow-sdk-team @deepanker13 @saileshd1402 @seanlaii @helenxie-bit @varshaprasad96 @franciscojavierarceo @thesuperzapper @rimolive @juliusvonkohout @jbottum @varodrig @Doris-xm

Why is this needed?

Coming from #2752, we decided to adopt the plan 3 after several rounds of discussions.

Love this feature?

Give it a 👍 We prioritize the features with most 👍

[Electronic-Waste]

/remove-label lifecycle/needs-triage
/area llm

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[github-actions]

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

[andreyvelich]

/reopen
/remove-lifecycle stale
/good-first-issue

We are looking for contributors to pick-up this proposal.

[google-oss-prow]

@andreyvelich: Reopened this issue.

Details

In response to this:

/reopen
/remove-lifecycle stale
/good-first-issue

We are looking for contributors to pick-up this proposal.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.