chore : add pipelines, components in library, remove pyproject.toml

[EncHawk]

pyproject.toml was removed to include the repository into kubeflow-sdk as part of pipelines. it is followed here

the pipelines, components directories are included under a common library/ namespace, this is to ensure that import command contians library in the sdk as followed here.

issues : #80

Pre-Submission Checklist

• All tests and CI checks pass
• Pre-commit hooks pass without errors
• You have signed off your commits
• The title for your pull request (PR) should follow our title convention.
  Learn more about the pull request title convention used in this repository.

[google-oss-prow]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign mprahl for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[Copilot]

Pull request overview

Migrates this repository’s pipelines/components into a shared library/ namespace to support inclusion in the Kubeflow SDK (per issue #80 / kubeflow/sdk#125), and removes standalone packaging configuration.

Changes:

• Removed pyproject.toml (previous packaging/build configuration).
• Added library/components/* and library/pipelines/* package scaffolding (__init__.py) for category-based imports.
• Added an initial example component (yoda_data_processor) with metadata, owners, and unit/local-runner tests, plus a sample deployment component metadata/owners.

Reviewed changes

Copilot reviewed 1 out of 22 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
pyproject.toml	Removes project packaging/build metadata previously used for distribution.
library/pipelines/init.py	Adds top-level pipelines package initializer for the new library/ layout.
library/pipelines/training/init.py	Adds training pipelines namespace initializer.
library/pipelines/evaluation/init.py	Adds evaluation pipelines namespace initializer.
library/pipelines/data_processing/init.py	Adds data-processing pipelines namespace initializer.
library/pipelines/deployment/init.py	Adds deployment pipelines namespace initializer.
library/components/init.py	Adds top-level components package initializer for the new library/ layout.
library/components/training/init.py	Adds training components namespace initializer.
library/components/evaluation/init.py	Adds evaluation components namespace initializer.
library/components/data_processing/init.py	Adds data-processing components namespace initializer.
library/components/data_processing/README.md	Adds category-level README linking to the new component.
library/components/deployment/init.py	Adds deployment components namespace initializer.
library/components/deployment/component_valid/metadata.yaml	Adds sample component metadata for deployment category.
library/components/deployment/component_valid/OWNERS	Adds sample OWNERS for the deployment sample component.
library/components/data_processing/yoda_data_processor/component.py	Introduces the prepare_yoda_dataset KFP component implementation.
library/components/data_processing/yoda_data_processor/init.py	Re-exports the new component entrypoint.
library/components/data_processing/yoda_data_processor/metadata.yaml	Adds metadata for yoda_data_processor.
library/components/data_processing/yoda_data_processor/OWNERS	Adds owners for yoda_data_processor.
library/components/data_processing/yoda_data_processor/README.md	Adds component documentation for yoda_data_processor.
library/components/data_processing/yoda_data_processor/tests/init.py	Declares the tests package for the component.
library/components/data_processing/yoda_data_processor/tests/test_component_unit.py	Adds unit tests that mock HuggingFace datasets interactions.
library/components/data_processing/yoda_data_processor/tests/test_component_local.py	Adds a LocalRunner execution test for the component.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[mprahl]

@mprahl to review this

[EncHawk]

Hi @mprahl, could take a look at this