Provide resources attribute in KubernetesPodOperator to be templated

[nitinmuteja]

Description

Make resources in KubernetesPodOperator as templated. We need to modify this during several runs and it needs code change for each run.

Use case/motivation

For running CPU and memory intensive workloads, we want to continuously optimise the "limt_cpu" and "limit_memory" parameters. Hence, we want to provide these parameters as a part of the pipeline definition.

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[talnagar]

we would love to get this feature!

[potiuk]

@nitinmuteja -> I assigned you - also maybe @talnagar you could take a stab at it - it seems like an easy first contribution

[nitinmuteja]

Created PR #23531 .

[alanatlemba]

Would be great to get this feature. @potiuk / @nitinmuteja seems it got stuck a few months back. I'm relatively new to Airflow (only a couple of years of Python experience, million years of experience in C# prior), and wouldn't mind sinking some time into it (not a ton).

[potiuk]

Feel free to add it @alanatlemba - you do not need much experience for that and we can point out any improvement areas while reviewing

[alanatlemba]

@potiuk @jedcunningham finally got around to this. Sorry about the long wait - life got in the way.

This is my first PR for a mainstream large scale open source project, let alone Airflow.
Sorry in advance if I've done anything improper, and thanks for your patience.