Skip to content

Conversation

@uranusjr
Copy link
Member

They are either changed to SerializedBaseOperator or the SDK BaseOperator. If this works, we can work on combining the scheduler BaseOperator into SerializedBaseOperator, and remove SDK BaseOperator base references in the scheduler.

@uranusjr uranusjr force-pushed the remove-baseoperator-from-core branch 14 times, most recently from 3862cd8 to d297979 Compare June 30, 2025 05:58
@uranusjr uranusjr added the log exception Set the label if you want to accept change with caplog label Jun 30, 2025
@uranusjr uranusjr closed this Jun 30, 2025
@uranusjr uranusjr reopened this Jun 30, 2025
@uranusjr uranusjr force-pushed the remove-baseoperator-from-core branch 7 times, most recently from 2c48445 to d51aeab Compare July 2, 2025 06:14
@uranusjr uranusjr force-pushed the remove-baseoperator-from-core branch 2 times, most recently from 33883e1 to 77fee4c Compare July 2, 2025 07:06
@uranusjr uranusjr requested review from kaxil and removed request for jscheffl July 7, 2025 06:10
@kaxil kaxil added the full tests needed We need to run full set of tests for this PR to merge label Jul 7, 2025
Copy link
Member

@kaxil kaxil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good on high-level but want to look at the s10n changes more closely.

cc @ashb @amoghrajesh - More eyes will help here.

@kaxil kaxil force-pushed the remove-baseoperator-from-core branch from 9e1c268 to 14598c4 Compare July 7, 2025 20:35
@kaxil
Copy link
Member

kaxil commented Jul 7, 2025

(rebased on main to get latest changes & running with full-tests now)

@ashb
Copy link
Member

ashb commented Jul 8, 2025

I want to take a look at what the serialized Dag JSON looks like with this change too.

@uranusjr uranusjr force-pushed the remove-baseoperator-from-core branch 3 times, most recently from 6423b6b to 7f9c6f7 Compare July 10, 2025 05:25
@uranusjr
Copy link
Member Author

Serialised dag JSON does not change; this only removes the JSON → SerializedBaseOperator part; the SDK operator → JSON part is not affected.

@uranusjr uranusjr force-pushed the remove-baseoperator-from-core branch from 7f9c6f7 to 94cc204 Compare July 10, 2025 06:16
@uranusjr uranusjr requested review from ashb and kaxil July 10, 2025 07:09
@uranusjr uranusjr force-pushed the remove-baseoperator-from-core branch 2 times, most recently from 5e3b5e4 to 1400861 Compare July 10, 2025 07:39
@uranusjr uranusjr force-pushed the remove-baseoperator-from-core branch from 1400861 to 4172002 Compare July 10, 2025 15:23
They are either changed to SerializedBaseOperator or the SDK
BaseOperator. If this works, we can work on combining the scheduler
BaseOperator into SerializedBaseOperator, and remove SDK BaseOperator
base references in the scheduler.

Scheduler BaseOperator is now removed entirely since
SerializedBaseOperator is all that's needed in the scheduler.

Furthermore, SerializedBaseOperator no longer inherits from the SDK
BaseOperator, so in the future we can separate the two inheritance tree
entirely.
@uranusjr uranusjr force-pushed the remove-baseoperator-from-core branch from 4172002 to 39ab2e9 Compare July 11, 2025 17:30
@uranusjr uranusjr merged commit 379c478 into apache:main Jul 12, 2025
195 of 196 checks passed
@uranusjr uranusjr deleted the remove-baseoperator-from-core branch July 12, 2025 05:18
stephen-bracken pushed a commit to stephen-bracken/airflow that referenced this pull request Jul 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:API Airflow's REST/HTTP API area:serialization area:task-sdk full tests needed We need to run full set of tests for this PR to merge log exception Set the label if you want to accept change with caplog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants