docs(task-sdk): reorganize landing page into six core sections #52196
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Closed
sunank200
force-pushed
the
task-sdk-docs-concepts
branch
2 times, most recently
from
092c4dc to
eb70f52
Compare
sunank200
force-pushed
the
task-sdk-docs-concepts
branch
2 times, most recently
from
88ef0d3 to
fd59275
Compare
amoghrajesh
reviewed
Jun 26, 2025
sunank200
force-pushed
the
task-sdk-docs-concepts
branch
4 times, most recently
from
f58f14e to
0bed9ee
Compare
cmarteepants
approved these changes
Jul 2, 2025
Collaborator
cmarteepants
left a comment
cmarteepants
left a comment
There was a problem hiding this comment.
Great job! I think moving the architecture changes to Upgrade to Airflow 3 was the right call. I also like the addition of the Supervisor & Task Runner to the Task SDK docs. Beefs it up a bit, and feels like it reinforces the split.
amoghrajesh
approved these changes
Jul 3, 2025
Contributor
amoghrajesh
left a comment
amoghrajesh
left a comment
There was a problem hiding this comment.
Good work on this @sunank200! I have some nits, but overall really like the way this one is being put together.
Shoutout to @TJaniF for the AF3 book as well, which provides a bulk of the content and images for this PR!
…Interface, DAG Authoring, Examples, Concepts, API Reference)
sunank200
force-pushed
the
task-sdk-docs-concepts
branch
from
823a908 to
4657f55
Compare
Update task-sdk/docs/concepts.rst
sunank200
force-pushed
the
task-sdk-docs-concepts
branch
from
4657f55 to
f755c43
Compare
vatsrahul1001
approved these changes
Jul 3, 2025
sunank200
added
the
backport-to-v3-1-test
sunank200
added a commit
to astronomer/airflow
that referenced
this pull request
Jul 3, 2025
…tions (apache#52196) docs(task-sdk): reorganize landing page into six core sections (cherry picked from commit 261d33d) Co-authored-by: Ankit Chaurasia <8670962+sunank200@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR reorganises and updates the content for task-sdk:
Landing page (task-sdk/docs/index.rst):
1. Introduction & Getting Started
2. Public Interface
3. DAG Authoring Enhancements
4. Example DAG References
5. Concepts
7. API References
Add concepts:
– Details task lifecycle: scheduling → execution → heartbeats → XCom communication → retries/teardown
– Supervisor & Task Runner
Move following to airflow 3
– Compares Airflow 2.x vs 3.x architectures
closes: #49627
related: #51590
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in airflow-core/newsfragments.