Status of testing of Apache Airflow 3.1.3rc1 and Task SDK 1.1.3rc1

[ephraimbuddy]

Body

We are kindly requesting that contributors to Apache Airflow RC 3.1.3rc1 help test the RC.

Please let us know by commenting if the issue is addressed in the latest RC.

• Fix upgrade failure when xcom contains NaN in string values (#57614): @amoghrajesh
• [v3-1-test] Remove leftovers from unlimited parallelism in local executor (#57579) (#57644): @jscheffl
• [v3-1-test] Add number of queries guard for public tasks (#57646) (#57664): @pierrejeambrun
• [v3-1-test] Fix code formatting via ruff preview (#57641) (#57670): @jscheffl
• [v3-1-test] Enable ruff PLW1508 rule (#57653) (#57673): @jscheffl
• [v3-1-test] Enable ruff PLW1510 rule (#57660) (#57674): @jscheffl
• [v3-1-test] Enable ruff PLW0211 rule (#57522) (#57684): @jscheffl
• [v3-1-test] Shorten German Translation of Asset in Navigation (#57671) (#57690): @jscheffl
• [v3-1-test] Enable ruff PLW1641 rule (#57679) (#57701): @jscheffl
• [v3-1-test] Upgrade Zizmor to 1.16.2 (#57708) (#57709): @jscheffl
• [v3-1-test] Use eralchemy instead of eralchemy2 (#55758) (#57715): @potiuk @maurerle
• [v3-1-test] Make extra of Asset, AssetAlias, AssetEvent a dict[str, JsonValue] (#57352) (#57728): @Lee-W
• [v3-1-test] Add number of queries guard for public variables (#57647) (#57732): @pierrejeambrun
• [v3-1-test] Add number of queries guard in public dag version list endpoints (#57… (#57735): @pierrejeambrun
• [v3-1-test] Add number of queries guard in public dag runs list endpoints (#57450) (#57736): @pierrejeambrun
• [v3-1-test] Add number of queries guard for public hitls (#57549) (#57738): @pierrejeambrun
• [v3-1-test] Don't fetch ImportError until modal opens. Use limit as 1 since the UI shows total_entries value and rest of the response is ignored. (#57624) (#57757): @tirkarthi @bbovenzi
• [v3-1-test] fix(task_instance): Ignore NotFullyPopulated if the task might be triggered due to trigger rule setup (#57474) (#57786): @Lee-W
• [v3-1-test] Add number of queries guard in public task instances list endpoints (… (#57794): @pierrejeambrun
• [v3-1-test] Fix loading providers hooks fields w/o FAB provider installed (#57717) (#57830): @jscheffl
• [v3-1-test] UI - Fix test connection (#57811) (#57852): @pierrejeambrun
• [v3-1-test] Configure uvicorn timeout_worker_healthcheck from worker-timeout CLI option (#57731) (#57854): @vlieven
• [v3-1-test] Add number of queries guard for ui backfill (#57820) (#57856): @pierrejeambrun
• [v3-1-test] Fix start-rc-process command test in CI (#57870) (#57875): @potiuk
• [v3-1-test] Add number of queries guard for ui connections (#57869) (#57882): @pierrejeambrun
• [v3-1-test] Enable PT006 rule to dev (#57834) (#57890): @KoviAnusha
• [v3-1-test] Ensure task in the context is always correct. (#57884) (#57892): @ashb
• Ensure that DB migrations handles all kinds of NaN values in historical xcoms (#57866) (#57893): @amoghrajesh
• [v3-1-test] Improve preparation and verification of source tarballs (… (#57906): @potiuk
• [v3-1-test] Upgrade important versions in v3-1-test (#57908): @potiuk
• [v3-1-test] Add number of queries guard for ui config (#57868) (#57918): @pierrejeambrun
• [v3-1-test] Bump prek, zizmor, go to fix the CI (#57930) (#57946): @amoghrajesh
• [v3-1-test] Fix scheduler using stale max_active_runs from SerializedDAG (#57619) (#57959): @DonHaul @ephraimbuddy
  Linked issues:
  • max_active_runs is 64, but with 16 active runs it says the constraint is reached (#57604)
• [v3-1-test] Add secret masking for Jinja template rendering exceptions (#57467) (#57962): @sunank200
• [v3-1-test] Add number of queries guard for ui dependencies (#57957) (#57972): @pierrejeambrun
• [v3-1-test] Add number of queries guard for ui dashboard (#57956) (#57973): @pierrejeambrun
• [v3-1-test] fix: Add .txt extension for log download function (#57991) (#58040): @RoyLee1224
• [v3-1-test] Fix logout in airflow-core (#57990) (#58043): @vincbeck
  Linked issues:
  • Fix logout in airflow-core (#57990)
• [v3-1-test] Add number of queries guard for ui next_run_assets (#58052) (#58064): @pierrejeambrun
• [v3-1-test] feat: add resize function to dag run / TI notes (#57897) (#58068): @RoyLee1224 @guan404ming
• Fill in the gap for Taiwan translation (#58121): @Lee-W
• [v3-1-test] fix: HITL params not validating (#57547) (#58144): @Lee-W
• [v3-1-test] Update Release instruction to include Task SDK version update (#58134) (#58154): @ephraimbuddy

Thanks to all who contributed to the release (probably not a complete list!):
@potiuk @sunank200 @guan404ming @jscheffl @bbovenzi @RoyLee1224 @ashb @KoviAnusha @pierrejeambrun @vincbeck @ephraimbuddy @maurerle @vlieven @tirkarthi @Lee-W @amoghrajesh @DonHaul

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[jscheffl]

Checked all changes, in soruce all fixes are in. Will do a release check shortly and respond in devlist

[potiuk]

I don't think the vote is out yet :) . I assume some more changes coming.

[jscheffl]

I don't think the vote is out yet :) . I assume some more changes coming.

And how about https://lists.apache.org/thread/87hb7zfobsnpp9slontkd4xlcvgrlrxr ?

[potiuk]

I don't think the vote is out yet :) . I assume some more changes coming.

And how about https://lists.apache.org/thread/87hb7zfobsnpp9slontkd4xlcvgrlrxr ?

Ups.

[potiuk]

Checked mine - all good !

[gvergnolle]

I tested task logs, all good!

• Able to render long logs, scrolling works as expected
• We can download the logs in a .txt file

[amoghrajesh]

Installed the RC and tested my changes:

Actual changes:

1. Fix upgrade failure when xcom contains NaN in string values #57614
2. Ensure that DB migrations handles all kinds of NaN values in historical xcoms (#57866) #57893

Those two do not work individually but together the upgrade works smoothly and as expected.

CI related changes:
#57946

[atul-astronomer]

Tested below PRs and confirm that its working fine.

1. Fix upgrade failure when xcom contains NaN in string values #57614
2. Make extra of Asset, AssetAlias, AssetEvent a dict[str, JsonValue] #57352
3. [v3-1-test] fix(task_instance): Ignore NotFullyPopulated if the task might be triggered due to trigger rule setup (#57474) #57786
4. Ensure that DB migrations handles all kinds of NaN values in historical xcoms (#57866) #57893
5. [v3-1-test] Fix scheduler using stale max_active_runs from SerializedDAG (#57619) #57959
6. [v3-1-test] Add secret masking for Jinja template rendering exceptions (#57467) #57962
7. [v3-1-test] fix: HITL params not validating (#57547) #58144

[ephraimbuddy]

Airflow 3.1.3 has been released. Thanks for testing the release candidate