Status of testing of Apache Airflow 3.1.7rc1 and Task SDK 1.1.7rc1

[ephraimbuddy]

Body

We are kindly requesting that contributors to Apache Airflow RC 3.1.7rc1 help test the RC.

Please let us know by commenting if the issue is addressed in the latest RC.

• Fix NoneType error when updating serialized DAG (#56422): @snowsky @anshuksi282-ksolves
  Linked issues:
  • DAG import error after v3 upgrade (#56306)
• Optimized DAG processing queue order on bundle refresh (#60003): @jedcunningham
• Fix TriggerDagRunOperator deferring when wait_for_completion=False (#60052): @nathadfield
  Linked issues:
  • TriggerDagRunOperator defers even when wait_for_completion=False (#60049)
• Refactor DAG file queuing and fix redundant processing (#60124): @jedcunningham
• [v3-1-test] Automatically add pydantic extra when installing airflow 2 in breeze (#60264) (#60267): @potiuk
• Add warning when bundle path isn't accessible to impersonated user (#60278): @Dev-iL
  Linked issues:
  • DAG Bundle/User Impersonation Causes Permission Issues in Resource Preparation (#60387)
  • Add configs to set bundle file & folder permissions (#60270)
• [v3-1-test] Add virtualization to grid view (#60241) (#60285): @bbovenzi
• [v3-1-test] Fix sidebar visibility issue when main content exceeds viewport height (#59660) (#60286): @choo121600
• [v3-1-test] Fix table filters reseting when deleting a dag (#60279) (#60287): @pierrejeambrun
• [v3-1-test] Fix constraint mode when installing from dist or version airflow (#60304) (#60305): @potiuk
• [v3-1-test] Remove unused logic in helm_template_generator (#60188) (#60331): @Miretpl
• [v3-1-test] fix: reset pagination on DagList search (#60326) (#60336): @OscarLigthart
• [v3-1-test] Move dags list filters to buttongroups (#60298) (#60337): @bbovenzi
• [v3-1-test] increase-mysql-healthcheck-timeout (#60338) (#60343): @vatsrahul1001
• [v3-1-test] Add Linux favour of installing dependencies for release (#60368) (#60381): @bugraoz93
• [v3-1-test] Improve insert content when generate docker file (#60393) (#60397): @tuanhm2911
• Remove dry-run skip for SVN clone in release command (#60400): @vatsrahul1001
• [v3-1-test] Fix dag-processor crashing due to MySql deadlock errors (#60166) (#60418): @msumit
• [v3-1-test] Clean react plugin tools (#60419) (#60450): @pierrejeambrun
• [v3-1-test] Upgrade react-dom-router in Airflow UI (#60316) (#60456): @pierrejeambrun
• [v3-1-test] Fix gantt chart styling (#60347) (#60457): @bbovenzi
• [v3-1-test] Unique run_id across manually triggered Dags with schedules (#59477) (#60468): @steveahnahn
• [v3-1-test] Update python client version/changelog for 3.1.6 release (#60459) (#60470): @ephraimbuddy
• [v3-1-test] Correct the access for the externalLogUrl (#60412) (#60479): @shubhamraj-git
• [v3-1-test] checking session.query() (#60510) (#60530): @Prab-27
• [v3-1-test] UI: Update PoolBar to separate Scheduled and Deferred slots (#59270) (#60538): @anshuksi282-ksolves
• Backport: Improve Dags Filter UI (#60346) (#60547): @bbovenzi
• [v3-1-test] Fix python client NOTICE and wheel content (#60539) (#60551): @potiuk
• [v3-1-test] Update AI question header to 5th-level in PR template and add separator (#60531) (#60556): @potiuk
• [v3-1-test] Fix/backfill permission error handling (#60582) (#60587): @pierrejeambrun @manipatnam
• [v3-1-test] Update release command and guide (#60508) (#60607): @ephraimbuddy
• [v3-1-test] Move row count and display toggle into DataTable (#57680) (#60639): @cmbilly8
• [v3-1-test] feat: added toasters for permission denied (#57966) (#58016) (#60646): @pierrejeambrun @aaron-wolmutt
• [v3-1-test] Remove API error from disabling submit (#60473) (#60658): @pierrejeambrun @bbovenzi
• [v3-1-test] Remove duplicate 'libgdbm-dev' from install_os_dependencies (#60642) (#60660): @shahar1
• [v3-1-test] Fix breeze start-airflow mprocs output interference (#60652) (#60678): @ephraimbuddy
• [v3-1-test] CI: Upgrade important CI environment (#60694) (#60695): @jscheffl
• [v3-1-test] Change default mysql client type to mariadb in Dockerfile.ci (#60683) (#60697): @shahar1
• [v3-1-test] Add prek hook to check NOTICE files for content (#60699) (#60710): @potiuk
  Linked issues:
  • Add verification steps for NOTICE files to our release processes (#60540)
• [v3-1-test] Fix Vite dev servers not starting in breeze (#60735) (#60745): @guan404ming
• [v3-1-test] Grey out trigger button on API 403 (#60648) (#60777): @pierrejeambrun
• [v3-1-test] Revert Fix breeze start-airflow mprocs output interference #60652 (#60786) (#60788): @pierrejeambrun
• Fix unnecessary DAG version churn when DAG file paths change (#60799): @kaxil
• [v3-1-test] build: upgrade prek to 0.2.30 (#60816) (#60820): @Lee-W
• [v3-1-test] CI: Upgrade important CI environment (#60827) (#60829): @vatsrahul1001
• [v3-1-test] Fix release check for Python Client (#60839) (#60842): @potiuk
• [v3-1-test] apply gc.freeze in dag-processor (#60505) (#60845): @wjddn279
• [v3-1-test] build: upgrade hatch to 1.16.3 (#60850) (#60852): @Lee-W
• [v3-1-test] Add checksum verification to Apache RAT downloading in release instructions (#60841) (#60862): @shahar1
• [v3-1-test] CI: Upgrade important CI environment (#60865) (#60872): @Lee-W
• [v3-1-test] Fix connection test API to restore masked password/extra from existin… (#60873): @choo121600 @pierrejeambrun
• [v3-1-test] Convert Tasks Table from card to table mode (#60830) (#60874): @pierrejeambrun
• [v3-1-test] Fix slow log scrolling for large task logs (#60806) (#60875): @pierrejeambrun @guan404ming
• fix(ui): avoid gantt annotation error during resize (#60877): @yuseok89
• [v3-1-test] Logout the user when the refresh token is no longer valid (#60781) (#60881): @vincbeck
  Linked issues:
  • Logout the user when the token expires (#60781)
• [v3-1-test] Fix permissions check in import error APIs (#60801) (#60884): @vincbeck
  Linked issues:
  • Fix permissions check in import error APIs (#60801)
• [v3-1-test] Fix mypy checks in CI to also run for scripts (#60898) (#60906): @potiuk
• Reschedule tasks on worker startup Dag load failures instead of exiting (#59604) (#60926): @Lee-W
• Fix DAG processor OOM || Avoid loading all TaskInstances when checking DagVersion in write_dag (#60937): @jedcunningham @vatsrahul1001
• Use bulk DELETE for XComModel.clear() instead of loading records (#60955): @kaxil
• [v3-1-test] Fix permissions on get_event_logs endpoint (#60936) (#60958): @pierrejeambrun
• [v3-1-test] Fix dag access control for dag_id in query param (#60935) (#60959): @pierrejeambrun
• Fix DAG processor OOM || Avoid loading all TaskInstances when checking DagVersion in write_dag (#60962): @vatsrahul1001
• [v3-1-test] Use log_level for root logger instead of hardcoded INFO level (#60784) (#60970): @justinpakzad
• Prevent Triggerer from crashing when a trigger event isn't serializable (#60152) (#60981): @dabla
• [v3-1-test] Fix ui get dags permission endpoint for user without dag run permissions (#60979) (#60988): @pierrejeambrun
• [v3-1-test] Upgrade important CI environment (#61006): @jscheffl
• [v3-1-test] Add Dheeraj Turaga as codeowner to airflow-core/executors (#61016) (#61020): @dheerajturaga
• [v3-1-test] Upgrade important CI environment (#61030): @Lee-W
• [v3-1-test] Add bundle_path temporarily to sys.path during DagBag parsing. (#55894) (#61053): @Lee-W @simi
• [v3-1-test] Get rid of the bleeding edge of our prek-hooks (#60452) (#61064): @potiuk
• [v3-1-test] Respect maximum page limit in API (#60989) (#61073): @pierrejeambrun
• [v3-1-test] Fix asset scheduling for stale DAGs (#59337) (#60022) (#61106): @Lee-W @Jkhall81
• [v3-1-test] Fix Simple Auth Manager UI dev server not starting in breeze (#60932) (#61107): @choo121600
• [v3-1-test] Pool API improve slots validation (#61071) (#61114): @pierrejeambrun
• [v3-1-test] Remove unused method is_default_pool in Pool model (#61084) (#61128): @vincbeck
• [v3-1-test] Plugins pagination fix #61055 (#61059) (#61129): @vishakha1411 @vatsrahul1001
  Linked issues:
  • UI E2E Test || ADMIN-005: Verify Plugins Page functionality (#60571)
  • Plugins Page does not show pagination (#61055)
• Manually backport fix reset pagination (#61169): @bbovenzi
• Fix react apps plugins router (#61206): @pierrejeambrun
• [v3-1-test] Add guardrail to handle DAG deserialization errors in scheduler (#61210): @vatsrahul1001
• [v3-1-test] Explicitly set table ordering (#60609) (#61216): @bbovenzi
• [v3-1-test] Add 404 handling for non-existent Dag (#61131) (#61225): @choo121600
• [v3-1-test] dag_processing: initialize versioned bundles for callbacks (#52040) (#60734) (#61230): @mistercrunch @nailo2c @ephraimbuddy
  Linked issues:
  • Bring in more resolution to hivestats (#2)
• [v3-1-test] Fix callback files losing priority during queue resort (#61232) (#61243): @jedcunningham

Thanks to all who contributed to the release (probably not a complete list!):
@wjddn279 @shubhamraj-git @dabla @yuseok89 @guan404ming @manipatnam @choo121600 @simi @Prab-27 @nathadfield @tuanhm2911 @cmbilly8 @ephraimbuddy @mistercrunch @vincbeck @anshuksi282-ksolves @snowsky @steveahnahn @OscarLigthart @justinpakzad @Miretpl @aaron-wolmutt @bugraoz93 @potiuk @nailo2c @pierrejeambrun @msumit @vatsrahul1001 @jscheffl @shahar1 @kaxil @vishakha1411 @Dev-iL @jedcunningham @Jkhall81 @Lee-W @dheerajturaga @bbovenzi

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[bugraoz93]

My changes look good! Thanks, Ephraim!

[rutiktambe]

Thanks for organizing the RC testing.

I can help by testing Apache Airflow 3.1.7rc1 and Task SDK 1.1.7rc1. I’ll focus on:

• installing from the RC artifacts,
• basic DAG import and scheduling,
• TriggerDagRunOperator behavior,
• and a quick regression check around DAG serialization and task execution.
  I’ll run the tests on a local setup and report back here whether the listed issues appear resolved or if I notice any regressions.

Please let me know if there’s a specific area you’d like me to prioritize.

[simi]

I can confirm #61053 works as intended using 3.1.7rc1 git tag.

[Miretpl]

Not sure why my change related to Helm Chart is here, but it looks good.