[Don't merge] Implement Human-in-the-Loop (HITL) shared links functionality

[sunank200]

This PR implements Human-in-the-Loop shared links functionality as described in AIP-90. It enables shareable URLs for HITL tasks, allowing users to interact with HITL operators via direct links.

Key Changes

• Configurable HITL Shared Links:
  • Added new Airflow config options to enable/disable HITL shared links, set secret keys, and configure link expiration.
• Shared Link Utilities:
  • Utility module for generating and verifying signed HITL URLs with HMAC signatures and expiration.
• API Endpoints:
  • Endpoints for generating shared links, retrieving HITL responses via shared links, and performing actions via shared links.
  • Redirect endpoint to Airflow UI for HITL tasks.
• Security:
  • All shared links are signed and time-limited to prevent CSRF and unauthorized access.
  • Feature is opt-in and must be enabled in configuration.

closes:#52202

depends on: 52868

---

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

[Lee-W]

Hey @sunank200 , the main AIP-90 branch has been merged. Would be great if you could rebase from the main branch again 🙂 Drop the the first 19 commits directly and then cherry-pick might make everything easier.

Also, discussed with @guan404ming , the frontend can't get ti_id directly. Thus, we change the endpoints to the following.

1. GET /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}: Get a HITLDetail for a specific task instance
2. GET /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}/{map_index}: Get a HITLDetail for a specific mapped task instance
3. PATCH /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}: write the response content part back to an existing HITLDetail for a specific task instance
4. PATCH /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}/{map_index}: write the response content part back to an existing HITLDetail for a specific mapped task instance

We'll need your help to change the share link endpoint to something like

• /api/v2/hitl-details-share-link/{dag_id}/{dag_run_id}/{task_id}
• /api/v2/hitl-details-share-link/{dag_id}/{dag_run_id}/{task_id}/{map_index}

Add a /shared at the end of the endpoint won't work due to {map_index}. I thought of /api/v2/hitl-details/dagId/{dag_id}/dagRunId/{dag_run_id}/taskId/{task_id}/mapIndex/{map_index}, which makes appending works. However, I decided not to do it as it makes the URL too lengthy

[sunank200]

Hey @sunank200 , the main AIP-90 branch has been merged. Would be great if you could rebase from the main branch again 🙂 Drop the the first 19 commits directly and then cherry-pick might make everything easier.

Also, discussed with @guan404ming , the frontend can't get ti_id directly. Thus, we change the endpoints to the following.

1. GET /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}: Get a HITLDetail for a specific task instance
2. GET /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}/{map_index}: Get a HITLDetail for a specific mapped task instance
3. PATCH /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}: write the response content part back to an existing HITLDetail for a specific task instance
4. PATCH /api/v2/hitl-details/{dag_id}/{dag_run_id}/{task_id}/{map_index}: write the response content part back to an existing HITLDetail for a specific mapped task instance

We'll need your help to change the share link endpoint to something like

• /api/v2/hitl-details-share-link/{dag_id}/{dag_run_id}/{task_id}
• /api/v2/hitl-details-share-link/{dag_id}/{dag_run_id}/{task_id}/{map_index}

Add a /shared at the end of the endpoint won't work due to {map_index}. I thought of /api/v2/hitl-details/dagId/{dag_id}/dagRunId/{dag_run_id}/taskId/{task_id}/mapIndex/{map_index}, which makes appending works. However, I decided not to do it as it makes the URL too lengthy

@Lee-W I have covered all of these in #53189

Closing this PR.