Skip to content

[SPARK-55691][CONNECT] GetStatus client#54520

Open
terana wants to merge 5 commits intoapache:masterfrom
terana:get-status-client
Open

[SPARK-55691][CONNECT] GetStatus client#54520
terana wants to merge 5 commits intoapache:masterfrom
terana:get-status-client

Conversation

@terana
Copy link
Contributor

@terana terana commented Feb 26, 2026

What changes were proposed in this pull request?

Client-side implementation of the GetStatus API:

  • Add client methods for requesting operation statuses.
    • GetStatus API is designed to support other request types that operation statuses in future. For those types, new methods will have to be created. This is a tradeoff between convenient client methods which encapsulate the most of the request building and flexibility.
  • Mark the client methods as Experimental and underscored for now, until enough confidence in the API stability is built.
  • Add client tests with mocked service.
  • Add E2E tests with real operation lifecycles.

Why are the changes needed?

GetStatus API allows to monitor status of executions in a session, which is particularly useful in multithreaded clients.

Does this PR introduce any user-facing change?

Yes. It's a new Spark Connect API.

How was this patch tested?

  • Add client tests with mocked service.
  • Add E2E tests with real operation lifecycles, which also test server-side changes.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude 4.6 Opus High

@terana terana changed the title Get status client [SPARK-55691][CONNECT] GetStatus client Feb 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants