Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] feature/core-entities #960

Merged
merged 24 commits into from
Oct 17, 2023
Merged

[WIP] feature/core-entities #960

merged 24 commits into from
Oct 17, 2023

Conversation

sebastianburckhardt
Copy link
Collaborator

Feature branch for the new entity support in DT.Core and DT.AzureStorage.

* implementaton of entity mechanics, compatible with existing DF SDK, but without a user-facing entity SDK for DTFx

* address PR feedback.

* fix usings and namespaces

* address PR feedback

* address PR feedback (remove NameObjectManager), fix breaking change in TaskHubWorker, fix some comments

* address PR feedback (fix CustomExceptionsTest, remove public property)

* add #nullable enable to most new classes

* address PR feedback

* try to fix compiler errors

* add a configuration setting that disables separate dispatch by default

* address PR feedback

* address PR feedback
@sebastianburckhardt sebastianburckhardt added core-entities Support for entities P1 dt.azurestorage DurableTask.AzureStorage dt.core DurableTask.Core labels Sep 7, 2023
sebastianburckhardt and others added 9 commits September 7, 2023 15:44
# Conflicts:
#	src/DurableTask.Core/TaskOrchestrationDispatcher.cs
* update scheduler state and entity status format and helpers

* fix mess-up caused by merge conflict
* revise how event messages are represented and used

* fix merge anomaly.
* rename OperationBatch to EntityBatch

* fix accidentally commited change from another PR
* revise task entity definition

* commit change that had been accidentally committed to a different PR.

* Apply suggestions from code review

Co-authored-by: David Justo <david.justo.1996@gmail.com>

* Apply suggestions from code review

Co-authored-by: Jacob Viau <javia@microsoft.com>

---------

Co-authored-by: David Justo <david.justo.1996@gmail.com>
Co-authored-by: Jacob Viau <javia@microsoft.com>
@sebastianburckhardt sebastianburckhardt marked this pull request as ready for review September 18, 2023 17:32
sebastianburckhardt and others added 14 commits September 21, 2023 13:50
…#957)

* revise entity backend properties and implement entity backend queries.

* Minor revisions to querries and properties, and improved comments.

* fix validation of which LockNext methods are being called.

* improve comments

* fix useage of IEntityOrchestrationService.

* revise how to exclude entity results from queries.

* address PR feedback
* fix propagation path for entity parameters that need to reach the orchestration executor.

* address PR feedback.
* rename includeDeletedEntities to includeStatelessEntities and add comment explaining the meaning

* add backlogQueueSize and lockedBy to entity metadata
* revise how entity messages are serialized when sent by orchestrators.

* address PR feedback (use RawInput)
* rename includeStateless to includeTransient

* rename variable also
public async override Task<EntityMetadata?> GetEntityAsync(
EntityId id,
bool includeState = false,
bool includeStateless = false,
Copy link
Collaborator

@jviau jviau Oct 17, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Think this should change to includeTransient before GA (and on the base class)

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh right

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core-entities Support for entities dt.azurestorage DurableTask.AzureStorage dt.core DurableTask.Core P1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants