Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

indexer: processor orchestrator and processors #6562

Merged
merged 1 commit into from
Dec 7, 2022
Merged

indexer: processor orchestrator and processors #6562

merged 1 commit into from
Dec 7, 2022

Conversation

gegaowp
Copy link
Contributor

@gegaowp gegaowp commented Dec 4, 2022

This PR implements processors part

  • processor orchestrator dispatches each processor and manage their failures via retrial
  • each processor reads from events / txns, and populate corresponding data table and log table
    • addresses table contains all active addresses from txns
    • objects table contains all updated object info based on object related events including NewObject, TransferObject, MutateObject and DeleteObject
    • modules table contains all published modules

Tested locally
addresses
Screen Shot 2022-12-04 at 1 40 17 PM

objects
Screen Shot 2022-12-04 at 1 40 04 PM

modules
Screen Shot 2022-12-04 at 1 51 44 PM

@gegaowp gegaowp requested review from 666lcz and mwtian December 4, 2022 19:16
@gegaowp gegaowp force-pushed the indexer-processor branch 3 times, most recently from b2fbcd8 to e66eec8 Compare December 4, 2022 19:34
@gegaowp gegaowp requested a review from patrickkuo December 7, 2022 16:55
666lcz
666lcz approved these changes Dec 7, 2022
View reviewed changes
Copy link
Contributor

@666lcz 666lcz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve to unblock

@gegaowp gegaowp merged commit 23d0ed8 into MystenLabs:main Dec 7, 2022
@gegaowp
Copy link
Contributor Author

gegaowp commented Dec 7, 2022 •
edited
Loading

merging to unblock deployment and integration with product team, will address comments in following PRs, thanks!

@gegaowp gegaowp deleted the indexer-processor branch December 7, 2022 17:10
patrickkuo pushed a commit that referenced this pull request Dec 13, 2022
@gegaowp @patrickkuo
indexer: processor orchestrator and processors (#6562)
259d278
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@666lcz 666lcz 666lcz approved these changes

@mwtian mwtian Awaiting requested review from mwtian

@patrickkuo patrickkuo Awaiting requested review from patrickkuo

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@gegaowp @666lcz