[DPP-1327] Improve performance of transaction streaming by replacing the backend implementation #15770
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
pbatko-da
force-pushed
the
pbatko/etq-tx-streams
branch
from
0ff9811
to
01157f4
Compare
pbatko-da
force-pushed
the
pbatko/etq-transactions-123
branch
2 times, most recently
from
669a6f4
to
12fbdff
Compare
pbatko-da
force-pushed
the
pbatko/etq-tx-streams
branch
from
01157f4
to
da2c300
Compare
pbatko-da
force-pushed
the
pbatko/etq-transactions-123
branch
2 times, most recently
from
9c2fef5
to
b9ffc4f
Compare
pbatko-da
changed the title
pbatko-da
changed the title
pbatko-da
force-pushed
the
pbatko/etq-tx-streams
branch
from
da2c300
to
2757bd7
Compare
pbatko-da
force-pushed
the
pbatko/etq-transactions-123
branch
2 times, most recently
from
ed3bb5f
to
362cd69
Compare
pbatko-da
changed the title
pbatko-da
force-pushed
the
pbatko/etq-tx-streams
branch
from
cf0605f
to
f69efa4
Compare
mziolekda
reviewed
Dec 8, 2022
...r/participant-integration-api/src/main/scala/platform/configuration/IndexServiceConfig.scala
Show resolved
Hide resolved
mziolekda
reviewed
Dec 8, 2022
...r/participant-integration-api/src/main/scala/platform/configuration/IndexServiceConfig.scala
Show resolved
Hide resolved
…the backend implementation Includes both flat and tree transactions streaming. Transactions streams are now build from quering new event id filter tables to obtain event ids and then querying event payload tables by those ids.
pbatko-da
force-pushed
the
pbatko/etq-transactions-123
branch
from
362cd69
to
d655b9e
Compare
mziolekda
reviewed
Dec 8, 2022
...tegration-api/src/main/scala/platform/store/backend/common/EventStorageBackendTemplate.scala
Show resolved
Hide resolved
mziolekda
reviewed
Dec 8, 2022
...tegration-api/src/main/scala/platform/store/backend/common/EventStorageBackendTemplate.scala
Show resolved
Hide resolved
mziolekda
reviewed
Dec 9, 2022
...tegration-api/src/main/scala/platform/store/backend/common/EventStorageBackendTemplate.scala
Outdated
Show resolved
Hide resolved
mziolekda
reviewed
Dec 9, 2022
...-integration-api/src/main/scala/platform/store/dao/events/TransactionsFlatStreamReader.scala
Outdated
Show resolved
Hide resolved
mziolekda
reviewed
Dec 9, 2022
...-integration-api/src/main/scala/platform/store/dao/events/TransactionsFlatStreamReader.scala
Show resolved
Hide resolved
mziolekda
reviewed
Dec 9, 2022
...articipant-integration-api/src/main/scala/platform/store/dao/events/TransactionsReader.scala
Show resolved
Hide resolved
mziolekda
reviewed
Dec 9, 2022
pbatko-da
commented
Dec 9, 2022
...-integration-api/src/main/scala/platform/store/dao/events/TransactionsTreeStreamReader.scala
Outdated
Show resolved
Hide resolved
pbatko-da
force-pushed
the
pbatko/etq-transactions-123
branch
from
1e564c8
to
f04c514
Compare
mziolekda
approved these changes
Dec 12, 2022
pbatko-da
added a commit
that referenced
this pull request
Jan 5, 2023
These metrics where changed in a previous PR: #15770 This PR adjusts the metrics names and documents the changes. Each of the metrics below is a family of metrics starting with such prefix. New metrics: daml_index_db_flat_transactions_stream_translation daml_index_db_flat_transactions_stream_fetch_event_consuming_ids_stakeholder daml_index_db_flat_transactions_stream_fetch_event_consuming_payloads daml_index_db_flat_transactions_stream_fetch_event_create_ids_stakeholder daml_index_db_flat_transactions_stream_fetch_event_create_payloads daml_index_db_tree_transactions_stream_translation daml_index_db_tree_transactions_stream_fetch_event_consuming_ids_non_stakeholder daml_index_db_tree_transactions_stream_fetch_event_consuming_ids_stakeholder daml_index_db_tree_transactions_stream_fetch_event_consuming_payloads daml_index_db_tree_transactions_stream_fetch_event_create_ids_non_stakeholder daml_index_db_tree_transactions_stream_fetch_event_create_ids_stakeholder daml_index_db_tree_transactions_stream_fetch_event_create_payloads daml_index_db_tree_transactions_stream_fetch_event_non_consuming_ids_informee daml_index_db_tree_transactions_stream_fetch_event_non_consuming_payloads Removed: daml_index_db_get_flat_transactions daml_index_db_get_transaction_trees
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Depends on #15703 - this PR shall be retargeted to main after the dependent PR is merged