Skip to content

Conversation

@yjshen
Copy link
Member

@yjshen yjshen commented Jan 22, 2022

Which issue does this PR close?

Closes #1611 and #1573 .

Rationale for this change

Report spill_count and spilled_bytes in BaselineMetrics since these might be common metrics as we proceed with more memory consumers.
We could also test sort spill with these newly introduced metrics.

What changes are included in this PR?

  • Add spill_count and spilled_bytes in BaselineMetrics
  • Report the above two metrics in the sort while spilling.

Are there any user-facing changes?

No.

@yjshen yjshen changed the title Add spill_count and spilled_bytes into BaselineMetrics, test sort with spill Add spill_count and spilled_bytes in BaselineMetrics, test sort with spill Jan 22, 2022
@yjshen yjshen changed the title Add spill_count and spilled_bytes in BaselineMetrics, test sort with spill Add spill_count and spilled_bytes to BaselineMetrics, test sort with spill Jan 22, 2022
@yjshen
Copy link
Member Author

yjshen commented Jan 22, 2022

Hi @alamb, could you please help review this?

Self::EndTimestamp(_) => 5,
Self::SpillCount(_) => 2,
Self::SpilledBytes(_) => 3,
Self::Count { .. } => 4,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks good to me, but we can make the format consistent with others as a minor fix in a follow-up pull request.
Self::Count { .. } => 4, -> Self::Count(_) => 4,

Copy link
Contributor

@liukun4515 liukun4515 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@alamb
Copy link
Contributor

alamb commented Jan 22, 2022

Thank you @yjshen and @liukun4515 for the review ❤️

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Report spill_count as well as spill_bytes in sort metrics

3 participants