Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[receiver/googlecloudspanner] feat: table size stats #18689

Merged

Conversation

artemvovk
Copy link
Contributor

Description:
https://cloud.google.com/spanner/docs/introspection/table-sizes-statistics
adding support for exposing table size statistics based on documentation link above

Link to tracking Issue: N/A
Testing:
Tried to run make, but addlicense step is not working, and after a bunch of messing with it - it added license to every single file over again.

Documentation: Still looking where/if I need to add that

@artemvovk artemvovk requested review from a team and evan-bradley February 15, 2023 20:55
@linux-foundation-easycla
Copy link

linux-foundation-easycla bot commented Feb 15, 2023

CLA Signed

The committers listed above are authorized under a signed CLA.

  • ✅ login: artemvovk / name: Artem Vovk (235d57f)

@artemvovk artemvovk changed the title feat: googlespanner receiver table size stats [receiver/googlecloudspanner] feat: table size stats Feb 15, 2023
@artemvovk artemvovk force-pushed the receiver-googlespanner-tablestats branch from e641f2b to 235d57f Compare February 15, 2023 21:09
@mx-psi
Copy link
Member

mx-psi commented Feb 16, 2023

Pinging codeowners @architjugran @varunraiko @KiranmayiB

@runforesight
Copy link

runforesight bot commented Feb 16, 2023

Foresight Summary

    
Major Impacts

build-and-test-windows duration(5 seconds) has decreased 31 minutes 41 seconds compared to main branch avg(31 minutes 46 seconds).
View More Details

✅  telemetrygen workflow has finished in 1 minute 11 seconds and finished at 30th Mar, 2023.


Job Failed Steps Tests
build-dev -     🔗  N/A See Details
publish-latest -     🔗  N/A See Details
publish-stable -     🔗  N/A See Details

✅  check-links workflow has finished in 1 minute 11 seconds and finished at 30th Mar, 2023.


Job Failed Steps Tests
changed files -     🔗  N/A See Details
check-links -     🔗  N/A See Details

✅  build-and-test workflow has finished in 36 minutes 48 seconds (9 minutes 27 seconds less than main branch avg.) and finished at 30th Mar, 2023.


Job Failed Steps Tests
unittest-matrix (1.20, connector) -     🔗  ✅ 126  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, connector) -     🔗  ✅ 126  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, internal) -     🔗  ✅ 583  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, internal) -     🔗  ✅ 583  ❌ 0  ⏭ 0    🔗 See Details
correctness-traces -     🔗  ✅ 17  ❌ 0  ⏭ 0    🔗 See Details
correctness-metrics -     🔗  ✅ 2  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, processor) -     🔗  ✅ 1557  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, extension) -     🔗  ✅ 544  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, extension) -     🔗  ✅ 544  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, processor) -     🔗  ✅ 1557  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, receiver-0) -     🔗  ✅ 2616  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, receiver-0) -     🔗  ✅ 2616  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, exporter) -     🔗  ✅ 2507  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, exporter) -     🔗  ✅ 2507  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, receiver-1) -     🔗  ✅ 1965  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, receiver-1) -     🔗  ✅ 1965  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, other) -     🔗  ✅ 4756  ❌ 0  ⏭ 0    🔗 See Details
integration-tests -     🔗  ✅ 56  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, other) -     🔗  ✅ 4756  ❌ 0  ⏭ 0    🔗 See Details
setup-environment -     🔗  N/A See Details
check-collector-module-version -     🔗  N/A See Details
lint-matrix (receiver-0) -     🔗  N/A See Details
lint-matrix (receiver-1) -     🔗  N/A See Details
lint-matrix (processor) -     🔗  N/A See Details
lint-matrix (exporter) -     🔗  N/A See Details
lint-matrix (extension) -     🔗  N/A See Details
lint-matrix (connector) -     🔗  N/A See Details
lint-matrix (internal) -     🔗  N/A See Details
lint-matrix (other) -     🔗  N/A See Details
check-codeowners -     🔗  N/A See Details
checks -     🔗  N/A See Details
build-examples -     🔗  N/A See Details
lint -     🔗  N/A See Details
unittest (1.20) -     🔗  N/A See Details
unittest (1.19) -     🔗  N/A See Details
cross-compile (darwin, amd64) -     🔗  N/A See Details
cross-compile (darwin, arm64) -     🔗  N/A See Details
cross-compile (linux, 386) -     🔗  N/A See Details
cross-compile (linux, amd64) -     🔗  N/A See Details
cross-compile (linux, arm) -     🔗  N/A See Details
cross-compile (linux, arm64) -     🔗  N/A See Details
cross-compile (linux, ppc64le) -     🔗  N/A See Details
cross-compile (windows, 386) -     🔗  N/A See Details
cross-compile (windows, amd64) -     🔗  N/A See Details
build-package (deb) -     🔗  N/A See Details
build-package (rpm) -     🔗  N/A See Details
windows-msi -     🔗  N/A See Details
publish-check -     🔗  N/A See Details
publish-stable -     🔗  N/A See Details
publish-dev -     🔗  N/A See Details

✅  prometheus-compliance-tests workflow has finished in 3 minutes 13 seconds (3 minutes 2 seconds less than main branch avg.) and finished at 30th Mar, 2023.


Job Failed Steps Tests
prometheus-compliance-tests -     🔗  ✅ 21  ❌ 0  ⏭ 0    🔗 See Details

✅  load-tests workflow has finished in 6 minutes 44 seconds (3 minutes 36 seconds less than main branch avg.) and finished at 30th Mar, 2023.


Job Failed Steps Tests
loadtest (TestTraceAttributesProcessor) -     🔗  ✅ 3  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestIdleMode) -     🔗  ✅ 1  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestMetric10kDPS|TestMetricsFromFile) -     🔗  ✅ 6  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestMetricResourceProcessor|TestTrace10kSPS) -     🔗  ✅ 12  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestTraceBallast1kSPSWithAttrs|TestTraceBallast1kSPSAddAttrs) -     🔗  ✅ 10  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestTraceNoBackend10kSPS|TestTrace1kSPSWithAttrs) -     🔗  ✅ 8  ❌ 0  ⏭ 0    🔗 See Details
setup-environment -     🔗  N/A See Details
loadtest (TestBallastMemory|TestLog10kDPS) -     🔗  ✅ 18  ❌ 0  ⏭ 0    🔗 See Details

✅  e2e-tests workflow has finished in 13 minutes 54 seconds and finished at 30th Mar, 2023.


Job Failed Steps Tests
kubernetes-test (v1.26.0) -     🔗  N/A See Details
kubernetes-test (v1.25.3) -     🔗  N/A See Details
kubernetes-test (v1.24.7) -     🔗  N/A See Details
kubernetes-test (v1.23.13) -     🔗  N/A See Details

⭕  build-and-test-windows workflow has finished in 5 seconds (31 minutes 41 seconds less than main branch avg.) and finished at 3rd Apr, 2023.


Job Failed Steps Tests
windows-unittest -     🔗  N/A See Details
windows-unittest-matrix -     🔗  N/A See Details

✅  changelog workflow has finished in 2 minutes 5 seconds and finished at 3rd Apr, 2023.


Job Failed Steps Tests
changelog -     🔗  N/A See Details

🔎 See details on Foresight

*You can configure Foresight comments in your organization settings page.

@artemvovk artemvovk force-pushed the receiver-googlespanner-tablestats branch from 2589891 to a911755 Compare February 21, 2023 19:04
@artemvovk
Copy link
Contributor Author

should I retroactively make an issue?

Error: specify one or more issues #'s

@mx-psi
Copy link
Member

mx-psi commented Feb 22, 2023

You can either create an issue or just put 18689 (the PR number) there

@mx-psi
Copy link
Member

mx-psi commented Feb 23, 2023

@architjugran @varunraiko @KiranmayiB ping, PTAL!

@artemvovk
Copy link
Contributor Author

👀

@architjugran
Copy link
Contributor

Hey, I'm no longer the code owner but the changes look good to me. (i'll make the change to remove myself shortly)
I just pinged Varun and Kiranmayi, for the final approval.

Copy link
Contributor

@varunraiko varunraiko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks mostly good. The only problem i see is that the TABLE_SIZES_STATS_1HOUR gets data points every hour, so querying every minute is not good. But this may need some more changes.

@mx-psi mx-psi requested a review from varunraiko March 30, 2023 19:44
@artemvovk
Copy link
Contributor Author

ok did i get them all? I can try changing the scrape interval, but I don't think there's anything terrible about extra queries on those tables

Copy link
Contributor

@varunraiko varunraiko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@evan-bradley evan-bradley added the ready to merge Code review completed; ready to merge by maintainers label Mar 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ready to merge Code review completed; ready to merge by maintainers receiver/googlecloudspanner
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants