Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark build error on the current master branch #19231

Open
zamazan4ik opened this issue Nov 24, 2023 · 8 comments
Open

Benchmark build error on the current master branch #19231

zamazan4ik opened this issue Nov 24, 2023 · 8 comments
Labels
domain: api Anything related to Vector's GraphQL API domain: dev Anything related to Vector's development environment domain: performance Anything related to Vector's performance type: tech debt A code change that does not add user value.

Comments

@zamazan4ik
Copy link
Contributor

A note for the community

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment

Problem

When I run cargo bench --all-features --workspace I get the following errors: https://gist.github.com/zamazan4ik/ec3a822381640446291953c8c0f55332

Expected behavior: the benchmark must compile and run successfully.

Configuration

OS: Fedora 39
Rustc: 1.72.1

Version

master branch, commit d5f6d074fb550b9bbb8b4eae3a44c64f1353065b

Debug Output

No response

Example Data

No response

Additional Context

No response

References

No response

@zamazan4ik zamazan4ik added the type: bug A code related bug. label Nov 24, 2023
@zamazan4ik
Copy link
Contributor Author

cargo bench --features benches fails with the following errors: https://gist.github.com/zamazan4ik/417b0b87ea65746f1161bf819c33e2c0

@bruceg bruceg added domain: dev Anything related to Vector's development environment domain: performance Anything related to Vector's performance labels Nov 24, 2023
@bruceg
Copy link
Member

bruceg commented Nov 24, 2023

I confirm this is a problem. I have a opened up #19235 that resolves the issues with the latter command, but there is more work needed on the API tests than I can put in right now to resolve the former.

@bruceg bruceg added type: tech debt A code change that does not add user value. and removed type: bug A code related bug. labels Nov 24, 2023
@bruceg
Copy link
Member

bruceg commented Nov 27, 2023

Note: the remaining failures can be reproduced with cargo check --tests --no-default-features --features api,vector-api-tests, which doesn't require any expensive code generation or link steps. The latter bench command is fixed now as of #19235.

@bruceg bruceg added the domain: api Anything related to Vector's GraphQL API label Nov 27, 2023
@zamazan4ik
Copy link
Contributor Author

@bruceg cargo bench --features benches --bench default fails to complete on the current master branch with the following error: #19235 (comment) . As @dsmith3197 pointed the error is somewhere here: #19235 (review)

@bruceg
Copy link
Member

bruceg commented Nov 29, 2023

That command works for me on ce615d0

@zamazan4ik
Copy link
Contributor Author

zamazan4ik commented Nov 29, 2023

What is your testing environment? I just deleted target directory, checked out the same commit as you, and got the same error. My environment is Linux (Fedora 39).

@jszwedko jszwedko changed the title Build error on the current master branch Benchmark build error on the current master branch Dec 12, 2023
@jszwedko
Copy link
Member

Gotcha, it compiles now, but yes, I see the same error during execution:

Benchmarking files/no_partitions: Warming up for 3.0000 sthread 'main' panicked at 'Metrics must be initialized: NotInitialized', /home/bits/go/src/github.com/DataDog/vector/src/topology/running.rs:1011:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

error: bench failed, to rerun pass `--bench default`

@zamazan4ik
Copy link
Contributor Author

JFYI, it's still the issue with the current master branch on the abb292a8c6179eb5650cc2a88f18897aa71509cf commit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
domain: api Anything related to Vector's GraphQL API domain: dev Anything related to Vector's development environment domain: performance Anything related to Vector's performance type: tech debt A code change that does not add user value.
Projects
None yet
Development

No branches or pull requests

3 participants