Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TURN] benchmark the performance of TURN #113

Closed
Tracked by #1
rainliu opened this issue Oct 16, 2021 · 2 comments
Closed
Tracked by #1

[TURN] benchmark the performance of TURN #113

rainliu opened this issue Oct 16, 2021 · 2 comments
Labels
benchmark benchmark the peformance

Comments

@rainliu
Copy link
Member

rainliu commented Oct 16, 2021

No description provided.

@rainliu rainliu added the benchmark benchmark the peformance label Oct 16, 2021
@rainliu
Copy link
Member Author

rainliu commented Oct 16, 2021

cargo bench

Benchmarking BenchmarkIsChannelData
Benchmarking BenchmarkIsChannelData: Warming up for 3.0000 s
Benchmarking BenchmarkIsChannelData: Collecting 100 samples in estimated 5.0000 s (2.8B iterations)
Benchmarking BenchmarkIsChannelData: Analyzing
BenchmarkIsChannelData  time:   [1.6669 ns 1.6804 ns 1.6977 ns]
                        change: [+31.037% +32.715% +34.522%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
  5 (5.00%) high mild
  5 (5.00%) high severe

Benchmarking BenchmarkChannelData_Encode
Benchmarking BenchmarkChannelData_Encode: Warming up for 3.0000 s
Benchmarking BenchmarkChannelData_Encode: Collecting 100 samples in estimated 5.0001 s (241M iterations)
Benchmarking BenchmarkChannelData_Encode: Analyzing
BenchmarkChannelData_Encode
                        time:   [20.543 ns 20.692 ns 20.878 ns]
                        change: [-2.2043% -1.2847% -0.2866%] (p = 0.01 < 0.05)
                        Change within noise threshold.
Found 10 outliers among 100 measurements (10.00%)
  4 (4.00%) high mild
  6 (6.00%) high severe

Benchmarking BenchmarkChannelData_Decode
Benchmarking BenchmarkChannelData_Decode: Warming up for 3.0000 s
Benchmarking BenchmarkChannelData_Decode: Collecting 100 samples in estimated 5.0000 s (227M iterations)
Benchmarking BenchmarkChannelData_Decode: Analyzing
BenchmarkChannelData_Decode
                        time:   [21.794 ns 22.033 ns 22.316 ns]
Found 7 outliers among 100 measurements (7.00%)
  6 (6.00%) high mild
  1 (1.00%) high severe

Benchmarking BenchmarkChannelNumber/AddTo
Benchmarking BenchmarkChannelNumber/AddTo: Warming up for 3.0000 s
Benchmarking BenchmarkChannelNumber/AddTo: Collecting 100 samples in estimated 5.0001 s (97M iterations)
Benchmarking BenchmarkChannelNumber/AddTo: Analyzing
BenchmarkChannelNumber/AddTo
                        time:   [51.667 ns 52.210 ns 52.796 ns]
Found 8 outliers among 100 measurements (8.00%)
  2 (2.00%) high mild
  6 (6.00%) high severe

Benchmarking BenchmarkChannelNumber/GetFrom
Benchmarking BenchmarkChannelNumber/GetFrom: Warming up for 3.0000 s
Benchmarking BenchmarkChannelNumber/GetFrom: Collecting 100 samples in estimated 5.0000 s (285M iterations)
Benchmarking BenchmarkChannelNumber/GetFrom: Analyzing
BenchmarkChannelNumber/GetFrom
                        time:   [16.339 ns 17.030 ns 18.282 ns]
Found 12 outliers among 100 measurements (12.00%)
  3 (3.00%) high mild
  9 (9.00%) high severe

Benchmarking BenchmarkData/AddTo
Benchmarking BenchmarkData/AddTo: Warming up for 3.0000 s
Benchmarking BenchmarkData/AddTo: Collecting 100 samples in estimated 5.0001 s (83M iterations)
Benchmarking BenchmarkData/AddTo: Analyzing
BenchmarkData/AddTo     time:   [61.801 ns 63.083 ns 64.511 ns]
Found 9 outliers among 100 measurements (9.00%)
  5 (5.00%) high mild
  4 (4.00%) high severe

Benchmarking BenchmarkData/AddToRaw
Benchmarking BenchmarkData/AddToRaw: Warming up for 3.0000 s
Benchmarking BenchmarkData/AddToRaw: Collecting 100 samples in estimated 5.0002 s (82M iterations)
Benchmarking BenchmarkData/AddToRaw: Analyzing
BenchmarkData/AddToRaw  time:   [59.431 ns 59.938 ns 60.567 ns]
Found 13 outliers among 100 measurements (13.00%)
  6 (6.00%) high mild
  7 (7.00%) high severe

Benchmarking BenchmarkLifetime/AddTo
Benchmarking BenchmarkLifetime/AddTo: Warming up for 3.0000 s
Benchmarking BenchmarkLifetime/AddTo: Collecting 100 samples in estimated 5.0002 s (96M iterations)
Benchmarking BenchmarkLifetime/AddTo: Analyzing
BenchmarkLifetime/AddTo time:   [53.374 ns 54.374 ns 55.470 ns]
Found 10 outliers among 100 measurements (10.00%)
  5 (5.00%) high mild
  5 (5.00%) high severe

Benchmarking BenchmarkLifetime/GetFrom
Benchmarking BenchmarkLifetime/GetFrom: Warming up for 3.0000 s
Benchmarking BenchmarkLifetime/GetFrom: Collecting 100 samples in estimated 5.0000 s (279M iterations)
Benchmarking BenchmarkLifetime/GetFrom: Analyzing
BenchmarkLifetime/GetFrom
                        time:   [17.255 ns 17.357 ns 17.479 ns]
Found 7 outliers among 100 measurements (7.00%)
  5 (5.00%) high mild
  2 (2.00%) high severe

@rainliu rainliu mentioned this issue Oct 19, 2021
41 tasks
@rainliu
Copy link
Member Author

rainliu commented Oct 19, 2021

benchmarking is done, will create separate issue to track performance improvement based on this benchmark

@rainliu rainliu closed this as completed Oct 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
benchmark benchmark the peformance
Projects
None yet
Development

No branches or pull requests

1 participant