Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flaky Test: AllMetricsOneFunction #7423

Open
easwars opened this issue Jul 17, 2024 · 4 comments
Open

Flaky Test: AllMetricsOneFunction #7423

easwars opened this issue Jul 17, 2024 · 4 comments
Assignees
Labels
Area: Observability Includes Stats, Tracing, Channelz, Healthz, Binlog, Reflection, Admin, GCP Observability P2 Type: Bug

Comments

@easwars
Copy link
Contributor

easwars commented Jul 17, 2024

https://github.com/grpc/grpc-go/actions/runs/9981600990/job/27585576492?pr=7397

--- FAIL: Test (0.08s)
    --- FAIL: Test/AllMetricsOneFunction (0.02s)
        tlogger.go:116: INFO server.go:685 [core] [Server #13]Server created  (t=+581.784µs)
        tlogger.go:116: INFO clientconn.go:1683 [core] original dial target is: "whatever:///127.0.0.1:36449"  (t=+676.37µs)
        tlogger.go:116: INFO clientconn.go:310 [core] [Channel #15]Channel created  (t=+742.573µs)
        tlogger.go:116: INFO clientconn.go:192 [core] [Channel #15]parsed dial target is: resolver.Target{URL:url.URL{Scheme:"whatever", Opaque:"", User:(*url.Userinfo)(nil), Host:"", Path:"/127.0.0.1:36449", RawPath:"", OmitHost:false, ForceQuery:false, RawQuery:"", Fragment:"", RawFragment:""}}  (t=+843.[231](https://github.com/grpc/grpc-go/actions/runs/9981600990/job/27585576492?pr=7397#step:8:232)µs)
        tlogger.go:116: INFO clientconn.go:193 [core] [Channel #15]Channel authority set to "127.0.0.1:36449"  (t=+906.989µs)
        tlogger.go:116: INFO server.go:881 [core] [Server #13 ListenSocket #14]ListenSocket created  (t=+989.032µs)
        tlogger.go:116: INFO clientconn.go:310 [core] [Channel #15]Channel exiting idle mode  (t=+1.056518ms)
        tlogger.go:116: INFO resolver_wrapper.go:197 [core] [Channel #15]Resolver state updated: {
              "Addresses": [
                {
                  "Addr": "127.0.0.1:36449",
                  "ServerName": "",
                  "Attributes": null,
                  "BalancerAttributes": null,
                  "Metadata": null
                }
              ],
              "Endpoints": [
                {
                  "Addresses": [
                    {
                      "Addr": "127.0.0.1:36449",
                      "ServerName": "",
                      "Attributes": null,
                      "BalancerAttributes": null,
                      "Metadata": null
                    }
                  ],
                  "Attributes": null
                }
              ],
              "ServiceConfig": null,
              "Attributes": null
            } (resolver returned new addresses)  (t=+1.220113ms)
        tlogger.go:116: INFO balancer_wrapper.go:106 [core] [Channel #15]Channel switches to new LB policy "pick_first"  (t=+1.314068ms)
        tlogger.go:116: INFO clientconn.go:847 [core] [Channel #15 SubChannel #16]Subchannel created  (t=+1.391121ms)
        tlogger.go:116: INFO clientconn.go:540 [core] [Channel #15]Channel Connectivity change to CONNECTING  (t=+1.444821ms)
        tlogger.go:116: INFO clientconn.go:1207 [core] [Channel #15 SubChannel #16]Subchannel Connectivity change to CONNECTING  (t=+1.573861ms)
        tlogger.go:116: INFO clientconn.go:1325 [core] [Channel #15 SubChannel #16]Subchannel picks a new address "127.0.0.1:36449" to connect  (t=+1.668[247](https://github.com/grpc/grpc-go/actions/runs/9981600990/job/27585576492?pr=7397#step:8:248)ms)
        tlogger.go:116: INFO clientconn.go:1207 [core] [Channel #15 SubChannel #16]Subchannel Connectivity change to READY  (t=+2.189578ms)
        tlogger.go:116: INFO clientconn.go:540 [core] [Channel #15]Channel Connectivity change to READY  (t=+2.273043ms)
        testutils.go:62: [Metrics Data not equal: Histogram not equal: Histogram DataPoints not equal:
            missing expected values:
            metricdata.HistogramDataPoint[int64]{Attributes:attribute.Set{equivalent:attribute.Distinct{iface:[2]attribute.KeyValue{attribute.KeyValue{Key:"grpc.method", Value:attribute.Value{vtype:4, numeric:0x0, stringly:"grpc.testing.TestService/UnaryCall", slice:interface {}(nil)}}, attribute.KeyValue{Key:"grpc.status", Value:attribute.Value{vtype:4, numeric:0x0, stringly:"OK", slice:interface {}(nil)}}}}}, StartTime:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Time:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Count:0x1, Bounds:[]float64{0, 1024, 2048, 4096, 16384, 65536, [262](https://github.com/grpc/grpc-go/actions/runs/9981600990/job/27585576492?pr=7397#step:8:263)144, 1.048576e+06, 4.194304e+06, 1.6777216e+07, 6.7108864e+07, 2.68435456e+08, 1.073741824e+09, 4.294967296e+09}, BucketCounts:[]uint64{0x0, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, Min:metricdata.Extrema[int64]{value:57, valid:true}, Max:metricdata.Extrema[int64]{value:57, valid:true}, Sum:57, Exemplars:[]metricdata.Exemplar[int64](nil)}
            ]
        tlogger.go:116: INFO clientconn.go:540 [core] [Channel #15]Channel Connectivity change to SHUTDOWN  (t=+19.182838ms)
        tlogger.go:116: INFO resolver_wrapper.go:100 [core] [Channel #15]Closing the name resolver  (t=+19.281922ms)
        tlogger.go:116: INFO balancer_wrapper.go:144 [core] [Channel #15]ccBalancerWrapper: closing  (t=+19.360909ms)
        tlogger.go:116: INFO clientconn.go:1207 [core] [Channel #15 SubChannel #16]Subchannel Connectivity change to SHUTDOWN  (t=+19.470213ms)
        tlogger.go:116: INFO clientconn.go:1556 [core] [Channel #15 SubChannel #16]Subchannel deleted  (t=+19.530595ms)
        tlogger.go:116: INFO clientconn.go:310 [core] [Channel #15]Channel deleted  (t=+19.709438ms)
        tlogger.go:116: INFO server.go:817 [core] [Server #13 ListenSocket #14]ListenSocket deleted  (t=+19.808393ms)
FAIL
FAIL	google.golang.org/grpc/stats/opentelemetry	0.173s
@zasweq
Copy link
Contributor

zasweq commented Jul 30, 2024

Will run this on g3. Error message seems strange, will try and figure out what's happening.

@purnesh42H purnesh42H added the Area: Observability Includes Stats, Tracing, Channelz, Healthz, Binlog, Reflection, Admin, GCP Observability label Sep 7, 2024
@easwars
Copy link
Contributor Author

easwars commented Nov 6, 2024

@arjan-bal
Copy link
Contributor

@easwars
Copy link
Contributor Author

easwars commented Dec 13, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Observability Includes Stats, Tracing, Channelz, Healthz, Binlog, Reflection, Admin, GCP Observability P2 Type: Bug
Projects
None yet
Development

No branches or pull requests

4 participants