Open
Description
Describe the bug
Running avg_over_time query fails when run against certain intervals of time
Other functions _over_time seem to behave properly without failing.
The job does not need to exist, no data is needed to reproduce the error. The problem is independent of the producer, collector or log format.
To Reproduce
Steps to reproduce the behavior:
- Run
avg_over_time({job="nojob/nojob"} | json | keep http_route, response_time | unwrap response_time [$__auto]) - Alternative query from @slim-bean that exhibits the same behaviour
avg by (http_route) (avg_over_time({job="nojob/nojob"} |json | keep http_route, response_time | unwrap response_time [$__auto])) - Use Grafana UI and set a range of time last 5 min, get empty (or values)
{
"queries": [
{
"refId": "A",
"expr": "avg_over_time({job=\"pi-logs-custom3/pi-logs-custom3\"} |json | keep http_route, response_time | unwrap response_time [$__auto])",
"queryType": "range",
"datasource": {
"type": "loki",
"uid": "grafanacloud-logs"
},
"editorMode": "code",
"legendFormat": "",
"datasourceId": 7,
"intervalMs": 200,
"maxDataPoints": 1343
}
],
"from": "1719009561800",
"to": "1719009861802"
}
- Use Grafana UI and set a range of time last 6 hours, get 500 error
aggregation operator '"sum"' without grouping
Payload:
{
"queries": [
{
"refId": "A",
"expr": "avg_over_time({job=\"pi-logs-custom3/pi-logs-custom3\"} |json | keep http_route, response_time | unwrap response_time [$__auto])",
"queryType": "range",
"datasource": {
"type": "loki",
"uid": "grafanacloud-logs"
},
"editorMode": "code",
"legendFormat": "",
"datasourceId": 7,
"intervalMs": 15000,
"maxDataPoints": 1343
}
],
"from": "1718988150000",
"to": "1719009750941"
}
{
"results": {
"A": {
"error": "aggregation operator '\"sum\"' without grouping",
"errorSource": "downstream",
"status": 500
}
}
}
Expected behavior
I expect values being returned, or empty if no data is found
Environment:
- Grafana Cloud
- Grafana Cloud Loki
Screenshots, Promtail config, or terminal output
n/a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Metadata
Assignees
Labels
Somehing is not working as expectedSomehing is not working as expected