Allow configuration of GRPC ruler

[keenobi]

Is your feature request related to a problem? Please describe.
We use ruler in remote evaluation mode : https://grafana.com/docs/loki/latest/community/lids/0002-remoteruleevaluation/
However the GRPC client cannot be configured and as a result we cannot configure : max_recv_msg_size or max_send_msg_size and we have currently the well-known error :
[eceived message larger than max (8799311 vs. 41943](grpc: received message larger than max (8799311 vs. 4194304)")

Describe the solution you'd like
Allow to configure grpc_client_config and or use the configuration in server block.

Describe alternatives you've considered
No other alternative seems relevent

Additional context
None

[mrethers]

Digging down, we could go about it 2 ways:

1- instead of the separate grpc client created in

loki/pkg/ruler/evaluator_remote.go

Line 360 in fdf8632

type QueryFrontendConfig struct {

, use the ruler.client config
2- Allow configuration of the GRPC client as in querier.frontend-grpc-client or querier.scheduler-grpc-client. Would result in ruler.evaluation.query_frontend having the grpc_client config inline or under uler.evaluation.query_frontend.grpc-client

Seems like 2- is the preferred approach throughout.

[dhoward-medallia]

I disagree that this is a feature...this is a bug that needs to be resolved with some urgency. Right now, remote execution isn't possible for our implementation because of this.

My reasoning here is that if you allow changes to happen across all components except one, then if any of those configured components use an updated config, the integration just doesn't work. So we either need to make this configurable for the ruler, or we need to remove the custom config across all other components.