Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing resource results in huge error log volume "not found" #6540

Open
1 task done
joran-fonjallaz opened this issue Oct 3, 2024 · 1 comment
Open
1 task done
Labels
bug Something isn't working
Milestone

Comments

@joran-fonjallaz
Copy link

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

When a resource is missing in the cluster, like

  • a Service on which an HTTPRoute points
  • a Secret on which a Consumer depends
  • a Plugin on which an HTTPRoute depends

the KIC controller container creates ~20 log entries per second for each missing dependency. Example here
image

during POC and discovery phases, it creates absolute madness of logs if things are not cleaned up immediately. I think 1 log entry per second telling that a resource is missing is more than enough.

Expected Behavior

The KIC logs get at max 1 log per second if a resource is missing. Maybe even just a few logs per minute.

Steps To Reproduce

e.g. create an HTTPRoute referring a Service that doesn't exist


apiVersion: gateway.networking.k8s.io/v1
kind: HTTPRoute
metadata:
  name: echo
  annotations:
    konghq.com/strip-path: 'true'
spec:
  parentRefs:
  - name: kong
  rules:
  - matches:
    - path:
        type: PathPrefix
        value: /echo
    backendRefs:
    - name: nonExistingServiceName # <-- KIC should start logging ~20 logs/second
      kind: Service
      port: 1027

Kong Ingress Controller version

3.3.1

Kubernetes version

1.30.3-gke

Anything else?

Thank you :)

@joran-fonjallaz joran-fonjallaz added the bug Something isn't working label Oct 3, 2024
@randmonkey
Copy link
Contributor

@joran-fonjallaz Thanks for pointing out. We will try to optimize logs to reduce excessive amount of error logs.

@randmonkey randmonkey added this to the KIC v3.4.x milestone Oct 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants