Conformance: EPP Panics #1164
Description
#1151 added initial support for loading EPP plugins from a config file. This PR did not update the EPP manifest used by conformance tests. When running the conformance tests, the EPP panics:
$ kubectl logs primary-app-endpoint-picker-9444f54-h4gk8 -n gateway-conformance-app-backend
{"level":"info","ts":"2025-07-15T16:24:21Z","logger":"setup","caller":"runner/runner.go:211","msg":"Flags processed","flags":{"DestinationEndpointHintMetadataNamespace":"envoy.lb","certPath":"","configFile":"","configText":"","destinationEndpointHintKey":"x-gateway-destination-endpoint","enablePprof":true,"grpcHealthPort":9003,"grpcPort":9002,"healthChecking":false,"kubeconfig":"","kvCacheUsagePercentageMetric":"vllm:gpu_cache_usage_perc","loraInfoMetric":"vllm:lora_requests_info","metricsPort":9090,"modelServerMetricsPath":"/metrics","modelServerMetricsPort":0,"poolName":"primary-inference-pool","poolNamespace":"gateway-conformance-app-backend","refreshMetricsInterval":50000000,"refreshPrometheusMetricsInterval":5000000000,"secureServing":true,"totalQueuedRequestsMetric":"vllm:num_requests_waiting","v":4,"zap-devel":true,"zap-encoder":{},"zap-log-level":{},"zap-stacktrace-level":{},"zap-time-encoding":{}}}
{"level":"info","ts":"2025-07-15T16:24:21Z","logger":"saturation-detector-config","caller":"env/env.go:34","msg":"Environment variable not set, using default value","key":"SD_QUEUE_DEPTH_THRESHOLD","defaultValue":5}
{"level":"info","ts":"2025-07-15T16:24:21Z","logger":"saturation-detector-config","caller":"env/env.go:34","msg":"Environment variable not set, using default value","key":"SD_KV_CACHE_UTIL_THRESHOLD","defaultValue":0.8}
{"level":"info","ts":"2025-07-15T16:24:21Z","logger":"saturation-detector-config","caller":"env/env.go:34","msg":"Environment variable not set, using default value","key":"SD_METRICS_STALENESS_THRESHOLD","defaultValue":0.2}
{"level":"info","ts":"2025-07-15T16:24:21Z","logger":"saturation-detector-config","caller":"saturationdetector/config.go:68","msg":"SaturationDetector configuration loaded from env","config":"&{QueueDepthThreshold:5 KVCacheUtilThreshold:0.8 MetricsStalenessThreshold:200ms}"}
{"level":"info","ts":"2025-07-15T16:24:21Z","logger":"setup","caller":"runner/runner.go:267","msg":"Enabling pprof handlers"}
{"level":"Level(-2)","ts":"2025-07-15T16:24:21Z","caller":"manager/internal.go:196","msg":"Registering metrics http server extra handler","path":"/debug/pprof/heap"}
{"level":"Level(-2)","ts":"2025-07-15T16:24:21Z","caller":"manager/internal.go:196","msg":"Registering metrics http server extra handler","path":"/debug/pprof/goroutine"}
{"level":"Level(-2)","ts":"2025-07-15T16:24:21Z","caller":"manager/internal.go:196","msg":"Registering metrics http server extra handler","path":"/debug/pprof/allocs"}
{"level":"Level(-2)","ts":"2025-07-15T16:24:21Z","caller":"manager/internal.go:196","msg":"Registering metrics http server extra handler","path":"/debug/pprof/threadcreate"}
{"level":"Level(-2)","ts":"2025-07-15T16:24:21Z","caller":"manager/internal.go:196","msg":"Registering metrics http server extra handler","path":"/debug/pprof/block"}
{"level":"Level(-2)","ts":"2025-07-15T16:24:21Z","caller":"manager/internal.go:196","msg":"Registering metrics http server extra handler","path":"/debug/pprof/mutex"}
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x1ca1f51]
goroutine 1 [running]:
sigs.k8s.io/gateway-api-inference-extension/pkg/epp/scheduling.NewSchedulerWithConfig(...)
/src/pkg/epp/scheduling/scheduler.go:40
sigs.k8s.io/gateway-api-inference-extension/cmd/epp/runner.(*Runner).Run(0xc0006e5f30, {0x26349c8, 0xc0006308c0})
/src/cmd/epp/runner/runner.go:282 +0x5f1
main.main()
/src/cmd/epp/main.go:33 +0x6c