Skip to content

runtime error: index out of range #927

Closed
@camper42

Description

base spark image: 3.0.0-rc2
spark-on-k8s-operator: current master(8c480ac)

I0527 15:43:43.258750       9 webhook.go:246] Serving admission request
2020/05/27 15:43:43 http: panic serving 172.18.4.56:56240: runtime error: index out of range [1] with length 1
goroutine 465 [running]:
net/http.(*conn).serve.func1(0xc000239a40)
        /usr/local/go/src/net/http/server.go:1772 +0x139
panic(0x155f660, 0xc000313380)
        /usr/local/go/src/runtime/panic.go:973 +0x3e3
github.com/GoogleCloudPlatform/spark-on-k8s-operator/pkg/webhook.addEnvVars(0xc000d27000, 0xc000c89500, 0x0, 0x5, 0x0)
        /workspace/pkg/webhook/patch.go:213 +0xc7b
github.com/GoogleCloudPlatform/spark-on-k8s-operator/pkg/webhook.patchSparkPod(0xc000d27000, 0xc000c89500, 0x19, 0xc000c89500, 0x0)
        /workspace/pkg/webhook/patch.go:63 +0x929
github.com/GoogleCloudPlatform/spark-on-k8s-operator/pkg/webhook.mutatePods(0xc000471080, 0x1835d20, 0xc00068e960, 0x0, 0x0, 0x1837260, 0xc000471080, 0x1837260)
        /workspace/pkg/webhook/webhook.go:554 +0x591
github.com/GoogleCloudPlatform/spark-on-k8s-operator/pkg/webhook.(*WebHook).serve(0xc000152000, 0x1866a60, 0xc000410fc0, 0xc000774500)
        /workspace/pkg/webhook/webhook.go:278 +0xb1a
net/http.HandlerFunc.ServeHTTP(0xc00068e970, 0x1866a60, 0xc000410fc0, 0xc000774500)
        /usr/local/go/src/net/http/server.go:2012 +0x44
net/http.(*ServeMux).ServeHTTP(0xc00032e200, 0x1866a60, 0xc000410fc0, 0xc000774500)
        /usr/local/go/src/net/http/server.go:2387 +0x1a5
net/http.serverHandler.ServeHTTP(0xc0002802a0, 0x1866a60, 0xc000410fc0, 0xc000774500)
        /usr/local/go/src/net/http/server.go:2807 +0xa3
net/http.(*conn).serve(0xc000239a40, 0x1869460, 0xc000309540)
        /usr/local/go/src/net/http/server.go:1895 +0x86c
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:2933 +0x35c

task failed due to 20/05/27 15:48:08 WARN TaskSetManager: Lost task 47.0 in stage 1.0 (TID 38, 172.18.12.113, executor 1): org.apache.hadoop.security.AccessControlException: Permission denied: user=5089, access=WRITE, inode="/user/camper42/streaming_checkpoint/query2":camper42:supergroup:drwxr-xr-x

5089 is spark_uid in spark Dockerfile, and I set runAsUser: 3631

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions