Error: COPY failed: stat /var/lib/docker/tmp/docker-builder039591276/download-kafka.sh: no such file or directory

[eitanh]

what am i doing wrong?

docker compose:

version: '2'
services:
  zookeeper:
    image: wurstmeister/zookeeper
    ports:
      - "2181:2181"
  kafka:
    build: .
    ports:
      - "9092:9092"
    environment:
      KAFKA_ADVERTISED_HOST_NAME: 192.168.20.21
      KAFKA_CREATE_TOPICS: "test:1:1"
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock

Dockerfile

FROM anapsix/alpine-java

ARG kafka_version=1.0.0
ARG scala_version=2.12

MAINTAINER wurstmeister

ENV KAFKA_VERSION=$kafka_version \
    SCALA_VERSION=$scala_version \
    KAFKA_HOME=/opt/kafka \
    PATH=${PATH}:${KAFKA_HOME}/bin

COPY download-kafka.sh start-kafka.sh broker-list.sh create-topics.sh /tmp/

RUN apk add --update unzip wget curl docker jq coreutils \
 && chmod a+x /tmp/*.sh \
 && mv /tmp/start-kafka.sh /tmp/broker-list.sh /tmp/create-topics.sh /usr/bin \
 && /tmp/download-kafka.sh \
 && tar xfz /tmp/kafka_${SCALA_VERSION}-${KAFKA_VERSION}.tgz -C /opt \
 && rm /tmp/kafka_${SCALA_VERSION}-${KAFKA_VERSION}.tgz \
 && ln -s /opt/kafka_${SCALA_VERSION}-${KAFKA_VERSION} /opt/kafka \
 && rm /tmp/*

VOLUME ["/kafka"]

# Use "exec" form so that it runs as PID 1 (useful for graceful shutdown)
CMD ["start-kafka.sh"]

[bryanleekw]

what is the detail of log file?

[sscaling]

@eitanh is this still an issue?

If so, can you provide the relevant information, i.e.

1. What OS and version are you building on
2. What is the version of the Docker daemon
3. What is the version of the Docker cli
   3a. What version of Docker-compose are you running (if relevant)
4. What command do you execute that triggers this error

[truetone]

I have this same issue:

What OS and version are you building on
macOS High Sierra (10.13.3)

What is the version of the Docker daemon
Output from docker version:

Client:
 Version:	17.12.0-ce
 API version:	1.35
 Go version:	go1.9.2
 Git commit:	c97c6d6
 Built:	Wed Dec 27 20:03:51 2017
 OS/Arch:	darwin/amd64

Server:
 Engine:
  Version:	17.12.0-ce
  API version:	1.35 (minimum version 1.12)
  Go version:	go1.9.2
  Git commit:	c97c6d6
  Built:	Wed Dec 27 20:12:29 2017
  OS/Arch:	linux/amd64
  Experimental:	true

What is the version of the Docker cli

Covered in the output above?

What version of Docker-compose are you running (if relevant)

Output from docker-compose version:

docker-compose version 1.18.0, build 8dd22a9
docker-py version: 2.6.1
CPython version: 2.7.12
OpenSSL version: OpenSSL 1.0.2j  26 Sep 2016

What command do you execute that triggers this error

docker-compose up -d

Output from that command:

Building kafka
Step 1/9 : FROM anapsix/alpine-java
latest: Pulling from anapsix/alpine-java
605ce1bd3f31: Already exists
bb91b357cb54: Already exists
Digest: sha256:<sha hash>
Status: Downloaded newer image for anapsix/alpine-java:latest
 ---> fedcd26522ec
Step 2/9 : ARG kafka_version=1.0.0
 ---> Running in 321736e87437
Removing intermediate container 321736e87437
 ---> 407e1b011e7f
Step 3/9 : ARG scala_version=2.12
 ---> Running in f5e362402116
Removing intermediate container f5e362402116
 ---> 722a71ac2bd8
Step 4/9 : MAINTAINER wurstmeister
 ---> Running in 1da038ebaefe
Removing intermediate container 1da038ebaefe
 ---> e70126f77ff2
Step 5/9 : ENV KAFKA_VERSION=$kafka_version     SCALA_VERSION=$scala_version     KAFKA_HOME=/opt/kafka     PATH=${PATH}:${KAFKA_HOME}/bin
 ---> Running in 39208d9a8597
Removing intermediate container 39208d9a8597
 ---> 2add94dd8ede
Step 6/9 : COPY download-kafka.sh start-kafka.sh broker-list.sh create-topics.sh /tmp/
ERROR: Service 'kafka' failed to build: COPY failed: stat /var/lib/docker/tmp/docker-builder052534341/download-kafka.sh: no such file or directory

Nothing in ~/Library/Containers/com.docker.docker/Data/com.docker.driver.amd64-linux/log (no logs at all).

[sscaling]

@truetone - thanks for the info - could well be related to #261

Could either you or @eitanh try adding the sync command in as per https://github.com/wurstmeister/kafka-docker/pull/261/files#diff-3254677a7917c6c01f55212f86c57fbfL18 and see if that fixes the issue?

[truetone]

@sscaling No luck. Exact same error as above.

[sscaling]

Thanks for trying @truetone. I've just nuked docker, and rebuilt everything without issue. I wonder what the difference is

I'm explicitly starting the build with docker-compose build (rather than implicitly via up)

I have the same version of docker & compose. Also on High Siera 10.13.3

$ docker version
Client:
 Version:	17.12.0-ce
 API version:	1.35
 Go version:	go1.9.2
 Git commit:	c97c6d6
 Built:	Wed Dec 27 20:03:51 2017
 OS/Arch:	darwin/amd64

Server:
 Engine:
  Version:	17.12.0-ce
  API version:	1.35 (minimum version 1.12)
  Go version:	go1.9.2
  Git commit:	c97c6d6
  Built:	Wed Dec 27 20:12:29 2017
  OS/Arch:	linux/amd64
  Experimental:	true

$ docker-compose version
docker-compose version 1.18.0, build 8dd22a9
docker-py version: 2.6.1
CPython version: 2.7.12
OpenSSL version: OpenSSL 1.0.2j  26 Sep 2016

[truetone]

@sscaling, weird. I rmed my images and ran docker build . Same error again:

Sending build context to Docker daemon  39.83MB
Step 1/9 : FROM anapsix/alpine-java
 ---> fedcd26522ec
Step 2/9 : ARG kafka_version=1.0.0
 ---> Using cache
 ---> 407e1b011e7f
Step 3/9 : ARG scala_version=2.12
 ---> Using cache
 ---> 722a71ac2bd8
Step 4/9 : MAINTAINER wurstmeister
 ---> Using cache
 ---> e70126f77ff2
Step 5/9 : ENV KAFKA_VERSION=$kafka_version     SCALA_VERSION=$scala_version     KAFKA_HOME=/opt/kafka     PATH=${PATH}:${KAFKA_HOME}/bin
 ---> Using cache
 ---> 2add94dd8ede
Step 6/9 : COPY download-kafka.sh start-kafka.sh broker-list.sh create-topics.sh /tmp/
COPY failed: stat /var/lib/docker/tmp/docker-builder214653194/download-kafka.sh: no such file or directory

I ran it again w/ --no-cache. Same problem.

[truetone]

This was my error. I was trying to run this with the DockerFile alone. Once I cloned the repo (and thus got the .sh files in question), I ran docker-compose up -d and everything worked as expected.

[sscaling]

OK, Issue looks the same as the OP. So closing for now.

@truetone - thanks for the perseverance .

[kiknaio]

This was my error. I was trying to run this with the DockerFile alone. Once I cloned the repo (and thus got the .sh files in question), I ran docker-compose up -d and everything worked as expected.

Awesome, it helped me also :)

[jinho1410]

I still get the same error.
docker-compose -f [DockerFile Path] build
In my case an error occurred when there was a docker folder name in context path.
Problems installing powerdns-admin
change powerdns-admin / docker path powerdns-admin / docker-source
Problem solved.

여전히 같은 오류가 발생합니다.
docker-compose -f [DockerFile Path] build
저의 경우 context path 에 docker 폴더명이 있을경우 오류가 발생했습니다.
powerdns-admin 설치시 문제발생
powerdns-admin/docker 경로 변경 powerdns-admin/docker-source
문제 해결됨.