Error handling inconsistency when adding multiple files from an absolute path outside the Docker build context

[smuu]

Contributing guidelines

• I've read the contributing guidelines and wholeheartedly agree

I've found a bug and checked that ...

• ... the documentation does not mention anything about my problem
• ... there are no open or closed issues that are related to my problem

Description

When adding multiple files from an absolute path, which is outside the docker build context, only the last line to add files is marked as ERROR, and all the previous ones are marked as CACHED, which indicates that it was able to add the file.

Expected behaviour

A visual ERROR for 2/3 instead of CACHED.

Actual behaviour

➤  docker buildx build .
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
[+] Building 0.5s (7/7) FINISHED                                                                                                                                                      
 => [internal] load .dockerignore                                                                                                                                                0.0s
 => => transferring context: 2B                                                                                                                                                  0.0s
 => [internal] load build definition from Dockerfile                                                                                                                             0.0s
 => => transferring dockerfile: 91B                                                                                                                                              0.0s
 => [internal] load metadata for docker.io/library/alpine:latest                                                                                                                 0.4s
 => [1/3] FROM docker.io/library/alpine@sha256:82d1e9d7ed48a7523bdebc18cf6290bdb97b82302a8a9c27d4fe885949ea94d1                                                                  0.0s
 => => resolve docker.io/library/alpine@sha256:82d1e9d7ed48a7523bdebc18cf6290bdb97b82302a8a9c27d4fe885949ea94d1                                                                  0.0s
 => [internal] load build context                                                                                                                                                0.0s
 => => transferring context: 2B                                                                                                                                                  0.0s
 => CACHED [2/3] ADD /tmp/file1 file1                                                                                                                                            0.0s
 => ERROR [3/3] ADD /tmp/file2 file2                                                                                                                                             0.0s
------
 > [3/3] ADD /tmp/file2 file2:
------
Dockerfile:4
--------------------
   2 |     
   3 |     ADD /tmp/file1 file1
   4 | >>> ADD /tmp/file2 file2
--------------------
ERROR: failed to solve: failed to compute cache key: failed to calculate checksum of ref 779frby5mzfnvh0rbzh87v1uu::9him080gk30ca77e8gi95mer5: "/tmp/file2": not found

Buildx version

github.com/docker/buildx v0.10.5 86bdced

Docker info

Client: Docker Engine - Community
 Version:    24.0.2
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.10.5
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.18.1
    Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
 Containers: 2
  Running: 1
  Paused: 0
  Stopped: 1
 Images: 252
 Server Version: 24.0.2
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: systemd
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 3dce8eb055cbb6872793272b4f20ed16117344f8
 runc version: v1.1.7-0-g860f061
 init version: de40ad0
 Security Options:
  apparmor
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 5.19.0-45-generic
 Operating System: Ubuntu 22.04.2 LTS
 OSType: linux
 Architecture: x86_64
 CPUs: 20
 Total Memory: 31.03GiB
 Name: samuel-celestia
 ID: I3LI:ACFC:5SWU:VAWC:K6MZ:JKVZ:ST6F:NMKB:UWU2:DJLS:CIOV:XQV7
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Username: smuu
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

Builders list

NAME/NODE               DRIVER/ENDPOINT             STATUS   BUILDKIT                              PLATFORMS
awesome_goldwasser      docker-container                                                           
  awesome_goldwasser0   unix:///var/run/docker.sock inactive                                       
epic_wilbur             docker-container                                                           
  epic_wilbur0          unix:///var/run/docker.sock inactive                                       
wonderful_mirzakhani    docker-container                                                           
  wonderful_mirzakhani0 unix:///var/run/docker.sock inactive                                       
youthful_goldwasser *   docker-container                                                           
  youthful_goldwasser0  unix:///var/run/docker.sock running  v0.11.6                               linux/amd64, linux/amd64/v2, linux/amd64/v3, linux/386
default                 docker                                                                     
  default               default                     running  v0.11.7-0.20230525183624-798ad6b0ce9f linux/amd64, linux/amd64/v2, linux/amd64/v3, linux/386

Configuration

FROM alpine

ADD /tmp/file1 file1
ADD /tmp/file2 file2

Build logs

No response

Additional info

Happy to provide more information if needed.

[crazy-max]

It works fine for me using plain progress output:

$ BUILDKIT_PROGRESS=plain docker buildx build .
0 building with "default" instance using docker driver

#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 92B done
#1 DONE 0.1s

#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.1s

#3 [internal] load metadata for docker.io/library/alpine:latest
#3 ...

#4 [auth] library/alpine:pull token for registry-1.docker.io
#4 DONE 0.0s

#3 [internal] load metadata for docker.io/library/alpine:latest
#3 DONE 1.4s

#5 [1/3] FROM docker.io/library/alpine@sha256:82d1e9d7ed48a7523bdebc18cf6290bdb97b82302a8a9c27d4fe885949ea94d1
#5 CACHED

#6 [internal] load build context
#6 transferring context: 2B done
#6 DONE 0.1s

#7 [2/3] ADD /tmp/file1 file1
#7 ERROR: failed to calculate checksum of ref e9fa4e2f-dfe9-470c-b0dd-310710788fd2::wkvofq56vfgsxu06kfd255pw5: failed to walk /var/lib/docker/tmp/buildkit-mount1365988029/tmp: lstat /var/lib/docker/tmp/buildkit-mount1365988029/tmp: no such file or directory

#8 [3/3] ADD /tmp/file2 file2
#8 ERROR: failed to calculate checksum of ref e9fa4e2f-dfe9-470c-b0dd-310710788fd2::wkvofq56vfgsxu06kfd255pw5: failed to walk /var/lib/docker/tmp/buildkit-mount2432927423/tmp: lstat /var/lib/docker/tmp/buildkit-mount2432927423/tmp: no such file or directory
------
 > [2/3] ADD /tmp/file1 file1:
------
------
 > [3/3] ADD /tmp/file2 file2:
------
Dockerfile:3
--------------------
   1 |     FROM alpine
   2 |
   3 | >>> ADD /tmp/file1 file1
   4 |     ADD /tmp/file2 file2
   5 |
--------------------
ERROR: failed to solve: failed to compute cache key: failed to calculate checksum of ref e9fa4e2f-dfe9-470c-b0dd-310710788fd2::wkvofq56vfgsxu06kfd255pw5: failed to walk /var/lib/docker/tmp/buildkit-mount1365988029/tmp: lstat /var/lib/docker/tmp/buildkit-mount1365988029/tmp: no such file or directory

But with tty I still have two errors but here last one is marked:

$ BUILDKIT_PROGRESS=tty docker buildx build .
[+] Building 0.5s (7/7) FINISHED                                                                                                                                                                                  docker:default
 => [internal] load build definition from Dockerfile                                                                                                                                                                        0.1s
 => => transferring dockerfile: 92B                                                                                                                                                                                         0.0s 
 => [internal] load .dockerignore                                                                                                                                                                                           0.0s 
 => => transferring context: 2B                                                                                                                                                                                             0.0s 
 => [internal] load metadata for docker.io/library/alpine:latest                                                                                                                                                            0.4s 
 => CACHED [1/3] FROM docker.io/library/alpine@sha256:82d1e9d7ed48a7523bdebc18cf6290bdb97b82302a8a9c27d4fe885949ea94d1                                                                                                      0.0s
 => [internal] load build context                                                                                                                                                                                           0.0s 
 => => transferring context: 2B                                                                                                                                                                                             0.0s 
 => ERROR [2/3] ADD /tmp/file1 file1                                                                                                                                                                                        0.0s 
 => ERROR [3/3] ADD /tmp/file2 file2                                                                                                                                                                                        0.0s 
------
 > [2/3] ADD /tmp/file1 file1:
------
------
 > [3/3] ADD /tmp/file2 file2:
------
Dockerfile:4
--------------------
   2 |
   3 |     ADD /tmp/file1 file1
   4 | >>> ADD /tmp/file2 file2
   5 |
--------------------
ERROR: failed to solve: failed to compute cache key: failed to calculate checksum of ref e9fa4e2f-dfe9-470c-b0dd-310710788fd2::9aceq94s3sbatu8apvrzkmt58: failed to walk /var/lib/docker/tmp/buildkit-mount3761999968/tmp: lstat /var/lib/docker/tmp/buildkit-mount3761999968/tmp: no such file or directory

So we are inconsistent between tty and plain but not sure why you have ADD /tmp/file1 file1 cached though.

[typoworx-de]

I'm having similar problems driving me crazy. Sometimes it build, somtimes does not! Using pure "docker build" most times works. But using docker-compose does not. Even removing buildx features (--chmod) seems to result in correct build. But if one wants to use such features, it does not work!

In my case it is the docker-entrypoint.sh that fails to be added:

COPY --chmod=a+x ${PWD}/docker-entrypoint.sh /docker-entrypoint.sh

Resulting in:

 > [my-app stage-release 3/6] COPY --chmod=a+x /docker-entrypoint.sh /docker-entrypoint.sh:
------
failed to solve: failed to compute cache key: failed to calculate checksum of ref pzhz5wxhfuk4nt6gvf90y7xb3::dw5j5js40bw7cxycqxcvvevv4: "/docker-entrypoint.sh": not found