[Flytekit] Envd builder with extra copy commands

[mao3267]

Tracking issue

Related to #2715, after adding support for extra copy commands in the default builder, we also want to extend this support to the envd builder.

Why are the changes needed?

When creating images with ImageSpec on a remote cluster, we may need to copy additional files or directories required during the container build process. To address this, we aim to support extra copy commands in ImageSpec for copying files and directories into the container’s /root directory.

What changes were proposed in this pull request?

1. Now we support ImageSpec with copy commands to be built by the envd builder.

Example Usage:
input.txt

test for document example

build_image.py

from flytekit.image_spec import ImageSpec
from flytekit import task, workflow

image_spec = ImageSpec(
    name="envd-copy-cmds",
    registry="localhost:30000",
   # envd is the default builder for imageSpec
    apt_packages=["git", "gh"],
    copy=["local_test/input.txt"],
    env={"GH_TOKEN": "<YOUR_GITHUB_TOKEN>"},
    commands=[
        "git clone https://github.com/flyteorg/flytekit.git", 
        "cd flytekit", 
        "gh pr checkout 2774", 
        "pip install -e ."
    ]
)

@task(container_image=image_spec)
def my_task() -> str:
    with open("/root/local_test/input.txt", "r") as f:
        return f.read()


@workflow
def my_wf() -> str:
    return my_task()

How was this patch tested?

1. Run the example above with remote execution.
2. Added tests in plugins/flytekit-envd/tests/test_image_spec.py to verify the correctness of the envd configuration and its ability to be built.

Setup process

git clone https://github.com/flyteorg/flytekit.git
gh pr checkout 2774
make setup && pip install -e .

Screenshots

Screenshots of running pyflyte run --remote build_image.py my_wf.

• Remote Execution

• Terminal
  The entire building process is too lengthy; therefore, only the start and the end of the build process are displayed here.

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

#2715

Docs link

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 94.87%. Comparing base (e60c152) to head (aca164a).
Report is 37 commits behind head on master.

Additional details and impacted files

@@             Coverage Diff             @@
##           master    #2774       +/-   ##
===========================================
+ Coverage   75.95%   94.87%   +18.91%     
===========================================
  Files         194       30      -164     
  Lines       19841     1209    -18632     
  Branches     3913        0     -3913     
===========================================
- Hits        15071     1147    -13924     
+ Misses       4086       62     -4024     
+ Partials      684        0      -684     

Flag	Coverage Δ
	?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.