Skip to content

Report on the issue of not being able to pass multiple arguments to the docker_args argument of the azure.ai.ml.command function in Azure Machine Learning SDK V2 #30466

Closed
@KazuOnuki

Description

@KazuOnuki

Hi, All.
This is a report of an issue by Azure Machine Learning Support Engineer.
In the command function of SDK V2, docker_args argument type is a string and multiple arguments cannot be passed.

command

image

The sample code to reproduce the event is as follows

  • Sample Code
# Problem sample
job = command(
  command='df -h && sleep 30 && exit',
  environment='AzureML-sklearn-0.24-ubuntu18.04-py37-cpu:9',
  compute='<Compute Name>', #Compute instance
  docker_args='--cap-add=SYS_ADMIN --device=/dev/fuse --security-opt apparmor:unconfined'
)
# submit the command
returned_job = ml_client.jobs.create_or_update(job)
  • Error Message
Failed to start Docker container xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx(masking)-execution-wrapper due to: Invalid container capability (cap-add): SYS_ADMIN --device=/dev/fuse --security-opt apparmor:unconfined. Supported values: ALL, AUDIT_CONTROL, AUDIT_READ, AUDIT_WRITE, BLOCK_SUSPEND, BPF, CHECKPOINT_RESTORE, CHOWN, DAC_OVERRIDE, DAC_READ_SEARCH, FOWNER, FSETID, IPC_LOCK, IPC_OWNER, KILL, LEASE, LINUX_IMMUTABLE, MAC_ADMIN, MAC_OVERRIDE, MKNOD, NET_ADMIN, NET_BIND_SERVICE, NET_BROADCAST, NET_RAW, PERFMON, SETFCAP, SETGID, SETPCAP, SETUID, SYS_ADMIN, SYS_BOOT, SYS_CHROOT, SYS_MODULE, SYS_NICE, SYS_PACCT, SYS_PTRACE, SYS_RAWIO, SYS_RESOURCE, SYS_TIME, SYS_TTY_CONFIG, SYSLOG, WAKE_ALARM. This error may occur if invalid or unsupported values are passed in the Docker arguments (for example with `--cap-add` ou `--cap-drop`).

As a result of discussions with the Azure Machine Learning Product Group, it has been determined that the error occurs because the command function in the following public information is implemented as a string, whereas it is passed as a list.
I assume that the correction of the implementation of the command function is being checked internally, but I would appreciate it if you could also correct this document.


Document Details

Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

Metadata

Metadata

Assignees

Labels

ClientThis issue points to a problem in the data-plane of the library.Machine LearningService AttentionWorkflow: This issue is responsible by Azure service team.customer-reportedIssues that are reported by GitHub users external to the Azure organization.feature-requestThis issue requires a new behavior in the product in order be resolved.issue-addressedWorkflow: The Azure SDK team believes it to be addressed and ready to close.questionThe issue doesn't require a change to the product in order to be resolved. Most issues start as that

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions