Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions docs/userguide/Enflame-device/enable-enflame-gcu-sharing.md
Original file line number Diff line number Diff line change
Expand Up @@ -82,6 +82,8 @@ spec:

## Device UUID Selection

### Pod Annotation

You can specify which GPU devices to use or exclude using annotations:

```yaml
Expand All @@ -98,6 +100,11 @@ spec:
# ... rest of pod spec
```

### Node Annotation

`enflame.com/nouse-gpuuuid`:
String type, supports multiple device IDs. Multiple devices should be separated by comma, ie: "node1-enflame-2,node1-enflame-3". If set, HAMI will not allocate any devices defined in this string to Pods during scheduling.

> **NOTE:** The device ID format is `{node-name}-enflame-{index}`. You can find the available device IDs in the node status.

### Finding Device UUIDs
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -102,6 +102,8 @@ spec:

## Device UUID Selection

### Pod Annotation

You can specify which GPU devices to use or exclude using annotations:

```yaml
Expand All @@ -118,6 +120,11 @@ spec:
# ... rest of pod spec
```

### Node Annotation

`iluvatar.ai/nouse-gpuuuid`:
String type, supports multiple device IDs. Multiple devices should be separated by comma, ie: "node1-iluvatar-2,node1-iluvatar-3". If set, HAMI will not allocate any devices defined in this string to Pods during scheduling.

> **NOTE:** The device ID format is `{node-name}-iluvatar-{index}`. You can find the available device IDs in the node status.

### Finding Device UUIDs
Expand Down
6 changes: 6 additions & 0 deletions docs/userguide/configure.md
Original file line number Diff line number Diff line change
Expand Up @@ -81,6 +81,12 @@ helm install hami hami-charts/hami --set devicePlugin.deviceMemoryScaling=5 ...
| `hami.io/gpu-scheduler-policy` | String | GPU scheduling policy: `"binpack"` allocates the pod to the same GPU card for execution. `"spread"` allocates the pod to different GPU cards for execution. | `"binpack"` or `"spread"` |
| `nvidia.com/vgpu-mode` | String | The type of vGPU instance this pod wishes to use. | `"hami-core"` or `"mig"` |

## Node configs: annotations

| Argument | Type | Description | Example |
|----------|------|-------------|---------|
| `nvidia.com/nouse-gpuuuid` | String | If set, HAMI will not allocate any devices defined in this string to Pods during scheduling. | `"GPU-AAA,GPU-BBB"` |

## Container configs: env

| Argument | Type | Description | Default |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,8 @@ spec:

## 设备 UUID 选择

### Pod注解

你可以通过 Pod 注解来指定要使用或排除特定的 GPU 设备:

```yaml
Expand All @@ -94,6 +96,11 @@ spec:
# ... rest of pod spec
```

### Node注解

`enflame.com/nouse-gpuuuid`:
字符串类型,支持多个设备ID,使用,分割多个设备,如:"node1-enflame-2,node1-enflame-3"。如果设置,hami在进行调度将不会为Pod使用字符串中定义的任何设备。

> **说明:** 设备 ID 格式为 `{节点名称}-enflame-{索引}`。你可以在节点状态中找到可用的设备 ID。

### 查找设备 UUID
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -100,6 +100,8 @@ spec:

## 设备 UUID 选择

### Node annotation

你可以通过 Pod 注解来指定要使用或排除特定的 GPU 设备:

```yaml
Expand All @@ -116,6 +118,11 @@ spec:
# ... 其余 Pod 配置
```

### Pod Annotation

`iluvatar.ai/nouse-gpuuuid`:
字符串类型,支持多个设备ID,使用,分割多个设备,如:"node1-iluvatar-2,node1-iluvatar-3"。如果设置,hami在进行调度将不会为Pod使用字符串中定义的任何设备。

> **说明:** 设备 ID 格式为 `{节点名称}-iluvatar-{索引}`。你可以在节点状态中找到可用的设备 ID。

### 查找设备 UUID
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -64,6 +64,12 @@ helm install hami hami-charts/hami --set devicePlugin.deviceMemoryScaling=5 ...
| `hami.io/gpu-scheduler-policy` | 字符串 | GPU 卡调度策略:`"binpack"` 表示将 Pod 分配到同一块 GPU 卡上执行,`"spread"` 表示分配到不同的 GPU 卡上执行。 | `"binpack"` 或 `"spread"` |
| `nvidia.com/vgpu-mode` | 字符串 | 指定该 Pod 希望使用的 vGPU 实例类型。 | `"hami-core"` 或 `"mig"` |

## Node 配置:注解

| 参数 | 类型 | 描述 | 示例 |
| --- | ---- | --- | ----- |
| `nvidia.com/nouse-gpuuuid` | 字符串 | 如果设置了此字段,则该 Pod 分配的设备 **必须** 是此字符串中定义的 GPU UUID 之一。 | `"GPU-AAA,GPU-BBB"` |

## 容器配置:环境变量

| 参数 | 类型 | 描述 | 默认值 |
Expand Down