Skip to content

[Bug] Model Qwen3.5 9b does not run with WebGPU #1039

Description

Describe the issue

natke@timmy % foundry run qwen3.5-9b 
● error: IPC error 'op_handler_failed': Error loading model qwen3.5-9b-generic-gpu:3: Error: 
Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: This is an invalid model. Error: 
Duplicate definition of name (image_grid_thw_CUDAExecutionProvider).
   at Microsoft.ML.OnnxRuntimeGenAI.Result.VerifySuccess(IntPtr) + 0x48
   at Microsoft.ML.OnnxRuntimeGenAI.Model..ctor(Config) + 0x20
   at Microsoft.Neutron.OpenAI.Provider.OnnxLoadedModel..ctor(String, Config, GenAIConfig, 
InferenceModel, OnnxEP) + 0x64
   at Microsoft.AI.Foundry.Local.ModelManager.<LoadModelAsync>d__9.MoveNext() + 0xb78
--- End of stack trace from previous location ---
   at 
Microsoft.AI.Foundry.Local.NativeInterop.<>c__DisplayClass10_0.<<ExecuteCommandManaged>b__5>d.Move
Next() + 0x84
--- End of stack trace from previous location ---
   at Microsoft.AI.Foundry.Local.NativeInterop.<ExecuteWithTracker>d__9.MoveNext() + 0xa8
Hint: Try 'foundry server stop' then 'foundry server start'.

Foundry Local version: 0.10.3
O/S: macOS

To reproduce

brew install foundrylocal
foundry run qwen3.5-9b

Urgency

No response

Platform and architecture

Windows X64

OS Version

macOS 15.7.9

Installation type

Released package/binary

Foundry Local version

0.10.3

API or surface area

CLI

Hardware acceleration/backend

WebGPU/CUDA

Backend/runtime version

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions