natke@timmy % foundry run qwen3.5-9b
● error: IPC error 'op_handler_failed': Error loading model qwen3.5-9b-generic-gpu:3: Error:
Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: This is an invalid model. Error:
Duplicate definition of name (image_grid_thw_CUDAExecutionProvider).
at Microsoft.ML.OnnxRuntimeGenAI.Result.VerifySuccess(IntPtr) + 0x48
at Microsoft.ML.OnnxRuntimeGenAI.Model..ctor(Config) + 0x20
at Microsoft.Neutron.OpenAI.Provider.OnnxLoadedModel..ctor(String, Config, GenAIConfig,
InferenceModel, OnnxEP) + 0x64
at Microsoft.AI.Foundry.Local.ModelManager.<LoadModelAsync>d__9.MoveNext() + 0xb78
--- End of stack trace from previous location ---
at
Microsoft.AI.Foundry.Local.NativeInterop.<>c__DisplayClass10_0.<<ExecuteCommandManaged>b__5>d.Move
Next() + 0x84
--- End of stack trace from previous location ---
at Microsoft.AI.Foundry.Local.NativeInterop.<ExecuteWithTracker>d__9.MoveNext() + 0xa8
Hint: Try 'foundry server stop' then 'foundry server start'.
brew install foundrylocal
foundry run qwen3.5-9b
Describe the issue
Foundry Local version:
0.10.3O/S: macOS
To reproduce
Urgency
No response
Platform and architecture
Windows X64
OS Version
macOS 15.7.9
Installation type
Released package/binary
Foundry Local version
0.10.3
API or surface area
CLI
Hardware acceleration/backend
WebGPU/CUDA
Backend/runtime version
No response