Open
Description
Hi Team,
I have followed the below documentation for optimization of llm guard to use GPU using onnxruntime-gpu library but even after that during code compilation I see device type as "cpu". Are there any additional steps in the code to enable gpu for llm guard in order to improve speed?
Metadata
Metadata
Assignees
Labels
No labels