Is it possible to obtain scores from the TRT-LLM model? #806
Description
I have multimodal Phi3-vision, and I want to get scores from the model like from the huggingface transformers
model.generate(..., output_scores= True)
{{ message }}
I have multimodal Phi3-vision, and I want to get scores from the model like from the huggingface transformers
model.generate(..., output_scores= True)