Enhance Models Picker

[sandy081]

Enhance Models Picker

[isidorn]

Model discussion notes:

• Model dropdown is: Auto SEP Recent list (5 entries) SEP Curated list (~5 entries) SEP Other Models >
• Once the Other Models is expanded Manage Models is shown at the bottom
• The Curate list comes from CDN .json file. ExP can influence the list (send the ids of models that are curated). There is a separate curate list for FREE (free and no-auth sku) and for PAID users (all other skus).
• What happens if the model is in both the Curate list and the Recently used?
• Users can remove models from recent list. As model is removed, the last used model that is not in the list takes up it's place
• Models can have badges on them. Example NEW
• Models can have badge/action on them that tell user what they need to do to get that model. UPDATE / UPGRADE / ENABLE ADMIN
• We need CAPI to send us a reason why a model is disabled - Isidor to reach out
• Badges - we need to show a badge on the model dropdown. The badge can be info or warning. Info can be shown for new models. Warning is shown when a model with degradation is used
• We need a rich custom hover
• Do not show input/output token limits separately. Just combine them
• We need a Bump List. That we can specify model ids, so that users are auto switched from model A to model B exactly once. When we Bump someone would be good to show a very slight ui affordance on hover or something "We changed the selected model because we believe your experience will improve with MODEL_NAME"
• P2 (March+) users can configure reasoning level of models. Is this a submenu? Can we use the model family for this?
• P3 pinning - let's add if we see that the recent list is not doing a good enough job
• P3 search - let's add if we see that the UI does not scale

[isidorn]

Related issues:

#283751
https://github.com/microsoft/vscode-internalbacklog/issues/6535

[tamuratak]

The current model picker UX in Insiders is frustrating. In the Recent list and Other Models, the sort order changes dynamically based on most recent usage, which makes it difficult to select a model consistently. A layout with a “Recent” section and a stable “All Models” list would be much easier to use.

[isidorn]

@tamuratak thanks for feedback. Let's wait for more thoughts from team / community before we change the layout. We were debating if the Recently Used and Featured models should be together or not, and decided to start with them being together.

[sandy081]

@tamuratak

the sort order changes dynamically based on most recent usage

Sort order should not change. It should be always same. Are you seeing othewise?

[tamuratak]

No. I see the same order in the “Other Models” list. The issue is that a model’s absolute position within the combined “Recent” and “Other Models” lists changes, which effectively means the order is changing.

[isidorn]

The issue is that a model’s absolute position within the combined “Recent” and “Other Models” lists changes, which effectively means the order is changing.

Can you provide some repro steps with screenshots please?
The recent list is capped at 4 items right now, so as you fill in the recent list the absolute position might be a bit bumpy, but over time it should stabilise.