Grok "llama-3.1-70b-versatile" shutdown solution

[kweatherman]

If attempting to use Grok as the AI source recently it will fail with a deprecation error.

Ref: https://console.groq.com/docs/deprecations
"llama-3.1-70b-versatile" expired on 1/24/2025

It looks like one would normally fix this via the [Groq] section BASE_URL entry.
Not knowing the URL, I just edited LLAMA_31_MODEL_NAME to "llama-3.3-70b-versatile" and that fixes it.

Don't know what LLAMA_32_MODEL_NAME and MIXTRAL_MODEL_NAME should be.

Solution, now question.
Based on feedback, what is the best online AI to use for IDA using Gepetto right now?

Thanks for the awesome tool!

[JusticeRage]

Hi! Thanks for reporting this. Indeed the default models do get stale for certain providers, I'll update Grok ASAP!
As for the question, I have to say I don't typically get feedback from users so I can't really say. I've personally been using OpenAI a lot and been happy about it, eventually I want to use Ollama locally more and more.

Some actual science to determine which models work better (do code-oriented models provide better results?) would be super useful, but organizing this study would require some work, and defining what the "best" answers are isn't even that trivial. It's also unclear that one model is consistently better than the others.
Lots of territory to explore here!

[kweatherman]

I think then one just needs to try at least a few and over time they will see the ones that consistently return the best analysis.
Thanks again for this awesome tool.