make 0 the default temperature

[waynehamadi]

Background

This is just a suggestion. I know it has pros and cons. But it appears like having 0 as the default would make the model more consistent.
We can wait to implement the benchmark to implement this, but we might be missing out a lot during that time.

People can still put 0 themselves, but new comers might be missing out without knowing.

Changes

Documentation

Test Plan

PR Quality Checklist

• My pull request is atomic and focuses on a single change.
• I have thoroughly tested my changes with multiple different prompts.
• I have considered potential risks and mitigations for my changes.
• I have documented my changes clearly and comprehensively.
• I have not snuck in any "extra" small tweaks changes

[Androbin]

Temperature 0 can make the AI more prone to get stuck in a loop.
Temperature 1 can make the AI more prone to go off on a tangent.
The OpenAI Playground uses temperature 0.7 by default, so I suggest we go with that.

[waynehamadi]

because of the very dynamic prompting we give it, it's less likely to get stuck.
I strongly suggest 0 still for new people coming. There are many way to get unstuck from a loop.
Temperature 0.7 means it oftentimes doesn't go for the most likely answer.