Gini / Entropy Sampling Test Build
kalomaze
released this
15 Oct 20:58
·
99 commits
to dynamic-temp
since this release
TEMPERATURE OVERRIDES:
- 2.0 Temp
Gini Sampling, uses a power function & SamplerTemp.txt file to control the values - 1.91 Temp
Greedy Dynamic Temp (aka DynaTemp), the original implementation, uses a sigmoid & DynaTemp.txt values - 1.84 Temp
Entropy Sampling, uses a power function & SamplerTemp.txt file to control the values
I'm mostly interested in seeing how Gini sampling performs with different values. You may want to up your minTemp to a higher value like 0.33 if it's a bit too deterministic, by default it is 0.0 - 2.0 temp range.
This is how the console should look for each token if you have Gini sampling on.