Skip to content

Gini / Entropy Sampling Test Build

Compare
Choose a tag to compare
@kalomaze kalomaze released this 15 Oct 20:58
· 99 commits to dynamic-temp since this release

TEMPERATURE OVERRIDES:

  • 2.0 Temp
    Gini Sampling, uses a power function & SamplerTemp.txt file to control the values
  • 1.91 Temp
    Greedy Dynamic Temp (aka DynaTemp), the original implementation, uses a sigmoid & DynaTemp.txt values
  • 1.84 Temp
    Entropy Sampling, uses a power function & SamplerTemp.txt file to control the values

I'm mostly interested in seeing how Gini sampling performs with different values. You may want to up your minTemp to a higher value like 0.33 if it's a bit too deterministic, by default it is 0.0 - 2.0 temp range.

image

image

This is how the console should look for each token if you have Gini sampling on.

image