Add min_p sampling method

[epicfilemcnulty]

min_p is a popular sampling method that has been adopted by various backends, e.g exllama, llamacpp, vllm.

[albertfgu]

Thank you! Can you provide an example generation command for testing?

[epicfilemcnulty]

@albertfgu Well, it's just a regular call to model.generate, e.g.

 output_ids = model.generate(
        input_ids=input_ids,
        max_length=256,
        temperature=0.8,
        top_p=1,
        top_k=0,
        min_p=0.05
 )

Or shall I also modify benchmark_generation_mamba_simple.py to include min_p option?

[albertfgu]

Yes, thank you, I just wanted to test that there's a simple command that can be run that produces reasonable outputs.