Search results

Add logical reasoning task tests? (e.g., Enigmata data)

Status: Open.

#141 In mlfoundations/evalchemy;

· Siki-cloud opened on Aug 29, 2025

Support for SWEBench

Status: Open.

#140 In mlfoundations/evalchemy;

· sravan500 opened on Aug 12, 2025

Request to add Debug mode

Status: Open.

#139 In mlfoundations/evalchemy;

· richardzhuang0412 opened on Jul 23, 2025

LiveCodeBench crashes on iteration due to dataset type inconsistency

Status: Open.

#136 In mlfoundations/evalchemy;

· dkimds opened on Jul 1, 2025

Debug mode fails for AIME24 and 5 other benchmarks

Status: Open.

#134 In mlfoundations/evalchemy;

· dkimds opened on Jul 1, 2025

per prompt performance and public data

Status: Open.

#132 In mlfoundations/evalchemy;

· chanansh opened on Jun 27, 2025

LCB benchmarks are duplicated

Status: Open.

#129 In mlfoundations/evalchemy;

· slimfrkha opened on Jun 13, 2025

How many responses are sampled per query?

Status: Open.

#105 In mlfoundations/evalchemy;

· noobimp opened on Apr 8, 2025

How to change model's temperature ?

Status: Open.

#99 In mlfoundations/evalchemy;

· hrdkbhatnagar opened on Mar 25, 2025

A suggestion for evalchemy about LiveCodeBench

Status: Open.

#96 In mlfoundations/evalchemy;

· BeastyZ opened on Mar 20, 2025

Log samples to huggingface

Status: Open.

#89 In mlfoundations/evalchemy;

· RyanMarten opened on Mar 5, 2025

How to log model response?

Status: Open.

#84 In mlfoundations/evalchemy;

· TundeAtSN opened on Feb 21, 2025