Eval file throws, but evalite still succeeds

[Floriferous]

I'm running evalite on Github actions, and I just saw this strange run (removed a few details):

Run npm run eval -- --threshold=70

> backend@0.0.0 eval
> evalite --threshold=70


 EVALITE running...

 ✖ src/agents/support/support.eval.ts  (unknown evals)
ZodError: [
  some missing env var
]
 ❯ src/config/env.ts:78:19
     76| 
     77| try {
     78|   env = envSchema.parse(process.env);
       |                   ^
     79| } catch (error) {
     80|   if (error instanceof z.ZodError) {

⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { some missing env var }
 ⏳ src/agents/qa/qa.eval.ts  (5 evals)
 100% src/agents/qa/qa.eval.ts  (5 evals)

      Score  100%
  Threshold  70% (passed)
 Eval Files  2
      Evals  5
   Duration  2441ms

As you can see one of the 2 eval files did not run at all, but the CI run did not fail. It correctly tracks 2 eval files, but the one that did not run has 1 eval in it (so total of 6).

Seems like something is not failing correctly here.

[mattpocock]

Fixed in 3e591c6. Module errors are now properly counted in failed tasks, preventing threshold success from incorrectly overriding failures.