You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm using SQL evaluation script, but I find something unreasonable when I list all conditions.
count_comp1_
count_comp2_
count_others_
hardness
2
0
1
medium
2
0
3
hard
As current script, the hardness of count_comp1_=2 and count_comp2_=0 and count_others_=2 is extra. Is it more reasonable to categorize the above situation as medium or hard rather than extra? https://github.com/taoyds/spider/blob/master/evaluation.py#L367
The text was updated successfully, but these errors were encountered:
I'm using SQL evaluation script, but I find something unreasonable when I list all conditions.
As current script, the hardness of count_comp1_=2 and count_comp2_=0 and count_others_=2 is extra. Is it more reasonable to categorize the above situation as medium or hard rather than extra?
https://github.com/taoyds/spider/blob/master/evaluation.py#L367
The text was updated successfully, but these errors were encountered: