Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update benchmark #400

Merged
merged 13 commits into from
Jun 2, 2024
Merged

update benchmark #400

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
e57c7f3
update result
yiweny May 14, 2024
6f20e31
Update README.md
yiweny May 14, 2024
9fc9b37
Update README.md
yiweny May 14, 2024
99c70ff
Update README.md
yiweny May 14, 2024
42ba745
Update README.md
yiweny May 14, 2024
7357c66
Update README.md
yiweny May 14, 2024
6574fdb
Update README.md
yiweny May 16, 2024
5622df9
Update README.md
yiweny May 17, 2024
9c44b23
Update README.md
yiweny May 20, 2024
cdbc1d9
Update README.md
yiweny May 20, 2024
51b092a
Update README.md
yiweny May 20, 2024
5cd6fdf
Update README.md
yiweny May 21, 2024
24a1812
Merge branch 'master' into yyuan/update-benchmark
yiweny Jun 1, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update README.md
  • Loading branch information
@yiweny
yiweny authored May 14, 2024
commit 6f20e316d4267f482f36e7d1ede005792061ca18
18 changes: 9 additions & 9 deletions benchmark/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -96,17 +96,17 @@ Experimental setting: 20 Optuna search trials for XGBoost and CatBoost. 3 Optuna

| | 0 |
|:--------------------|:------------------------|
| XGBoost | 0.597±0.000 (5717s) |
| CatBoost | 0.631±0.000 (1201s) |
| LightGBM | 0.639±0.000 (49s) |
| Trompt | OOM |
| ResNet | 0.637±0.000 (810s) |
| XGBoost | |
| CatBoost | |
| LightGBM | |
| Trompt | |
| ResNet | |
| MLP | 0.824±0.002 (220s) |
| FTTransformerBucket | 0.637±0.000 (8032s) |
| ExcelFormer | OOM |
| FTTransformer | 0.632±0.001 (7669s) |
| FTTransformerBucket | |
| ExcelFormer | |
| FTTransformer | |
| TabNet | 0.837±0.001 (404s) |
| TabTransformer | 0.634±0.001 (10791s) |
| TabTransformer | |

### `task_type: regression`
Metric: RMSE, lower the better.
Expand Down
Loading