Skip to content

Commit

Permalink
Fixed X64Fact tests (#5057)
Browse files Browse the repository at this point in the history
* Enable X64 Tests to run to view baseline outputs

* More X64Fact tests fixed, added baselines

* Added logging for when conf. specific baseline is used

* Revert "Added logging for when conf. specific baseline is used"

This reverts commit 21ef056.
  • Loading branch information
mstfbl committed Apr 25, 2020
1 parent e1fe0a8 commit 2b5b9cf
Show file tree
Hide file tree
Showing 60 changed files with 14,896 additions and 13 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
maml.exe TrainTest test=%Data% tr=FastTreeBinaryClassification{nl=5 mil=5 lr=0.25 iter=20 mb=255} dout=%Output% loader=Text{header+ col=Label:0 col=Cat:TX:1-8} data=%Data% out=%Output% seed=1 xf=Cat{col=Cat} xf=Concat{col=Features:Cat}
Not adding a normalizer.
Making per-feature arrays
Changing data from row-wise to column-wise
Processed 500 instances
Binning and forming Feature objects
Changing data from row-wise to column-wise
Reserved memory for tree learner: %Number% bytes
Starting to train ...
Not training a calibrator because it is not needed.
TEST POSITIVE RATIO: 0.2300 (115.0/(115.0+385.0))
Confusion table
||======================
PREDICTED || positive | negative | Recall
TRUTH ||======================
positive || 55 | 60 | 0.4783
negative || 17 | 368 | 0.9558
||======================
Precision || 0.7639 | 0.8598 |
OVERALL 0/1 ACCURACY: 0.846000
LOG LOSS/instance: 0.481805
Test-set entropy (prior Log-Loss/instance): 0.778011
LOG-LOSS REDUCTION (RIG): 0.380722
AUC: 0.893281

OVERALL RESULTS
---------------------------------------
AUC: 0.893281 (0.0000)
Accuracy: 0.846000 (0.0000)
Positive precision: 0.763889 (0.0000)
Positive recall: 0.478261 (0.0000)
Negative precision: 0.859813 (0.0000)
Negative recall: 0.955844 (0.0000)
Log-loss: 0.481805 (0.0000)
Log-loss reduction: 0.380722 (0.0000)
F1 Score: 0.588235 (0.0000)
AUPRC: 0.738040 (0.0000)

---------------------------------------
Physical memory usage(MB): %Number%
Virtual memory usage(MB): %Number%
%DateTime% Time elapsed(s): %Number%

--- Progress log ---
[1] 'Building term dictionary' started.
[1] (%Time%) 500 examples Total Terms: 76
[1] 'Building term dictionary' finished in %Time%.
[2] 'FastTree data preparation' started.
[2] 'FastTree data preparation' finished in %Time%.
[3] 'FastTree in-memory bins initialization' started.
[3] 'FastTree in-memory bins initialization' finished in %Time%.
[4] 'FastTree feature conversion' started.
[4] 'FastTree feature conversion' finished in %Time%.
[5] 'FastTree data preparation #2' started.
[5] 'FastTree data preparation #2' finished in %Time%.
[6] 'FastTree feature conversion #2' started.
[6] 'FastTree feature conversion #2' finished in %Time%.
[7] 'FastTree training' started.
[7] 'FastTree training' finished in %Time%.
[8] 'Saving model' started.
[8] 'Saving model' finished in %Time%.
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
FastTreeBinaryClassification
AUC Accuracy Positive precision Positive recall Negative precision Negative recall Log-loss Log-loss reduction F1 Score AUPRC /lr /nl /mil /iter Learner Name Train Dataset Test Dataset Results File Run Time Physical Memory Virtual Memory Command Line Settings
0.893281 0.846 0.763889 0.478261 0.859813 0.955844 0.481805 0.380722 0.588235 0.73804 0.25 5 5 20 FastTreeBinaryClassification %Data% %Data% %Output% 99 0 0 maml.exe TrainTest test=%Data% tr=FastTreeBinaryClassification{nl=5 mil=5 lr=0.25 iter=20 mb=255} dout=%Output% loader=Text{header+ col=Label:0 col=Cat:TX:1-8} data=%Data% out=%Output% seed=1 xf=Cat{col=Cat} xf=Concat{col=Features:Cat} /lr:0.25;/nl:5;/mil:5;/iter:20

Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@

Per-feature gain summary for the boosted tree ensemble:
marital-status.Married-civ-spouse 1
occupation.Prof-specialty 0.499978104303624
occupation.Exec-managerial 0.434935442345068
marital-status.Never-married 0.267286281351726
education.Doctorate 0.255205743594169
Workclass.Self-emp-inc 0.218913886097949
ethnicity.Asian-Pac-Islander 0.198007032992433
relationship.Husband 0.187623229061434
Workclass.Local-gov 0.186017717229329
native-country-region.Mexico 0.177614308223737
education.Bachelors 0.170936054067049
education.Masters 0.169804646788063
occupation.Farming-fishing 0.145811380173079
ethnicity.Black 0.137140760481446
occupation.Transport-moving 0.13022579853358
occupation.Other-service 0.12589916923037
education.Some-college 0.116092176092999
Workclass.Private 0.109401738173027
Workclass.? 0.109103172155946
education.Assoc-acdm 0.100323599151049
Workclass.Self-emp-not-inc 0.0973694292542764
relationship.Own-child 0.0957862810994456
education.11th 0.0905382862951382
occupation.Tech-support 0.0778673683865196
education.HS-grad 0.0727543074440302
education.7th-8th 0.0727320100839907
marital-status.Widowed 0.0634429881388435
Workclass.State-gov 0.0535351814497221
Loading

0 comments on commit 2b5b9cf

Please sign in to comment.