Skip to content

Commit 5860a4e

Browse files
AnipikTomFinley
authored andcommitted
Enables Calibrators Tests for Linear Svm (#233)
* Test Enabled, Debug and Release baseline files added
1 parent 38cd636 commit 5860a4e

25 files changed

+6036
-11
lines changed
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,58 @@
1+
maml.exe CV tr=LinearSVM{iter=100 lambda=0.03} threads=- cali=PAV dout=%Output% data=%Data% seed=1
2+
Automatically adding a MinMax normalization transform, use 'norm=Warn' or 'norm=No' to turn this behavior off.
3+
Warning: Skipped 800 instances with missing features during training (over 100 iterations; 8 inst/iter)
4+
Training calibrator.
5+
PAV calibrator: piecewise function approximation has 6 components.
6+
Automatically adding a MinMax normalization transform, use 'norm=Warn' or 'norm=No' to turn this behavior off.
7+
Warning: Skipped 800 instances with missing features during training (over 100 iterations; 8 inst/iter)
8+
Training calibrator.
9+
PAV calibrator: piecewise function approximation has 6 components.
10+
Warning: The predictor produced non-finite prediction values on 8 instances during testing. Possible causes: abnormal data or the predictor is numerically unstable.
11+
TEST POSITIVE RATIO: 0.3785 (134.0/(134.0+220.0))
12+
Confusion table
13+
||======================
14+
PREDICTED || positive | negative | Recall
15+
TRUTH ||======================
16+
positive || 128 | 6 | 0.9552
17+
negative || 7 | 213 | 0.9682
18+
||======================
19+
Precision || 0.9481 | 0.9726 |
20+
OVERALL 0/1 ACCURACY: 0.963277
21+
LOG LOSS/instance: Infinity
22+
Test-set entropy (prior Log-Loss/instance): 0.956998
23+
LOG-LOSS REDUCTION (RIG): -Infinity
24+
AUC: 0.994233
25+
Warning: The predictor produced non-finite prediction values on 8 instances during testing. Possible causes: abnormal data or the predictor is numerically unstable.
26+
TEST POSITIVE RATIO: 0.3191 (105.0/(105.0+224.0))
27+
Confusion table
28+
||======================
29+
PREDICTED || positive | negative | Recall
30+
TRUTH ||======================
31+
positive || 97 | 8 | 0.9238
32+
negative || 2 | 222 | 0.9911
33+
||======================
34+
Precision || 0.9798 | 0.9652 |
35+
OVERALL 0/1 ACCURACY: 0.969605
36+
LOG LOSS/instance: 0.220291
37+
Test-set entropy (prior Log-Loss/instance): 0.903454
38+
LOG-LOSS REDUCTION (RIG): 75.616820
39+
AUC: 0.997491
40+
41+
OVERALL RESULTS
42+
---------------------------------------
43+
AUC: 0.995862 (0.0016)
44+
Accuracy: 0.966441 (0.0032)
45+
Positive precision: 0.963973 (0.0158)
46+
Positive recall: 0.939517 (0.0157)
47+
Negative precision: 0.968910 (0.0037)
48+
Negative recall: 0.979627 (0.0114)
49+
Log-loss: Infinity (NaN)
50+
Log-loss reduction: -Infinity (NaN)
51+
F1 Score: 0.951327 (0.0003)
52+
AUPRC: 0.991949 (0.0025)
53+
54+
---------------------------------------
55+
Physical memory usage(MB): %Number%
56+
Virtual memory usage(MB): %Number%
57+
%DateTime% Time elapsed(s): %Number%
58+
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
LinearSVM
2+
AUC Accuracy Positive precision Positive recall Negative precision Negative recall Log-loss Log-loss reduction F1 Score AUPRC /lambda /iter Learner Name Train Dataset Test Dataset Results File Run Time Physical Memory Virtual Memory Command Line Settings
3+
0.995862 0.966441 0.963973 0.939517 0.96891 0.979627 Infinity -Infinity 0.951327 0.991949 0.03 100 LinearSVM %Data% %Output% 99 0 0 maml.exe CV tr=LinearSVM{iter=100 lambda=0.03} threads=- cali=PAV dout=%Output% data=%Data% seed=1 /lambda:0.03;/iter:100
4+

0 commit comments

Comments
 (0)