Skip to content

Enables NoCalibratorLinearSvmTest #232

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 3 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,58 @@
maml.exe CV tr=LinearSVM{iter=100 lambda=0.03} threads=- cali={} dout=%Output% data=%Data% seed=1
Automatically adding a MinMax normalization transform, use 'norm=Warn' or 'norm=No' to turn this behavior off.
Warning: Skipped 800 instances with missing features during training (over 100 iterations; 8 inst/iter)
Not training a calibrator because a valid calibrator trainer was not provided.
Warning: Data does not contain a probability column. Will not output the Log-loss column
Automatically adding a MinMax normalization transform, use 'norm=Warn' or 'norm=No' to turn this behavior off.
Warning: Skipped 800 instances with missing features during training (over 100 iterations; 8 inst/iter)
Not training a calibrator because a valid calibrator trainer was not provided.
Warning: Data does not contain a probability column. Will not output the Log-loss column
Warning: The predictor produced non-finite prediction values on 8 instances during testing. Possible causes: abnormal data or the predictor is numerically unstable.
TEST POSITIVE RATIO: 0.3785 (134.0/(134.0+220.0))
Confusion table
||======================
PREDICTED || positive | negative | Recall
TRUTH ||======================
positive || 128 | 6 | 0.9552
negative || 7 | 213 | 0.9682
||======================
Precision || 0.9481 | 0.9726 |
OVERALL 0/1 ACCURACY: 0.963277
LOG LOSS/instance: NaN
Test-set entropy (prior Log-Loss/instance): 0.956998
LOG-LOSS REDUCTION (RIG): 0.000000
AUC: 0.994233
Warning: The predictor produced non-finite prediction values on 8 instances during testing. Possible causes: abnormal data or the predictor is numerically unstable.
TEST POSITIVE RATIO: 0.3191 (105.0/(105.0+224.0))
Confusion table
||======================
PREDICTED || positive | negative | Recall
TRUTH ||======================
positive || 97 | 8 | 0.9238
negative || 2 | 222 | 0.9911
||======================
Precision || 0.9798 | 0.9652 |
OVERALL 0/1 ACCURACY: 0.969605
LOG LOSS/instance: NaN
Test-set entropy (prior Log-Loss/instance): 0.903454
LOG-LOSS REDUCTION (RIG): 0.000000
AUC: 0.997491

OVERALL RESULTS
---------------------------------------
AUC: 0.995862 (0.0016)
Accuracy: 0.966441 (0.0032)
Positive precision: 0.963973 (0.0158)
Positive recall: 0.939517 (0.0157)
Negative precision: 0.968910 (0.0037)
Negative recall: 0.979627 (0.0114)
Log-loss: NaN (NaN)
Log-loss reduction: 0.000000 (0.0000)
F1 Score: 0.951327 (0.0003)
AUPRC: 0.991949 (0.0025)

---------------------------------------
Physical memory usage(MB): %Number%
Virtual memory usage(MB): %Number%
%DateTime% Time elapsed(s): %Number%

Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
LinearSVM
AUC Accuracy Positive precision Positive recall Negative precision Negative recall Log-loss Log-loss reduction F1 Score AUPRC /lambda /iter Learner Name Train Dataset Test Dataset Results File Run Time Physical Memory Virtual Memory Command Line Settings
0.995862 0.966441 0.963973 0.939517 0.96891 0.979627 NaN 0 0.951327 0.991949 0.03 100 LinearSVM %Data% %Output% 99 0 0 maml.exe CV tr=LinearSVM{iter=100 lambda=0.03} threads=- cali={} dout=%Output% data=%Data% seed=1 /lambda:0.03;/iter:100

Loading