Add Cancellation checkpoint in Normalizer transfomer. (#3062)

codemzs · sfilipi · commit df1c72f37b06 · 2019-03-22T14:23:15.000-07:00
* Add Cancellation checkpoint in Normalizer transfomer.
diff --git a/src/Microsoft.ML.Data/Transforms/Normalizer.cs b/src/Microsoft.ML.Data/Transforms/Normalizer.cs
@@ -462,6 +462,7 @@ internal static NormalizingTransformer Train(IHostEnvironment env, IDataView dat
 
                     while (cursor.MoveNext())
                     {
+                        env.CheckAlive();
                         // If the row has bad values, the good values are still being used for training.
                         // The comparisons in the code below are arranged so that NaNs in the input are not recorded.
                         // REVIEW: Should infinities and/or NaNs be filtered before the normalization? Should we not record infinities for min/max?

Original file line number	Diff line number	Diff line change
`@@ -462,6 +462,7 @@ internal static NormalizingTransformer Train(IHostEnvironment env, IDataView dat`
`462`	`462`
`463`	`463`	`while (cursor.MoveNext())`
`464`	`464`	`{`
	`465`	`+ env.CheckAlive();`
`465`	`466`	`// If the row has bad values, the good values are still being used for training.`
`466`	`467`	`// The comparisons in the code below are arranged so that NaNs in the input are not recorded.`
`467`	`468`	`// REVIEW: Should infinities and/or NaNs be filtered before the normalization? Should we not record infinities for min/max?`