You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
/// Stopword remover removes language-specific list of stop words (most common words)
487
-
/// This is usually applied after tokenizing text, so it compares individual tokens
488
-
/// (case-insensitive comparison) to the stopwords.
483
+
/// <see cref="IEstimator{TTransformer}"/> for the <see cref="CustomStopWordsRemovingTransformer"/>.
489
484
/// </summary>
485
+
/// <remarks>
486
+
/// <format type="text/markdown">< |
492
+
/// | Output column data type | Variable-sized vector of [Text](xref:Microsoft.ML.Data.TextDataViewType) |
493
+
///
494
+
/// The resulting <xref:Microsoft.ML.Transforms.Text.StopWordsRemovingTransformer/> creates a new column, named as specified in the output column name parameter,
495
+
/// and fills it with a vector of words containing all of the words in the input column **except the predefined list of stopwords for the specified language.
496
+
/// All text comparison made by casting predefined text and text from input column to lower case using casing rules of invariant culture.
497
+
/// See the See Also section for links to examples of the usage.
@@ -1076,10 +1086,25 @@ protected override Delegate MakeGetter(DataViewRow input, int iinfo, Func<int, b
1076
1086
}
1077
1087
1078
1088
/// <summary>
1079
-
/// Custom stopword remover removes specified list of stop words.
1080
-
/// This is usually applied after tokenizing text, so it compares individual tokens
1081
-
/// (case-insensitive comparison) to the stopwords.
1089
+
/// <see cref="IEstimator{TTransformer}"/> for the <see cref="CustomStopWordsRemovingTransformer"/>.
1082
1090
/// </summary>
1091
+
/// <remarks>
1092
+
/// <format type="text/markdown">< |
1098
+
/// | Output column data type | Unknown-sized vector of [Text](xref:Microsoft.ML.Data.TextDataViewType) |
1099
+
///
1100
+
/// The resulting <xref:Microsoft.ML.Transforms.Text.CustomStopWordsRemovingTransformer/> creates a new column, named as specified by the output column name parameter, and
1101
+
/// fills it with a vector of words containing all of the words in the input column except those given by the stopwords parameter.
1102
+
/// All text comparison made by casting provided words and words from input column to lower case using casing rules of invariant culture.
1103
+
/// See the See Also section for links to examples of the usage.
0 commit comments