标记分隔符 meaning in English

token separator

The fuzzy grouping transformation includes two features for customizing the grouping it performs : token delimiters and similarity threshold
模糊分组转换包括两个用于自定义所执行的分组的功能：标记分隔符和相似性阈值。
The transformation provides a default set of delimiters used to tokenize the data , but you can add token delimiters to suit the needs of your data
该转换提供了一组用于标记化数据的默认分隔符，但您可以添加适合自己数据需要的标记分隔符。
The fuzzy lookup transformation includes three features for customizing the lookup it performs : maximum number of matches to return per input row , token delimiters , and similarity thresholds
模糊查找转换包含以下三项可自定义所执行的查找的功能：每个输入行可返回的最大匹配项数、标记分隔符和相似性阈值。