tokenized meaning in English
标记化的
Examples
- The string to be tokenized is specified through the
属性指定要标记化的字符串，而通过 - Company would be tokenized as
Company将标记为 - Should be specified as the string of hexadecimal digits representing the tokenized form of the public key
应指定为十六进制数字的字符串以表示标记形式的公钥。 - In some specific cases , changes made to the word breakers have the potential to impact how some data is tokenized
在某些特定情况下，对断字符所做的更改可能会影响对某些数据进行标记化的方式。 - In a tokenized type , the parser will normalize all white space to a single space character and will eliminate leading and trailing white space altogether
在标记化类型中，分析器将使所有空白标准化为单个空格字符，并将前导和尾随空白一同删除。