Missed TensorFlow World? Check out the recap. Learn more

Module: tf.keras.preprocessing.text

TensorFlow 2.0 version View source on GitHub


  • Module tf.compat.v1.keras.preprocessing.text


class Tokenizer: Text tokenization utility class.


hashing_trick(...): Converts a text to a sequence of indexes in a fixed-size hashing space.

one_hot(...): One-hot encodes a text into a list of word indexes of size n.

text_to_word_sequence(...): Converts a text to a sequence of words (or tokens).