deeppavlov.models.tokenizers
============================

.. autoclass:: deeppavlov.models.tokenizers.nltk_moses_tokenizer.NLTKMosesTokenizer

    .. automethod:: __call__

.. autoclass:: deeppavlov.models.tokenizers.nltk_tokenizer.NLTKTokenizer

    .. automethod:: __call__

.. autoclass:: deeppavlov.models.tokenizers.split_tokenizer.SplitTokenizer

.. autoclass:: deeppavlov.models.tokenizers.spacy_tokenizer.StreamSpacyTokenizer

    .. automethod:: __call__