pip_services3_expressions.tokenizers.generic.GenericTokenizer module

class pip_services3_expressions.tokenizers.generic.GenericTokenizer.GenericTokenizer

Bases: pip_services3_expressions.tokenizers.AbstractTokenizer.AbstractTokenizer

Implements a default tokenizer class.