pip_services3_expressions.tokenizers.generic.GenericNumberState module

class pip_services3_expressions.tokenizers.generic.GenericNumberState.GenericNumberState

Bases: pip_services3_expressions.tokenizers.INumberState.INumberState

A NumberState object returns a number from a scanner. This state’s idea of a number allows an optional, initial minus sign, followed by one or more digits. A decimal point and another string of digits may follow these digits.

next_token(scanner: pip_services3_expressions.io.IScanner.IScanner, tokenizer: pip_services3_expressions.tokenizers.ITokenizer.ITokenizer) → pip_services3_expressions.tokenizers.Token.Token

Gets the next token from the stream started from the character linked to this state.

Parameters

  • scanner – A textual string to be tokenized.

  • tokenizer – A tokenizer class that controls the process.

Returns

The next token from the top of the stream.