pip_services3_expressions.csv.CsvSymbolState module

class pip_services3_expressions.csv.CsvSymbolState.CsvSymbolState

Bases: pip_services3_expressions.tokenizers.generic.GenericSymbolState.GenericSymbolState

Implements a symbol state to tokenize delimiters in CSV streams.

next_token(scanner: pip_services3_expressions.io.IScanner.IScanner, tokenizer: pip_services3_expressions.tokenizers.ITokenizer.ITokenizer) → pip_services3_expressions.tokenizers.Token.Token

Return a symbol token from a scanner.

Parameters

  • scanner – A textual string to be tokenized.

  • tokenizer – A tokenizer class that controls the process.

Returns

The next token from the top of the stream.