Module margo_parser.tokenizer

A tokenizer for Margo syntax

Expand source code
"""A tokenizer for Margo syntax"""

from .tokenizer import tokenize

Sub-modules

margo_parser.tokenizer.margo_transformer
margo_parser.tokenizer.tokenizer