Age | Commit message (Collapse) | Author | |
---|---|---|---|
2023-04-18 | lexer: Add tokenizer for OP and UNKNOWN tokens | Johnny Richard | |
We want to tokenizer arithmetic expressions. We are handling exceptional cases with UNKNOWN token. Co-authored-by: Carlos Maniero <carlosmaniero@gmail.com> Signed-off-by: Johnny Richard <johnny@johnnyrichard.com> | |||
2023-04-18 | tests: Include lexer's number tokenizer tests | Carlos Maniero | |
Signed-off-by: Carlos Maniero <carlosmaniero@gmail.com> Reviewed-by: Johnny Richard <johnny@johnnyrichard.com> |