lexer: Peek next token

The only way to get the next token was by consuming it. So then, our
parser starts to become hard to understand, once sometimes we just
want to take a look on the next token to understand what should be the
next kind of expression.

This commit introduces a new function that will help us to improve our
parser implementation.

Signed-off-by: Johnny Richard <johnny@johnnyrichard.com>
Reviewed-by: Carlos Maniero <carlos@maniero.me>

0 files changed, 0 insertions, 0 deletions