util: Create string_view tool to optimize memory usage

We are allocating heap memory to create tokens value, we can minimize the
number of allocations if we start using string_view.

We have other problems, right now the tokens value ownership are quite
unclear once the AST nodes also share the memory allocation done by
token_get_next_token function.

It's important to clarify we also have memory leaks on the current
implementation.  Hence, we are going to start using string_view to make
the memory management easier. :^)

Signed-off-by: Johnny Richard <johnny@johnnyrichard.com>

0 files changed, 0 insertions, 0 deletions