This repository was archived by the owner on Nov 11, 2024. It is now read-only.
This repository was archived by the owner on Nov 11, 2024. It is now read-only.
Attach line number, column number and filename to tokens #2
Description
To output more useful messages during the parsing stage, it'd be useful to have some meta-data attached to the tokens, such as the line number, column number and filename.
Check https://github.com/rust-analyzer/ungrammar/blob/42810d770e4cddec2a5fff658489fa72f3b28a7c/src/lexer.rs#L17-L27 for inspiration.