Rework emoji tokenizer to match Rust #56

Open

Open

Rework emoji tokenizer to match Rust#56

Current implementation is extremely sloppy. rust-unic/unic-emoji-char as in rust-lang/rust#88781 is likely a much better idea 🤔

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests