Skip to content

RobEin/ANTLR4-parser-for-Python-3.14

Repository files navigation

ANTLR4 parser for Python 3.14.2   License: MIT

About files:

  • PythonParser.g4 is the ANTLR4 parser grammar that based on the official Python PEG grammar

  • PythonLexerBase class

    • handles the Python indentations
    • creates encoding token
    • tokenizes f-string, t-string literals
    • and manage many other things

Recent changes:

  • parser grammar update for Python 3.14.2
  • tokenizing t-string literals
  • tokenizing BOM Unicode character at the start of the file so it is skipped in the token stream
  • moved encoding detection from PythonLexerBase to a separate component (grun4py)

Related links:

ANTLR 4

ANTLR4-tools

ANTLR 4 Documentation

ANTLR 4 Runtime API

Python 3.14 Lexical Analysis

cpython

ANTLR4 parser for Python 2.7.18

ANTLR4 parser for Python 3.8