Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bpo-31394: Clarify documentation about token type attribute #3469

Merged
merged 3 commits into from
Sep 13, 2017
Merged

bpo-31394: Clarify documentation about token type attribute #3469

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
80f1514
Clarify documentation about tokens' type attribute
aivarannamaa Sep 9, 2017
a92c625
Better wording for tokenizer documentation update
aivarannamaa Sep 9, 2017
f297e84
Update tokenize doc (Ellipsis -> :data:`Ellipsis`)
aivarannamaa Sep 10, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions Doc/library/tokenize.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,8 @@ implemented in Python. The scanner in this module returns comments as tokens
as well, making it useful for implementing "pretty-printers," including
colorizers for on-screen displays.

To simplify token stream handling, all :ref:`operators` and :ref:`delimiters`
tokens are returned using the generic :data:`~token.OP` token type. The exact
To simplify token stream handling, all :ref:`operator <operators>` and :ref:`delimiter <delimiters>`
tokens and :data:`Ellipsis` are returned using the generic :data:`~token.OP` token type. The exact
type can be determined by checking the ``exact_type`` property on the
:term:`named tuple` returned from :func:`tokenize.tokenize`.

Expand Down