Skip to content

Commit 2d0edff

Browse files
tomasr8srinivasreddy
authored andcommitted
pythongh-129020: Remove ambiguous sentence from tokenize.untokenize docs (python#129021)
1 parent 2197bd9 commit 2d0edff

File tree

1 file changed

+4
-5
lines changed

1 file changed

+4
-5
lines changed

Doc/library/tokenize.rst

+4-5
Original file line numberDiff line numberDiff line change
@@ -91,11 +91,10 @@ write back the modified script.
9191
sequences with at least two elements, the token type and the token string.
9292
Any additional sequence elements are ignored.
9393

94-
The reconstructed script is returned as a single string. The result is
95-
guaranteed to tokenize back to match the input so that the conversion is
96-
lossless and round-trips are assured. The guarantee applies only to the
97-
token type and token string as the spacing between tokens (column
98-
positions) may change.
94+
The result is guaranteed to tokenize back to match the input so that the
95+
conversion is lossless and round-trips are assured. The guarantee applies
96+
only to the token type and token string as the spacing between tokens
97+
(column positions) may change.
9998

10099
It returns bytes, encoded using the :data:`~token.ENCODING` token, which
101100
is the first token sequence output by :func:`.tokenize`. If there is no

0 commit comments

Comments
 (0)