Skip to content

Commit 758aa5d

Browse files
committed
[lex] Provide unicode name for all control characters
This commit does not touch the new-line character as paper P2348. It resricts itself to consistent use of the unicode character name for space, horizontal tab, and vertical tab. Compared to PR #7359 it deliberately does not touch the grammar that would necessitate a review by core review. The intent is to rebase that PR if this one lands.
1 parent f9847af commit 758aa5d

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

source/lex.tex

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -140,9 +140,9 @@
140140
would arise from a source file ending with an unclosed \tcode{/*}
141141
comment.
142142
\end{footnote}
143-
Each comment\iref{lex.comment} is replaced by one space character. New-line characters are
143+
Each comment\iref{lex.comment} is replaced by one \unicode{0020}{space} character. New-line characters are
144144
retained. Whether each nonempty sequence of whitespace characters other
145-
than new-line is retained or replaced by one space character is
145+
than new-line is retained or replaced by one \unicode{0020}{space} character is
146146
unspecified.
147147
As characters from the source file are consumed
148148
to form the next preprocessing token
@@ -477,7 +477,7 @@
477477
characters \tcode{*/}. These comments do not nest.
478478
\indextext{comment!\tcode{//}}%
479479
The characters \tcode{//} start a comment, which terminates immediately before the
480-
next new-line character. If there is a form-feed or a vertical-tab
480+
next new-line character. If there is a \unicode{0009}{character tabulation} or a \unicode{000c}{form feed}
481481
character in such a comment, only whitespace characters shall appear
482482
between it and the new-line that terminates the comment; no diagnostic
483483
is required.
@@ -824,7 +824,8 @@
824824
\end{footnote}
825825
operators, and other separators.
826826
\indextext{whitespace}%
827-
Blanks, horizontal and vertical tabs, newlines, formfeeds, and comments
827+
Comments and the characters \unicode{0020}{space}, \unicode{0009}{character tabulation},
828+
\unicode{0009}{line tabulation}, \unicode{000c}{form feed}, and new-line
828829
(collectively, ``whitespace''), as described below, are ignored except
829830
as they serve to separate tokens.
830831
\begin{note}

0 commit comments

Comments
 (0)
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy