Add extra test coverage and fix existing test cases for input stream preprocessing behavior. With special thanks to @keithamus for reporting this issue and for providing insights.
Add extra tests with code points spanning two string indices.
Add a test for string
tokens containing a backslash followed by CRLF.
Fix negative zero serialization in test corpus.
Move recent tests from the numeric
category to number
.
Add a test for .2.7
Add a test for 1e+
Add signCharacter
for number
, dimension
and percentage
tokens.
This makes it possible to distinguish between +10
and 10
or -0
and 0
.
This value can be either provided by a tokenizer or inferred from the first character of the raw
value.
{
"type": "number-token",
"raw": "+10",
"startIndex": 0,
"endIndex": 3,
"structured": {
"signCharacter": "+",
"value": 10,
"type": "integer"
}
}