Browse Source

Updated stmd spec to 2014-09-19

pull/14/head
Vitaly Puzrin 10 years ago
parent
commit
e5459c72f3
  1. 224
      test/fixtures/stmd/bad.txt
  2. 551
      test/fixtures/stmd/good.txt
  3. 91
      test/fixtures/stmd/spec.txt

224
test/fixtures/stmd/bad.txt

@ -20,6 +20,40 @@ error:
<p></DIV></p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 1678
.
[Foo bar]:
<my url>
'title'
[Foo bar]
.
<p><a href="my%20url" title="title">Foo bar</a></p>
.
error:
<p><a href="my url" title="title">Foo bar</a></p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 1743
.
[ΑΓΩ]: /φου
[αγω]
.
<p><a href="/%CF%86%CE%BF%CF%85">αγω</a></p>
.
error:
<p><a href="/φου">αγω</a></p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 3550
@ -50,7 +84,139 @@ baz</li>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 4325
src line: 3688
.
<http://google.com?find=\*>
.
<p><a href="http://google.com?find=%5C*">http://google.com?find=\*</a></p>
.
error:
<p><a href="http://google.com?find=\*">http://google.com?find=\*</a></p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 3746
.
&nbsp; &amp; &copy; &AElig; &Dcaron; &frac34; &HilbertSpace; &DifferentialD; &ClockwiseContourIntegral;
.
<p>  &amp; © Æ Ď ¾ ℋ ⅆ ∲</p>
.
error:
<p>&nbsp; &amp; &copy; &AElig; &Dcaron; &frac34; &HilbertSpace; &DifferentialD; &ClockwiseContourIntegral;</p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 3757
.
&#35; &#1234; &#992; &#98765432;
.
<p># Ӓ Ϡ �</p>
.
error:
<p>&#35; &#1234; &#992; &#98765432;</p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 3767
.
&#X22; &#XD06; &#xcab;
.
<p>&quot; ആ ಫ</p>
.
error:
<p>&#X22; &#XD06; &#xcab;</p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 3792
.
&MadeUpEntity;
.
<p>&amp;MadeUpEntity;</p>
.
error:
<p>&MadeUpEntity;</p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 3808
.
[foo](/f&ouml;&ouml; "f&ouml;&ouml;")
.
<p><a href="/f%C3%B6%C3%B6" title="föö">foo</a></p>
.
error:
<p><a href="/f&ouml;&ouml;" title="f&ouml;&ouml;">foo</a></p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 3814
.
[foo]
[foo]: /f&ouml;&ouml; "f&ouml;&ouml;"
.
<p><a href="/f%C3%B6%C3%B6" title="föö">foo</a></p>
.
error:
<p><a href="/f&ouml;&ouml;" title="f&ouml;&ouml;">foo</a></p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 3822
.
``` f&ouml;&ouml;
foo
```
.
<pre><code class="language-föö">foo
</code></pre>
.
error:
<pre><code class="language-f&ouml;&ouml;">foo
</code></pre>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 3957
.
<http://foo.bar.`baz>`
.
<p><a href="http://foo.bar.%60baz">http://foo.bar.`baz</a>`</p>
.
error:
<p><a href="http://foo.bar.`baz">http://foo.bar.`baz</a>`</p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 4336
.
*here is a \**
@ -64,7 +230,49 @@ error:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 4879
src line: 4766
.
[link](</my uri>)
.
<p><a href="/my%20uri">link</a></p>
.
error:
<p><a href="/my uri">link</a></p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 4824
.
[link](foo%20b&auml;)
.
<p><a href="foo%20b%C3%A4">link</a></p>
.
error:
<p><a href="foo%20b&auml;">link</a></p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 4834
.
[link]("title")
.
<p><a href="%22title%22">link</a></p>
.
error:
<p><a href="&quot;title&quot;">link</a></p>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 4892
.
[link]( /uri
@ -80,7 +288,7 @@ error:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 5156
src line: 5169
.
[[[foo]]]
@ -97,7 +305,7 @@ error:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 5235
src line: 5248
.
![foo *bar*]
@ -113,7 +321,7 @@ error:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 5243
src line: 5256
.
![foo *bar*][]
@ -129,7 +337,7 @@ error:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 5251
src line: 5264
.
![foo *bar*][foobar]
@ -145,7 +353,7 @@ error:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 5311
src line: 5324
.
![*foo* bar][]
@ -161,7 +369,7 @@ error:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
src line: 5351
src line: 5364
.
![*foo* bar]

551
test/fixtures/stmd/good.txt

File diff suppressed because it is too large

91
test/fixtures/stmd/spec.txt

@ -2,8 +2,8 @@
title: CommonMark Spec
author:
- John MacFarlane
version: 1
date: 2014-09-06
version: 2
date: 2014-09-19
...
# Introduction
@ -1058,7 +1058,7 @@ a blank line either before or after.
The content of a code fence is treated as literal text, not parsed
as inlines. The first word of the info string is typically used to
specify the language of the code sample, and rendered in the `class`
attribute of the `pre` tag. However, this spec does not mandate any
attribute of the `code` tag. However, this spec does not mandate any
particular treatment of the info string.
Here is a simple example with backticks:
@ -1682,7 +1682,7 @@ them.
[Foo bar]
.
<p><a href="my url" title="title">Foo bar</a></p>
<p><a href="my%20url" title="title">Foo bar</a></p>
.
The title may be omitted:
@ -1745,7 +1745,7 @@ case-insensitive (see [matches](#matches)).
[αγω]
.
<p><a href="/φου">αγω</a></p>
<p><a href="/%CF%86%CE%BF%CF%85">αγω</a></p>
.
Here is a link reference definition with no corresponding link.
@ -1994,11 +1994,11 @@ form of the definition is:
> transforming X in such-and-such a way is a container of type Y
> with these blocks as its content.
So, we explain what counts as a block quote or list item by
explaining how these can be *generated* from their contents.
This should suffice to define the syntax, although it does not
give a recipe for *parsing* these constructions. (A recipe is
provided below in the section entitled [A parsing strategy].)
So, we explain what counts as a block quote or list item by explaining
how these can be *generated* from their contents. This should suffice
to define the syntax, although it does not give a recipe for *parsing*
these constructions. (A recipe is provided below in the section entitled
[A parsing strategy](#appendix-a-a-parsing-strategy).)
## Block quotes
@ -2010,9 +2010,9 @@ The following rules define [block quotes](#block-quote):
<a id="block-quote"></a>
1. **Basic case.** If a string of lines *Ls* constitute a sequence
of blocks *Bs*, then the result of appending a [block quote marker]
to the beginning of each line in *Ls* is a [block quote](#block-quote)
containing *Bs*.
of blocks *Bs*, then the result of appending a [block quote
marker](#block-quote-marker) to the beginning of each line in *Ls*
is a [block quote](#block-quote) containing *Bs*.
2. **Laziness.** If a string of lines *Ls* constitute a [block
quote](#block-quote) with contents *Bs*, then the result of deleting
@ -3688,7 +3688,7 @@ raw HTML:
.
<http://google.com?find=\*>
.
<p><a href="http://google.com?find=\*">http://google.com?find=\*</a></p>
<p><a href="http://google.com?find=%5C*">http://google.com?find=\*</a></p>
.
.
@ -3727,47 +3727,59 @@ foo
## Entities
Entities are parsed as entities, not as literal text, in all contexts
except code spans and code blocks. Three kinds of entities are recognized.
With the goal of making this standard as HTML-agnostic as possible, all HTML valid HTML Entities in any
context are recognized as such and converted into their actual values (i.e. the UTF8 characters representing
the entity itself) before they are stored in the AST.
This allows implementations that target HTML output to trivially escape the entities when generating HTML,
and simplifies the job of implementations targetting other languages, as these will only need to handle the
UTF8 chars and need not be HTML-entity aware.
[Named entities](#name-entities) <a id="named-entities"></a> consist of `&`
+ a string of 2-32 alphanumerics beginning with a letter + `;`.
+ any of the valid HTML5 entity names + `;`. The [following document](http://www.whatwg.org/specs/web-apps/current-work/multipage/entities.json)
is used as an authoritative source of the valid entity names and their corresponding codepoints.
Conforming implementations that target Markdown don't need to generate entities for all the valid
named entities that exist, with the exception of `"` (`&quot;`), `&` (`&amp;`), `<` (`&lt;`) and `>` (`&gt;`),
which always need to be written as entities for security reasons.
.
&nbsp; &amp; &copy; &AElig; &Dcaron; &frac34; &HilbertSpace; &DifferentialD; &ClockwiseContourIntegral;
.
<p>&nbsp; &amp; &copy; &AElig; &Dcaron; &frac34; &HilbertSpace; &DifferentialD; &ClockwiseContourIntegral;</p>
<p>  &amp; © Æ Ď ¾ ℋ ⅆ ∲</p>
.
[Decimal entities](#decimal-entities) <a id="decimal-entities"></a>
consist of `&#` + a string of 1--8 arabic digits + `;`.
consist of `&#` + a string of 1--8 arabic digits + `;`. Again, these entities need to be recognised
and tranformed into their corresponding UTF8 codepoints. Invalid Unicode codepoints will be written
as the "unknown codepoint" character (`0xFFFD`)
.
&#1; &#35; &#1234; &#992; &#98765432;
&#35; &#1234; &#992; &#98765432;
.
<p>&#1; &#35; &#1234; &#992; &#98765432;</p>
<p># Ӓ Ϡ �</p>
.
[Hexadecimal entities](#hexadecimal-entities) <a id="hexadecimal-entities"></a>
consist of `&#` + either `X` or `x` + a string of 1-8 hexadecimal digits
+ `;`.
+ `;`. They will also be parsed and turned into their corresponding UTF8 values in the AST.
.
&#x1; &#X22; &#XD06; &#xcab;
&#X22; &#XD06; &#xcab;
.
<p>&#x1; &#X22; &#XD06; &#xcab;</p>
<p>&quot; ആ ಫ</p>
.
Here are some nonentities:
.
&nbsp &x; &#; &#x; &#123456789; &ThisIsWayTooLongToBeAnEntityIsntIt; &hi?;
&nbsp &x; &#; &#x; &ThisIsWayTooLongToBeAnEntityIsntIt; &hi?;
.
<p>&amp;nbsp &amp;x; &amp;#; &amp;#x; &amp;#123456789; &amp;ThisIsWayTooLongToBeAnEntityIsntIt; &amp;hi?;</p>
<p>&amp;nbsp &amp;x; &amp;#; &amp;#x; &amp;ThisIsWayTooLongToBeAnEntityIsntIt; &amp;hi?;</p>
.
Although HTML5 does accept some entities without a trailing semicolon
(such as `&copy`), these are not recognized as entities here:
(such as `&copy`), these are not recognized as entities here, because it makes the grammar too ambiguous:
.
&copy
@ -3775,13 +3787,12 @@ Although HTML5 does accept some entities without a trailing semicolon
<p>&amp;copy</p>
.
On the other hand, many strings that are not on the list of HTML5
named entities are recognized as entities here:
Strings that are not on the list of HTML5 named entities are not recognized as entities either:
.
&MadeUpEntity;
.
<p>&MadeUpEntity;</p>
<p>&amp;MadeUpEntity;</p>
.
Entities are recognized in any context besides code spans or
@ -3797,7 +3808,7 @@ code blocks, including raw HTML, URLs, [link titles](#link-title), and
.
[foo](/f&ouml;&ouml; "f&ouml;&ouml;")
.
<p><a href="/f&ouml;&ouml;" title="f&ouml;&ouml;">foo</a></p>
<p><a href="/f%C3%B6%C3%B6" title="föö">foo</a></p>
.
.
@ -3805,7 +3816,7 @@ code blocks, including raw HTML, URLs, [link titles](#link-title), and
[foo]: /f&ouml;&ouml; "f&ouml;&ouml;"
.
<p><a href="/f&ouml;&ouml;" title="f&ouml;&ouml;">foo</a></p>
<p><a href="/f%C3%B6%C3%B6" title="föö">foo</a></p>
.
.
@ -3813,7 +3824,7 @@ code blocks, including raw HTML, URLs, [link titles](#link-title), and
foo
```
.
<pre><code class="language-f&ouml;&ouml;">foo
<pre><code class="language-föö">foo
</code></pre>
.
@ -3946,7 +3957,7 @@ But this is a link:
.
<http://foo.bar.`baz>`
.
<p><a href="http://foo.bar.`baz">http://foo.bar.`baz</a>`</p>
<p><a href="http://foo.bar.%60baz">http://foo.bar.`baz</a>`</p>
.
And this is an HTML tag:
@ -4030,7 +4041,7 @@ for efficient parsing strategies that do not backtrack:
(a) it is not part of a sequence of four or more unescaped `_`s,
(b) it is not followed by whitespace,
(c) is is not preceded by an ASCII alphanumeric character, and
(c) it is not preceded by an ASCII alphanumeric character, and
(d) either it is not followed by a `_` character or it is
followed immediately by strong emphasis.
@ -4755,7 +4766,7 @@ braces:
.
[link](</my uri>)
.
<p><a href="/my uri">link</a></p>
<p><a href="/my%20uri">link</a></p>
.
The destination cannot contain line breaks, even with pointy braces:
@ -4806,12 +4817,14 @@ in Markdown:
<p><a href="foo):">link</a></p>
.
URL-escaping and entities should be left alone inside the destination:
URL-escaping and should be left alone inside the destination, as all URL-escaped characters
are also valid URL characters. HTML entities in the destination will be parsed into their UTF8
codepoints, as usual, and optionally URL-escaped when written as HTML.
.
[link](foo%20b&auml;)
.
<p><a href="foo%20b&auml;">link</a></p>
<p><a href="foo%20b%C3%A4">link</a></p>
.
Note that, because titles can often be parsed as destinations,
@ -4821,7 +4834,7 @@ get unexpected results:
.
[link]("title")
.
<p><a href="&quot;title&quot;">link</a></p>
<p><a href="%22title%22">link</a></p>
.
Titles may be in single quotes, double quotes, or parentheses:

Loading…
Cancel
Save