diff --git a/test/fixtures/commonmark/spec.txt b/test/fixtures/commonmark/spec.txt index 7b891b0..449e5b0 100644 --- a/test/fixtures/commonmark/spec.txt +++ b/test/fixtures/commonmark/spec.txt @@ -1,8 +1,8 @@ --- title: CommonMark Spec author: John MacFarlane -version: 0.21 -date: 2015-07-14 +version: 0.24 +date: '2015-01-12' license: '[CC-BY-SA 4.0](http://creativecommons.org/licenses/by-sa/4.0/)' ... @@ -36,11 +36,11 @@ questions it does not answer: users in real documents. (See [this comment by John Gruber](http://article.gmane.org/gmane.text.markdown.general/1997).) -2. Is a blank line needed before a block quote or header? +2. Is a blank line needed before a block quote or heading? Most implementations do not require the blank line. However, this can lead to unexpected results in hard-wrapped text, and also to ambiguities in parsing (note that some implementations - put the header inside the blockquote, while others do not). + put the heading inside the blockquote, while others do not). (John Gruber has also spoken [in favor of requiring the blank lines](http://article.gmane.org/gmane.text.markdown.general/2146).) @@ -85,8 +85,8 @@ questions it does not answer: 10. item 2a ``` -6. Is this one list with a horizontal rule in its second item, - or two lists separated by a horizontal rule? +6. Is this one list with a thematic break in its second item, + or two lists separated by a thematic break? ``` markdown * a @@ -128,8 +128,8 @@ questions it does not answer: - and it can screw things up` ``` -11. Can list items include section headers? (`Markdown.pl` does not - allow this, but does allow blockquotes to include headers.) +11. Can list items include section headings? (`Markdown.pl` does not + allow this, but does allow blockquotes to include headings.) ``` markdown - # Heading @@ -201,85 +201,94 @@ In the examples, the `→` character is used to represent tabs. ## Characters and lines -Any sequence of [character]s is a valid CommonMark +Any sequence of [characters] is a valid CommonMark document. -A [character](@character) is a unicode code point. +A [character](@) is a Unicode code point. Although some +code points (for example, combining accents) do not correspond to +characters in an intuitive sense, all code points count as characters +for purposes of this spec. + This spec does not specify an encoding; it thinks of lines as composed -of characters rather than bytes. A conforming parser may be limited +of [characters] rather than bytes. A conforming parser may be limited to a certain encoding. -A [line](@line) is a sequence of zero or more [character]s +A [line](@) is a sequence of zero or more [characters] +other than newline (`U+000A`) or carriage return (`U+000D`), followed by a [line ending] or by the end of file. -A [line ending](@line-ending) is a newline (`U+000A`), carriage return -(`U+000D`), or carriage return + newline. +A [line ending](@) is a newline (`U+000A`), a carriage return +(`U+000D`) not followed by a newline, or a carriage return and a +following newline. A line containing no characters, or a line containing only spaces -(`U+0020`) or tabs (`U+0009`), is called a [blank line](@blank-line). +(`U+0020`) or tabs (`U+0009`), is called a [blank line](@). The following definitions of character classes will be used in this spec: -A [whitespace character](@whitespace-character) is a space +A [whitespace character](@) is a space (`U+0020`), tab (`U+0009`), newline (`U+000A`), line tabulation (`U+000B`), form feed (`U+000C`), or carriage return (`U+000D`). -[Whitespace](@whitespace) is a sequence of one or more [whitespace -character]s. +[Whitespace](@) is a sequence of one or more [whitespace +characters]. -A [unicode whitespace character](@unicode-whitespace-character) is -any code point in the unicode `Zs` class, or a tab (`U+0009`), +A [Unicode whitespace character](@) is +any code point in the Unicode `Zs` class, or a tab (`U+0009`), carriage return (`U+000D`), newline (`U+000A`), or form feed (`U+000C`). -[Unicode whitespace](@unicode-whitespace) is a sequence of one -or more [unicode whitespace character]s. +[Unicode whitespace](@) is a sequence of one +or more [Unicode whitespace characters]. -A [space](@space) is `U+0020`. +A [space](@) is `U+0020`. -A [non-whitespace character](@non-space-character) is any character +A [non-whitespace character](@) is any character that is not a [whitespace character]. -An [ASCII punctuation character](@ascii-punctuation-character) +An [ASCII punctuation character](@) is `!`, `"`, `#`, `$`, `%`, `&`, `'`, `(`, `)`, `*`, `+`, `,`, `-`, `.`, `/`, `:`, `;`, `<`, `=`, `>`, `?`, `@`, `[`, `\`, `]`, `^`, `_`, `` ` ``, `{`, `|`, `}`, or `~`. -A [punctuation character](@punctuation-character) is an [ASCII +A [punctuation character](@) is an [ASCII punctuation character] or anything in -the unicode classes `Pc`, `Pd`, `Pe`, `Pf`, `Pi`, `Po`, or `Ps`. +the Unicode classes `Pc`, `Pd`, `Pe`, `Pf`, `Pi`, `Po`, or `Ps`. ## Tabs -Tabs in lines are not expanded to [spaces][space]. However, +Tabs in lines are not expanded to [spaces]. However, in contexts where indentation is significant for the document's structure, tabs behave as if they were replaced by spaces with a tab stop of 4 characters. -. +```````````````````````````````` example →foo→baz→→bim .
foo→baz→→bim
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
→foo→baz→→bim
.
foo→baz→→bim
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
a→a
ὐ→a
.
a→a
ὐ→a
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
- foo
→bar
@@ -290,29 +299,41 @@ by spaces with a tab stop of 4 characters.
bar
-. +```````````````````````````````` -. + +```````````````````````````````` example >→foo→bar .+```````````````````````````````` + + +```````````````````````````````` example + foo +→bar . +foo→bar
foo
+bar
+
+````````````````````````````````
+
## Insecure characters
For security reasons, the Unicode character `U+0000` must be replaced
-with the replacement character (`U+FFFD`).
+with the REPLACEMENT CHARACTER (`U+FFFD`).
# Blocks and inlines
We can think of a document as a sequence of
-[blocks](@block)---structural elements like paragraphs, block
-quotations, lists, headers, rules, and code blocks. Some blocks (like
+[blocks](@)---structural elements like paragraphs, block
+quotations, lists, headings, rules, and code blocks. Some blocks (like
block quotes and list items) contain other blocks; others (like
-headers and paragraphs) contain [inline](@inline) content---text,
+headings and paragraphs) contain [inline](@) content---text,
links, emphasized text, images, code, and so on.
## Precedence
@@ -321,7 +342,7 @@ Indicators of block structure always take precedence over indicators
of inline structure. So, for example, the following is a list with
two items, not a list with one item containing a code span:
-.
+```````````````````````````````` example
- `one
- two`
.
@@ -329,11 +350,12 @@ two items, not a list with one item containing a code span:
+++
-. +```````````````````````````````` -. + +```````````````````````````````` example === .===
-. +```````````````````````````````` + Not enough characters: -. +```````````````````````````````` example -- ** __ @@ -393,11 +418,12 @@ __-- ** __
-. +```````````````````````````````` + One to three spaces indent are allowed: -. +```````````````````````````````` example *** *** *** @@ -405,64 +431,72 @@ One to three spaces indent are allowed:***
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
Foo
***
.
Foo ***
-. +```````````````````````````````` + More than three characters may be used: -. +```````````````````````````````` example _____________________________________ ._ _ _ _ a
a------
---a---
-. +```````````````````````````````` -It is required that all of the [non-whitespace character]s be the same. -So, this is not a horizontal rule: -. +It is required that all of the [non-whitespace characters] be the same. +So, this is not a thematic break: + +```````````````````````````````` example *-* .-
-. +```````````````````````````````` -Horizontal rules do not need blank lines before or after: -. +Thematic breaks do not need blank lines before or after: + +```````````````````````````````` example - foo *** - bar @@ -497,11 +533,12 @@ Horizontal rules do not need blank lines before or after:Foo
bar
-. +```````````````````````````````` + If a line of dashes that meets the above conditions for being a -horizontal rule could also be interpreted as the underline of a [setext -header], the interpretation as a -[setext header] takes precedence. Thus, for example, -this is a setext header, not a paragraph followed by a horizontal rule: +thematic break could also be interpreted as the underline of a [setext +heading], the interpretation as a +[setext heading] takes precedence. Thus, for example, +this is a setext heading, not a paragraph followed by a thematic break: -. +```````````````````````````````` example Foo --- bar .bar
-. +```````````````````````````````` -When both a horizontal rule and a list item are possible -interpretations of a line, the horizontal rule takes precedence: -. +When both a thematic break and a list item are possible +interpretations of a line, the thematic break takes precedence: + +```````````````````````````````` example * Foo * * * * Bar @@ -541,11 +580,12 @@ interpretations of a line, the horizontal rule takes precedence:####### foo
-. +```````````````````````````````` + At least one space is required between the `#` characters and the -header's contents, unless the header is empty. Note that many +heading's contents, unless the heading is empty. Note that many implementations currently do not require the space. However, the space was required by the [original ATX implementation](http://www.aaronsw.com/2002/atx/atx.py), and it helps prevent things like the following from being parsed as -headers: +headings: -. +```````````````````````````````` example #5 bolt -#foobar +#hashtag .#5 bolt
-#foobar
-. +#hashtag
+```````````````````````````````` -This is not a header, because the first `#` is escaped: +A tab will not work: + +```````````````````````````````` example +#→foo . +#→foo
+```````````````````````````````` + + +This is not a heading, because the first `#` is escaped: + +```````````````````````````````` example \## foo .## foo
-. +```````````````````````````````` + Contents are parsed as inlines: -. +```````````````````````````````` example # foo *bar* \*baz\* .# foo
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
foo
# bar
.
foo # bar
-. +```````````````````````````````` + A closing sequence of `#` characters is optional: -. +```````````````````````````````` example ## foo ## ### bar ### .Foo bar
Bar foo
-. +```````````````````````````````` -ATX headers can be empty: -. +ATX headings can be empty: + +```````````````````````````````` example ## # ### ### @@ -760,40 +826,42 @@ ATX headers can be empty: -. +```````````````````````````````` + -## Setext headers +## Setext headings -A [setext header](@setext-header) -consists of a line of text, containing at least one [non-whitespace character], -with no more than 3 spaces indentation, followed by a [setext header -underline]. The line of text must be -one that, were it not followed by the setext header underline, -would be interpreted as part of a paragraph: it cannot be -interpretable as a [code fence], [ATX header][ATX headers], -[block quote][block quotes], [horizontal rule][horizontal rules], +A [setext heading](@) consists of one or more +lines of text, each containing at least one [non-whitespace +character], with no more than 3 spaces indentation, followed by +a [setext heading underline]. The lines of text must be such +that, were they not followed by the setext heading underline, +they would be interpreted as a paragraph: they cannot be +interpretable as a [code fence], [ATX heading][ATX headings], +[block quote][block quotes], [thematic break][thematic breaks], [list item][list items], or [HTML block][HTML blocks]. -A [setext header underline](@setext-header-underline) is a sequence of +A [setext heading underline](@) is a sequence of `=` characters or a sequence of `-` characters, with no more than 3 spaces indentation and any number of trailing spaces. If a line containing a single `-` can be interpreted as an empty [list items], it should be interpreted this way -and not as a [setext header underline]. +and not as a [setext heading underline]. -The header is a level 1 header if `=` characters are used in the -[setext header underline], and a level 2 -header if `-` characters are used. The contents of the header are the -result of parsing the first line as Markdown inline content. +The heading is a level 1 heading if `=` characters are used in +the [setext heading underline], and a level 2 heading if `-` +characters are used. The contents of the heading are the result +of parsing the preceding lines of text as CommonMark inline +content. -In general, a setext header need not be preceded or followed by a +In general, a setext heading need not be preceded or followed by a blank line. However, it cannot interrupt a paragraph, so when a -setext header comes after a paragraph, a blank line is needed between +setext heading comes after a paragraph, a blank line is needed between them. Simple examples: -. +```````````````````````````````` example Foo *bar* ========= @@ -802,11 +870,24 @@ Foo *bar* .Foo ---
-. +```````````````````````````````` -The setext header underline cannot contain internal spaces: -. +The setext heading underline cannot contain internal spaces: + +```````````````````````````````` example Foo = = @@ -885,30 +971,33 @@ Foo = =Foo
`
of dashes"/>
-. +```````````````````````````````` -The setext header underline cannot be a [lazy continuation + +The setext heading underline cannot be a [lazy continuation line] in a list item or block quote: -. +```````````````````````````````` example > Foo --- . @@ -934,9 +1024,23 @@ line] in a list item or block quote:Foo
++```````````````````````````````` + + +```````````````````````````````` example - Foo --- . @@ -944,30 +1048,27 @@ line] in a list item or block quote:foo +bar +===
+
Foo -Bar
-Foo -Bar -===
+--- . +Baz
-. +```````````````````````````````` -Setext headers cannot be empty: -. +Setext headings cannot be empty: + +```````````````````````````````` example ==== .====
-. +```````````````````````````````` + -Setext header text lines must not be interpretable as block +Setext heading text lines must not be interpretable as block constructs other than paragraphs. So, the line of dashes -in these examples gets interpreted as a horizontal rule: +in these examples gets interpreted as a thematic break: -. +```````````````````````````````` example --- --- .foo
foo
a simple
- indented code block
-
-.
+One can find four different interpretations:
-If there is any ambiguity between an interpretation of indentation
-as a code block and as indicating that material belongs to a [list
-item][list items], the list item interpretation takes precedence:
+1. paragraph "Foo", heading "bar", paragraph "baz"
+2. paragraph "Foo bar", thematic break, paragraph "baz"
+3. paragraph "Foo bar --- baz"
+4. heading "Foo bar", paragraph "baz"
-.
- - foo
+We find interpretation 4 most natural, and interpretation 4
+increases the expressive power of CommonMark, by allowing
+multiline headings. Authors who want interpretation 1 can
+put a blank line after the first paragraph:
- bar
-.
-foo
-bar
-Foo
+baz
+```````````````````````````````` + + +Authors who want interpretation 2 can put blank lines around +the thematic break, + +```````````````````````````````` example +Foo +bar + +--- + +baz +. +Foo +bar
+baz
+```````````````````````````````` + + +or use a thematic break that cannot count as a [setext heading +line], such as + +```````````````````````````````` example +Foo +bar +* * * +baz +. +Foo +bar
+baz
+```````````````````````````````` + + +Authors who want interpretation 3 can use backslash escapes: + +```````````````````````````````` example +Foo +bar +\--- +baz +. +Foo +bar +--- +baz
+```````````````````````````````` + + +## Indented code blocks + +An [indented code block](@) is composed of one or more +[indented chunks] separated by blank lines. +An [indented chunk](@) is a sequence of non-blank lines, +each indented four or more spaces. The contents of the code block are +the literal contents of the lines, including trailing +[line endings], minus four spaces of indentation. +An indented code block has no [info string]. + +An indented code block cannot interrupt a paragraph, so there must be +a blank line between a paragraph and a following indented code block. +(A blank line is not needed, however, between a code block and a following +paragraph.) + +```````````````````````````````` example + a simple + indented code block +. +a simple
+ indented code block
+
+````````````````````````````````
+
+
+If there is any ambiguity between an interpretation of indentation
+as a code block and as indicating that material belongs to a [list
+item][list items], the list item interpretation takes precedence:
+
+```````````````````````````````` example
+ - foo
+
+ bar
+.
+foo
+bar
+Foo bar
-. +```````````````````````````````` + However, any non-blank line with fewer than four leading spaces ends the code block immediately. So a paragraph may occur immediately after indented code: -. +```````````````````````````````` example foo bar .foo
bar
-. +```````````````````````````````` + And indented code can occur immediately before and after other kinds of blocks: -. -# Header +```````````````````````````````` example +# Heading foo -Header +Heading ------ foo ---- . -foo
-foo
foo
bar
-.
+````````````````````````````````
+
Blank lines preceding or following an indented code block
are not included in it:
-.
+```````````````````````````````` example
foo
@@ -1217,29 +1420,31 @@ are not included in it:
.
foo
-.
+````````````````````````````````
+
Trailing spaces are included in the code block's content:
-.
+```````````````````````````````` example
foo
.
foo
-.
+````````````````````````````````
+
## Fenced code blocks
-A [code fence](@code-fence) is a sequence
+A [code fence](@) is a sequence
of at least three consecutive backtick characters (`` ` ``) or
tildes (`~`). (Tildes and backticks cannot be mixed.)
-A [fenced code block](@fenced-code-block)
+A [fenced code block](@)
begins with a code fence, indented no more than three spaces.
The line with the opening code fence may optionally contain some text
following the code fence; this is trimmed of leading and trailing
-spaces and called the [info string](@info-string).
+spaces and called the [info string](@).
The [info string] may not contain any backtick
characters. (The reason for this restriction is that otherwise
some inline code would be incorrectly interpreted as the
@@ -1275,7 +1480,7 @@ particular treatment of the [info string].
Here is a simple example with backticks:
-.
+```````````````````````````````` example
```
<
>
@@ -1284,11 +1489,12 @@ Here is a simple example with backticks:
<
>
-.
+````````````````````````````````
+
With tildes:
-.
+```````````````````````````````` example
~~~
<
>
@@ -1297,12 +1503,13 @@ With tildes:
<
>
-.
+````````````````````````````````
+
The closing code fence must use the same character as the opening
fence:
-.
+```````````````````````````````` example
```
aaa
~~~
@@ -1311,9 +1518,10 @@ aaa
aaa
~~~
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
~~~
aaa
```
@@ -1322,11 +1530,12 @@ aaa
aaa
```
-.
+````````````````````````````````
+
The closing code fence must be at least as long as the opening fence:
-.
+```````````````````````````````` example
````
aaa
```
@@ -1335,9 +1544,10 @@ aaa
aaa
```
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
~~~~
aaa
~~~
@@ -1346,18 +1556,20 @@ aaa
aaa
~~~
-.
+````````````````````````````````
+
Unclosed code blocks are closed by the end of the document
-(or the enclosing [block quote] or [list item]):
+(or the enclosing [block quote][block quotes] or [list item][list items]):
-.
+```````````````````````````````` example
```
.
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
`````
```
@@ -1367,9 +1579,10 @@ aaa
```
aaa
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
> ```
> aaa
@@ -1380,11 +1593,12 @@ bbb
bbb
-. +```````````````````````````````` + A code block can have all empty lines as its content: -. +```````````````````````````````` example ``` @@ -1393,22 +1607,24 @@ A code block can have all empty lines as its content:
-.
+````````````````````````````````
+
A code block can be empty:
-.
+```````````````````````````````` example
```
```
.
-.
+````````````````````````````````
+
Fences can be indented. If the opening fence is indented,
content lines will have equivalent opening indentation removed,
if present:
-.
+```````````````````````````````` example
```
aaa
aaa
@@ -1417,9 +1633,10 @@ aaa
aaa
aaa
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
```
aaa
aaa
@@ -1430,9 +1647,10 @@ aaa
aaa
aaa
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
```
aaa
aaa
@@ -1443,11 +1661,12 @@ aaa
aaa
aaa
-.
+````````````````````````````````
+
Four spaces indentation produces an indented code block:
-.
+```````````````````````````````` example
```
aaa
```
@@ -1456,32 +1675,35 @@ Four spaces indentation produces an indented code block:
aaa
```
-.
+````````````````````````````````
+
Closing fences may be indented by 0-3 spaces, and their indentation
need not match that of the opening fence:
-.
+```````````````````````````````` example
```
aaa
```
.
aaa
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
```
aaa
```
.
aaa
-.
+````````````````````````````````
+
This is not a closing fence, because it is indented 4 spaces:
-.
+```````````````````````````````` example
```
aaa
```
@@ -1489,20 +1711,22 @@ aaa
aaa
```
-.
+````````````````````````````````
+
Code fences (opening and closing) cannot contain internal spaces:
-.
+```````````````````````````````` example
``` ```
aaa
.
aaa
aaa
~~~ ~~
-.
+````````````````````````````````
+
Fenced code blocks can interrupt paragraphs, and can be followed
directly by paragraphs, without a blank line between:
-.
+```````````````````````````````` example
foo
```
bar
@@ -1526,12 +1751,13 @@ baz
bar
baz
-. +```````````````````````````````` + Other blocks can also occur before and after fenced code blocks without an intervening blank line: -. +```````````````````````````````` example foo --- ~~~ @@ -1543,14 +1769,15 @@ barbar
-.
+````````````````````````````````
-[Info string]s for backtick code blocks cannot contain backticks:
-.
+[Info strings] for backtick code blocks cannot contain backticks:
+
+```````````````````````````````` example
``` aa ```
foo
.
aa
foo
``` aaa
-.
+````````````````````````````````
+
## HTML blocks
-An [HTML block](@html-block) is a group of lines that is treated
+An [HTML block](@) is a group of lines that is treated
as raw HTML (and will not be escaped in HTML output).
There are seven kinds of [HTML block], which can be defined
by their start and end conditions. The block begins with a line that
-meets a [start condition](@start-condition) (after up to three spaces
+meets a [start condition](@) (after up to three spaces
optional indentation). It ends with the first subsequent line that
-meets a matching [end condition](@end-condition), or the last line of
+meets a matching [end condition](@), or the last line of
the document, if no line is encountered that meets the
[end condition]. If the first line meets both the [start condition]
and the [end condition], the block will contain just that line.
@@ -1646,28 +1878,29 @@ followed by one of the strings (case-insensitive) `address`,
`caption`, `center`, `col`, `colgroup`, `dd`, `details`, `dialog`,
`dir`, `div`, `dl`, `dt`, `fieldset`, `figcaption`, `figure`,
`footer`, `form`, `frame`, `frameset`, `h1`, `head`, `header`, `hr`,
-`html`, `legend`, `li`, `link`, `main`, `menu`, `menuitem`, `meta`,
-`nav`, `noframes`, `ol`, `optgroup`, `option`, `p`, `param`, `pre`,
-`section`, `source`, `title`, `summary`, `table`, `tbody`, `td`,
+`html`, `iframe`, `legend`, `li`, `link`, `main`, `menu`, `menuitem`,
+`meta`, `nav`, `noframes`, `ol`, `optgroup`, `option`, `p`, `param`,
+`section`, `source`, `summary`, `table`, `tbody`, `td`,
`tfoot`, `th`, `thead`, `title`, `tr`, `track`, `ul`, followed
by [whitespace], the end of the line, the string `>`, or
the string `/>`.\
**End condition:** line is followed by a [blank line].
-7. **Start condition:** line begins with an [open tag]
-(with any [tag name]) followed only by [whitespace] or the end
-of the line.\
+7. **Start condition:** line begins with a complete [open tag]
+or [closing tag] (with any [tag name] other than `script`,
+`style`, or `pre`) followed only by [whitespace]
+or the end of the line.\
**End condition:** line is followed by a [blank line].
All types of [HTML blocks] except type 7 may interrupt
a paragraph. Blocks of type 7 may not interrupt a paragraph.
-(This restricted is intended to prevent unwanted interpretation
+(This restriction is intended to prevent unwanted interpretation
of long tags inside a wrapped paragraph as starting HTML blocks.)
Some simple examples follow. Here are some basic HTML blocks
of type 6:
-.
+```````````````````````````````` example
@@ -1686,9 +1919,10 @@ okay. |
okay.
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo* -. +```````````````````````````````` + Here we have two HTML blocks with a Markdown paragraph between them: -. +```````````````````````````````` exampleMarkdown
bar
-. +```````````````````````````````` + A partial tag need not even be completed (garbage in, garbage out): -. +```````````````````````````````` example . -. +```````````````````````````````` -. + +```````````````````````````````` examplefoo |
foo |
foo
foo
import Text.HTML.TagSoup
@@ -1927,11 +2188,12 @@ import Text.HTML.TagSoup
main :: IO ()
main = print $ parseTags tags
-.
+````````````````````````````````
+
A script tag (type 1):
-.
+```````````````````````````````` example
-.
+````````````````````````````````
+
A style tag (type 1):
-.
+```````````````````````````````` example
-.
+````````````````````````````````
+
If there is no matching end tag, the block will end at the
-end of the document (or the enclosing [block quote] or
-[list item]):
+end of the document (or the enclosing [block quote][block quotes]
+or [list item][list items]):
-.
+```````````````````````````````` example
*foo*
.
foo
-. +```````````````````````````````` -. + +```````````````````````````````` example *bar* *baz* . *bar*baz
-. +```````````````````````````````` + Note that anything on the last line after the end tag will be included in the [HTML block]: -. +```````````````````````````````` example 1. *bar* @@ -2033,11 +2302,12 @@ foo 1. *bar* -. +```````````````````````````````` + A comment (type 2): -. +```````````````````````````````` example -. +```````````````````````````````` + A processing instruction (type 3): -. +```````````````````````````````` example '; @@ -2064,19 +2335,21 @@ A processing instruction (type 3): echo '>'; ?> -. +```````````````````````````````` + A declaration (type 4): -. +```````````````````````````````` example . -. +```````````````````````````````` + CDATA (type 5): -. +```````````````````````````````` example -. +```````````````````````````````` + The opening tag can be indented 1-3 spaces, but not 4: -. +```````````````````````````````` example @@ -2114,9 +2388,10 @@ The opening tag can be indented 1-3 spaces, but not 4:<!-- foo -->
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
<div>
-.
+````````````````````````````````
+
An HTML block of types 1--6 can interrupt a paragraph, and need not be
preceded by a blank line.
-.
+```````````````````````````````` example
Foo
Foo baz
-. +```````````````````````````````` + This rule differs from John Gruber's original Markdown syntax specification, which says: @@ -2198,7 +2477,7 @@ simply separate the Markdown from the HTML using blank lines: Compare: -. +```````````````````````````````` exampleEmphasized text.
` tags, but as described @@ -2287,7 +2570,7 @@ lines. ## Link reference definitions -A [link reference definition](@link-reference-definition) +A [link reference definition](@) consists of a [link label], indented up to three spaces, followed by a colon (`:`), optional [whitespace] (including up to one [line ending]), a [link destination], @@ -2295,24 +2578,25 @@ optional [whitespace] (including up to one [line ending]), and an optional [link title], which if it is present must be separated from the [link destination] by [whitespace]. -No further [non-whitespace character]s may occur on the line. +No further [non-whitespace characters] may occur on the line. A [link reference definition] does not correspond to a structural element of a document. Instead, it -defines a label which can be used in [reference link]s +defines a label which can be used in [reference links] and reference-style [images] elsewhere in the document. [Link reference definitions] can come either before or after the links that use them. -. +```````````````````````````````` example [foo]: /url "title" [foo] . -. +```````````````````````````````` -. + +```````````````````````````````` example [foo]: /url 'the title' @@ -2320,29 +2604,32 @@ them. [foo] . -. +```````````````````````````````` -. + +```````````````````````````````` example [Foo*bar\]]:my_(url) 'title (with parens)' [Foo*bar\]] . -. +```````````````````````````````` -. + +```````````````````````````````` example [Foo bar]: --. +```````````````````````````````` + The Laziness clause allows us to omit the `>` before a paragraph continuation line: -. +```````````````````````````````` example > # Foo > bar baz @@ -2813,12 +3132,13 @@ baz+ 'title' [Foo bar] . -. +```````````````````````````````` + The title may extend over multiple lines: -. +```````````````````````````````` example [foo]: /url ' title line1 @@ -2356,11 +2643,12 @@ title line1 line2 ">foo -. +```````````````````````````````` + However, it may not contain a [blank line]: -. +```````````````````````````````` example [foo]: /url 'title with blank line' @@ -2370,123 +2658,135 @@ with blank line' [foo]: /url 'title
with blank line'
[foo]
-. +```````````````````````````````` + The title may be omitted: -. +```````````````````````````````` example [foo]: /url [foo] . -. +```````````````````````````````` + The link destination may not be omitted: -. +```````````````````````````````` example [foo]: [foo] .[foo]:
[foo]
-. +```````````````````````````````` + Both title and destination can contain backslash escapes and literal backslashes: -. +```````````````````````````````` example [foo]: /url\bar\*baz "foo\"bar\baz" [foo] . -. +```````````````````````````````` + A link can come before its corresponding definition: -. +```````````````````````````````` example [foo] [foo]: url . -. +```````````````````````````````` + If there are several matching definitions, the first one takes precedence: -. +```````````````````````````````` example [foo] [foo]: first [foo]: second . -. +```````````````````````````````` + As noted in the section on [Links], matching of labels is case-insensitive (see [matches]). -. +```````````````````````````````` example [FOO]: /url [Foo] . -. +```````````````````````````````` -. + +```````````````````````````````` example [ΑΓΩ]: /φου [αγω] . -. +```````````````````````````````` + Here is a link reference definition with no corresponding link. It contributes nothing to the document. -. +```````````````````````````````` example [foo]: /url . -. +```````````````````````````````` + Here is another one: -. +```````````````````````````````` example [ foo ]: /url bar .bar
-. +```````````````````````````````` + This is not a link reference definition, because there are -[non-whitespace character]s after the title: +[non-whitespace characters] after the title: -. +```````````````````````````````` example [foo]: /url "title" ok .[foo]: /url "title" ok
-. +```````````````````````````````` + This is a link reference definition, but it has no title: -. +```````````````````````````````` example [foo]: /url "title" ok ."title" ok
-. +```````````````````````````````` + This is not a link reference definition, because it is indented four spaces: -. +```````````````````````````````` example [foo]: /url "title" [foo] @@ -2494,12 +2794,13 @@ four spaces:[foo]: /url "title"
[foo]
-. +```````````````````````````````` + This is not a link reference definition, because it occurs inside a code block: -. +```````````````````````````````` example ``` [foo]: /url ``` @@ -2509,11 +2810,12 @@ a code block:[foo]: /url
[foo]
-. +```````````````````````````````` + A [link reference definition] cannot interrupt a paragraph. -. +```````````````````````````````` example Foo [bar]: /baz @@ -2522,12 +2824,13 @@ FooFoo [bar]: /baz
[bar]
-. +```````````````````````````````` -However, it can directly follow other block elements, such as headers -and horizontal rules, and it need not be followed by a blank line. -. +However, it can directly follow other block elements, such as headings +and thematic breaks, and it need not be followed by a blank line. + +```````````````````````````````` example # [Foo] [foo]: /url > bar @@ -2536,12 +2839,13 @@ and horizontal rules, and it need not be followed by a blank line.-. +```````````````````````````````` -Several [link reference definition]s + +Several [link reference definitions] can occur one after another, without intervening blank lines. -. +```````````````````````````````` example [foo]: /foo-url "foo" [bar]: /bar-url "bar" @@ -2554,14 +2858,15 @@ can occur one after another, without intervening blank lines. -. +```````````````````````````````` + -[Link reference definition]s can occur +[Link reference definitions] can occur inside block containers, like lists and block quotations. They affect the entire document, not just the container in which they are defined: -. +```````````````````````````````` example [foo] > [foo]: /url @@ -2569,13 +2874,14 @@ are defined:bar
-. +```````````````````````````````` + ## Paragraphs A sequence of non-blank lines that cannot be interpreted as other -kinds of blocks forms a [paragraph](@paragraph). +kinds of blocks forms a [paragraph](@). The contents of the paragraph are the result of parsing the paragraph's raw content as inlines. The paragraph's raw content is formed by concatenating the lines and removing initial and final @@ -2583,18 +2889,19 @@ is formed by concatenating the lines and removing initial and final A simple example with two paragraphs: -. +```````````````````````````````` example aaa bbb .aaa
bbb
-. +```````````````````````````````` + Paragraphs can contain multiple lines, but no blank lines: -. +```````````````````````````````` example aaa bbb @@ -2605,11 +2912,12 @@ ddd bbbccc ddd
-. +```````````````````````````````` + Multiple blank lines between paragraph have no effect: -. +```````````````````````````````` example aaa @@ -2617,22 +2925,24 @@ bbb .aaa
bbb
-. +```````````````````````````````` + Leading spaces are skipped: -. +```````````````````````````````` example aaa bbb .aaa bbb
-. +```````````````````````````````` + Lines after the first may be indented any amount, since indented code blocks cannot interrupt paragraphs. -. +```````````````````````````````` example aaa bbb ccc @@ -2640,49 +2950,53 @@ aaaaaa bbb ccc
-. +```````````````````````````````` + However, the first line may be indented at most three spaces, or an indented code block will be triggered: -. +```````````````````````````````` example aaa bbb .aaa bbb
-. +```````````````````````````````` -. + +```````````````````````````````` example aaa bbb .aaa
bbb
-. +```````````````````````````````` + Final spaces are stripped before inline parsing, so a paragraph that ends with two or more spaces will not end with a [hard line break]: -. +```````````````````````````````` example aaa bbb .aaa
-. +```````````````````````````````` + ## Blank lines -[Blank line]s between block-level elements are ignored, +[Blank lines] between block-level elements are ignored, except for the role they play in determining whether a [list] is [tight] or [loose]. Blank lines at the beginning and end of the document are also ignored. -. +```````````````````````````````` example aaa @@ -2694,7 +3008,8 @@ aaa .
bbbaaa
aaa
-. +```````````````````````````````` + # Container blocks @@ -2719,7 +3034,7 @@ these constructions. (A recipe is provided below in the section entitled ## Block quotes -A [block quote marker](@block-quote-marker) +A [block quote marker](@) consists of 0-3 spaces of initial indent, plus (a) the character `>` together with a following space, or (b) a single character `>` not followed by a space. @@ -2736,7 +3051,7 @@ The following rules define [block quotes]: more lines in which the next [non-whitespace character] after the [block quote marker] is [paragraph continuation text] is a block quote with *Bs* as its content. - [Paragraph continuation text](@paragraph-continuation-text) is text + [Paragraph continuation text](@) is text that will be parsed as part of the content of a paragraph, but does not occur at the beginning of the paragraph. @@ -2747,7 +3062,7 @@ Nothing else counts as a [block quote](#block-quotes). Here is a simple example: -. +```````````````````````````````` example > # Foo > bar > baz @@ -2757,11 +3072,12 @@ Here is a simple example:bar baz
-. +```````````````````````````````` + The spaces after the `>` characters can be omitted: -. +```````````````````````````````` example ># Foo >bar > baz @@ -2771,11 +3087,12 @@ The spaces after the `>` characters can be omitted:bar baz
-. +```````````````````````````````` + The `>` characters can be indented 1-3 spaces: -. +```````````````````````````````` example > # Foo > bar > baz @@ -2785,11 +3102,12 @@ The `>` characters can be indented 1-3 spaces:bar baz
-. +```````````````````````````````` + Four spaces gives us a code block: -. +```````````````````````````````` example > # Foo > bar > baz @@ -2798,12 +3116,13 @@ Four spaces gives us a code block: > bar > baz
bar baz
-. +```````````````````````````````` + A block quote can contain some lazy and some non-lazy continuation lines: -. +```````````````````````````````` example > bar baz > foo @@ -2828,11 +3148,12 @@ baz baz foo -. +```````````````````````````````` + Laziness only applies to lines that would have been continuations of -paragraphs had they been prepended with `>`. For example, the -`>` cannot be omitted in the second line of +paragraphs had they been prepended with [block quote markers]. +For example, the `> ` cannot be omitted in the second line of ``` markdown > foo @@ -2841,7 +3162,7 @@ paragraphs had they been prepended with `>`. For example, the without changing the meaning: -. +```````````````````````````````` example > foo --- . @@ -2849,9 +3170,10 @@ without changing the meaning:foo
bar
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
> ```
foo
```
@@ -2899,29 +3223,57 @@ foo
foo
+````````````````````````````````
+
+
+Note that in the following case, we have a paragraph
+continuation line:
+
+```````````````````````````````` example
+> foo
+ - bar
.
+++```````````````````````````````` + + +To see why, note that in + +```markdown +> foo +> - bar +``` + +the `- bar` is indented too far to start a list, and can't +be an indented code block because indented code blocks cannot +interrupt paragraphs, so it is a [paragraph continuation line]. A block quote can be empty: -. +```````````````````````````````` example > .foo +- bar
+
-. +```````````````````````````````` -. + +```````````````````````````````` example > > > .
-. +```````````````````````````````` + A block quote can have initial or final blank lines: -. +```````````````````````````````` example > > foo > @@ -2929,11 +3281,12 @@ A block quote can have initial or final blank lines:
-. +```````````````````````````````` + A blank line always separates block quotes: -. +```````````````````````````````` example > foo > bar @@ -2944,7 +3297,8 @@ A blank line always separates block quotes:foo
-. +```````````````````````````````` + (Most current Markdown implementations, including John Gruber's original `Markdown.pl`, will parse this example as a single block quote @@ -2954,7 +3308,7 @@ whether two block quotes or one are wanted.) Consecutiveness means that if we put these block quotes together, we get a single block quote: -. +```````````````````````````````` example > foo > bar . @@ -2962,11 +3316,12 @@ we get a single block quote:bar
foo bar
-. +```````````````````````````````` + To get a block quote with two paragraphs, use: -. +```````````````````````````````` example > foo > > bar @@ -2975,11 +3330,12 @@ To get a block quote with two paragraphs, use:foo
bar
-. +```````````````````````````````` + Block quotes can interrupt paragraphs: -. +```````````````````````````````` example foo > bar . @@ -2987,12 +3343,13 @@ foo-. +```````````````````````````````` + In general, blank lines are not needed before or after block quotes: -. +```````````````````````````````` example > aaa *** > bbb @@ -3004,12 +3361,13 @@ quotes:bar
-. +```````````````````````````````` + However, because of laziness, a blank line is needed between a block quote and a following paragraph: -. +```````````````````````````````` example > bar baz . @@ -3017,9 +3375,10 @@ bazbbb
bar baz
-. +```````````````````````````````` -. + +```````````````````````````````` example > bar baz @@ -3028,9 +3387,10 @@ bazbar
baz
-. +```````````````````````````````` -. + +```````````````````````````````` example > bar > baz @@ -3039,13 +3399,14 @@ bazbar
baz
-. +```````````````````````````````` + It is a consequence of the Laziness rule that any number of initial `>`s may be omitted on a continuation line of a nested block quote: -. +```````````````````````````````` example > > > foo bar . @@ -3057,9 +3418,10 @@ bar -. +```````````````````````````````` -. + +```````````````````````````````` example >>> foo > bar >>baz @@ -3073,14 +3435,15 @@ baz -. +```````````````````````````````` + When including an indented code block in a block quote, remember that the [block quote marker] includes both the `>` and a following space. So *five spaces* are needed after the `>`: -. +```````````````````````````````` example > code > not code @@ -3092,18 +3455,19 @@ the `>`:-. +```````````````````````````````` + ## List items -A [list marker](@list-marker) is a +A [list marker](@) is a [bullet list marker] or an [ordered list marker]. -A [bullet list marker](@bullet-list-marker) +A [bullet list marker](@) is a `-`, `+`, or `*` character. -An [ordered list marker](@ordered-list-marker) +An [ordered list marker](@) is a sequence of 1--9 arabic digits (`0-9`), followed by either a `.` character or a `)` character. (The reason for the length limit is that with 10 digits we start seeing integer overflows @@ -3124,7 +3488,7 @@ The following rules define [list items]: For example, let *Ls* be the lines -. +```````````````````````````````` example A paragraph with two lines. @@ -3139,13 +3503,14 @@ with two lines.not code
-. +```````````````````````````````` + And let *M* be the marker `1.`, and *N* = 2. Then rule #1 says that the following is an ordered list item with start number 1, and the same contents as *Ls*: -. +```````````````````````````````` example 1. A paragraph with two lines. @@ -3164,7 +3529,8 @@ with two lines. -. +```````````````````````````````` + The most important thing to notice is that the position of the text after the list marker determines how much indentation @@ -3177,7 +3543,7 @@ item. Here are some examples showing how far content must be indented to be put under the list item: -. +```````````````````````````````` example - one two @@ -3186,9 +3552,10 @@ put under the list item:A block quote.
two
-. +```````````````````````````````` -. + +```````````````````````````````` example - one two @@ -3199,9 +3566,10 @@ put under the list item:two
-. +```````````````````````````````` -. + +```````````````````````````````` example - one two @@ -3211,9 +3579,10 @@ put under the list item: two
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
- one
two
@@ -3224,7 +3593,8 @@ put under the list item:
two
-. +```````````````````````````````` + It is tempting to think of this in terms of columns: the continuation blocks must be indented at least to the column of the first @@ -3234,7 +3604,7 @@ is needed. Which column this indentation reaches will depend on how the list item is embedded in other constructions, as shown by this example: -. +```````````````````````````````` example > > 1. one >> >> two @@ -3249,7 +3619,8 @@ this example: -. +```````````````````````````````` + Here `two` occurs in the same column as the list marker `1.`, but is actually contained in the list item, because there is @@ -3260,7 +3631,7 @@ occurs far to the right of the initial text of the list item, `one`, but it is not considered part of the list item, because it is not indented far enough past the blockquote marker: -. +```````````````````````````````` example >>- one >> > > two @@ -3273,25 +3644,27 @@ far enough past the blockquote marker:two
-. +```````````````````````````````` + Note that at least one space is needed between the list marker and any following content, so these are not list items: -. +```````````````````````````````` example -one 2.two .-one
2.two
-. +```````````````````````````````` + A list item may not contain blocks that are separated by more than one blank line. Thus, two blank lines will end a list, unless the two blanks are contained in a [fenced code block]. -. +```````````````````````````````` example - foo bar @@ -3348,11 +3721,12 @@ bar -. +```````````````````````````````` + A list item may contain any kind of block: -. +```````````````````````````````` example 1. foo ``` @@ -3374,49 +3748,99 @@ A list item may contain any kind of block: +```````````````````````````````` + + +A list item that contains an indented code block will preserve +empty lines within the code block verbatim, unless there are two +or more empty lines in a row (since as described above, two +blank lines end the list): + +```````````````````````````````` example +- Foo + + bar + + baz . +Foo
+bar
-Note that ordered list start numbers must be nine digits or less:
+baz
+
+Foo
+bar
+
+ baz
+
+````````````````````````````````
+
+
+Note that ordered list start numbers must be nine digits or less:
+
+```````````````````````````````` example
123456789. ok
.
1234567890. not ok
-. +```````````````````````````````` + A start number may begin with 0s: -. +```````````````````````````````` example 0. ok .-1. not ok
-. +```````````````````````````````` + 2. **Item starting with indented code.** If a sequence of lines *Ls* @@ -3435,7 +3859,7 @@ An indented code block will have to be indented four spaces beyond the edge of the region where text will be included in the list item. In the following case that is 6 spaces: -. +```````````````````````````````` example - foo bar @@ -3447,11 +3871,12 @@ In the following case that is 6 spaces: -. +```````````````````````````````` + And in this case it is 11 spaces: -. +```````````````````````````````` example 10. foo bar @@ -3463,13 +3888,14 @@ And in this case it is 11 spaces: -. +```````````````````````````````` + If the *first* block in the list item is an indented code block, then by rule #2, the contents must be indented *one* space after the list marker: -. +```````````````````````````````` example indented code paragraph @@ -3481,9 +3907,10 @@ paragraphparagraph
more code
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
1. indented code
paragraph
@@ -3499,12 +3926,13 @@ paragraph
-.
+````````````````````````````````
+
Note that an additional space indent is interpreted as space
inside the code block:
-.
+```````````````````````````````` example
1. indented code
paragraph
@@ -3520,7 +3948,8 @@ inside the code block:
-.
+````````````````````````````````
+
Note that rules #1 and #2 only apply to two cases: (a) cases
in which the lines to be included in a list item begin with a
@@ -3530,16 +3959,17 @@ block. In a case like the following, where the first block begins with
a three-space indent, the rules do not allow us to form a list item by
indenting the whole thing and prepending a list marker:
-.
+```````````````````````````````` example
foo
bar
.
foo
bar
-. +```````````````````````````````` -. + +```````````````````````````````` example - foo bar @@ -3548,14 +3978,15 @@ barbar
-. +```````````````````````````````` + This is not a significant restriction, because when a block begins with 1-3 spaces indent, the indentation can always be removed without a change in interpretation, allowing rule #1 to be applied. So, in the above case: -. +```````````````````````````````` example - foo bar @@ -3566,7 +3997,8 @@ the above case:bar
-. +```````````````````````````````` + 3. **Item starting with a blank line.** If a sequence of lines *Ls* starting with a single [blank line] constitute a (possibly empty) @@ -3582,7 +4014,7 @@ the above case: Here are some list items that start with a blank line but are not empty: -. +```````````````````````````````` example - foo - @@ -3603,11 +4035,28 @@ Here are some list items that start with a blank line but are not empty: +```````````````````````````````` + + +A list item can begin with at most one blank line. +In the following example, `foo` is not part of the list +item: + +```````````````````````````````` example +- + + foo . +foo
+```````````````````````````````` + Here is an empty bullet list item: -. +```````````````````````````````` example - foo - - bar @@ -3617,11 +4066,12 @@ Here is an empty bullet list item:` tags, while paragraphs in a tight list are not.) Changing the bullet or ordered list delimiter starts a new list: -. +```````````````````````````````` example - foo - bar + baz @@ -4182,9 +4650,10 @@ Changing the bullet or ordered list delimiter starts a new list:
bim
-.
+````````````````````````````````
+
Thus, two blank lines can be used to separate consecutive lists of
the same type, or to separate a list from an indented code block
that would otherwise be parsed as a subparagraph of the final list
item:
-.
+```````````````````````````````` example
- foo
- bar
@@ -4369,9 +4844,10 @@ item:
code
-.
+````````````````````````````````
+
List items need not be indented to the same level. The following
list items will be treated as items at the same list level,
since none is indented enough to belong to the previous list
item:
-.
+```````````````````````````````` example
- a
- b
- c
@@ -4421,9 +4898,10 @@ item:
c
-. +```````````````````````````````` + This is a loose list, because there is a blank line between two of the list items: -. +```````````````````````````````` example - a - b @@ -4463,11 +4942,12 @@ two of the list items:c
-. +```````````````````````````````` + So is this, with a empty second item: -. +```````````````````````````````` example * a * @@ -4482,13 +4962,14 @@ So is this, with a empty second item:c
-. +```````````````````````````````` + These are loose lists, even though there is no space between the items, because one of the items directly contains two block-level elements with a blank line between them: -. +```````````````````````````````` example - a - b @@ -4507,9 +4988,10 @@ with a blank line between them:d
-. +```````````````````````````````` -. + +```````````````````````````````` example - a - b @@ -4527,11 +5009,12 @@ with a blank line between them:d
-. +```````````````````````````````` + This is a tight list, because the blank lines are in a code block: -. +```````````````````````````````` example - a - ``` b @@ -4550,13 +5033,14 @@ This is a tight list, because the blank lines are in a code block:bar
-. +```````````````````````````````` + Here the outer list is loose, the inner list tight: -. +```````````````````````````````` example * foo * bar @@ -4677,9 +5167,10 @@ Here the outer list is loose, the inner list tight:baz
-. +```````````````````````````````` -. + +```````````````````````````````` example - a - b - c @@ -4704,7 +5195,8 @@ Here the outer list is loose, the inner list tight: -. +```````````````````````````````` + # Inlines @@ -4712,11 +5204,12 @@ Inlines are parsed sequentially from the beginning of the character stream to the end (left to right, in left-to-right languages). Thus, for example, in -. +```````````````````````````````` example `hi`lo` .hi
lo`
!"#$%&'()*+,-./:;<=>?@[\]^_`{|}~
-. +```````````````````````````````` + Backslashes before other characters are treated as literal backslashes: -. +```````````````````````````````` example \→\A\a\ \3\φ\« .\→\A\a\ \3\φ\«
-. +```````````````````````````````` + Escaped characters are treated as regular characters and do not have their usual Markdown meanings: -. +```````````````````````````````` example \*not emphasized* \*not emphasized* @@ -4759,109 +5254,120 @@ not have their usual Markdown meanings: `not code` 1. not a list * not a list -# not a header +# not a heading [foo]: /url "not a reference"
-. +```````````````````````````````` + If a backslash is itself escaped, the following character is not: -. +```````````````````````````````` example \\*emphasis* .\emphasis
-. +```````````````````````````````` + A backslash at the end of the line is a [hard line break]: -. +```````````````````````````````` example foo\ bar .foo
bar
\[\`
\[\]
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
~~~
\[\]
~~~
.
\[\]
-.
+````````````````````````````````
-.
+
+```````````````````````````````` example
foo
-.
+````````````````````````````````
-## Entities
-With the goal of making this standard as HTML-agnostic as possible, all
-valid HTML entities (except in code blocks and code spans)
-are recognized as such and converted into unicode characters before
-they are stored in the AST. This means that renderers to formats other
-than HTML need not be HTML-entity aware. HTML renderers may either escape
-unicode characters as entities or leave them as they are. (However,
-`"`, `&`, `<`, and `>` must always be rendered as entities.)
+## Entity and numeric character references
-[Named entities](@name-entities) consist of `&`
-+ any of the valid HTML5 entity names + `;`. The
-[following document](https://html.spec.whatwg.org/multipage/entities.json)
-is used as an authoritative source of the valid entity names and their
-corresponding codepoints.
+All valid HTML entity references and numeric character
+references, except those occuring in code blocks and code spans,
+are recognized as such and treated as equivalent to the
+corresponding Unicode characters. Conforming CommonMark parsers
+need not store information about whether a particular character
+was represented in the source using a Unicode character or
+an entity reference.
-.
+[Entity references](@) consist of `&` + any of the valid
+HTML5 entity names + `;`. The
+document & © Æ Ď ¾ ℋ ⅆ ∲ ≧̸
-. +```````````````````````````````` -[Decimal entities](@decimal-entities) -consist of `` + a string of 1--8 arabic digits + `;`. Again, these -entities need to be recognised and transformed into their corresponding -unicode codepoints. Invalid unicode codepoints will be replaced by -the "unknown codepoint" character (`U+FFFD`). For security reasons, -the codepoint `U+0000` will also be replaced by `U+FFFD`. -. +[Decimal numeric character +references](@) +consist of `` + a string of 1--8 arabic digits + `;`. A +numeric character reference is parsed as the corresponding +Unicode character. Invalid Unicode code points will be replaced by +the REPLACEMENT CHARACTER (`U+FFFD`). For security reasons, +the code point `U+0000` will also be replaced by `U+FFFD`. + +```````````````````````````````` example # Ӓ Ϡ .# Ӓ Ϡ � �
-. +```````````````````````````````` -[Hexadecimal entities](@hexadecimal-entities) -consist of `` + either `X` or `x` + a string of 1-8 hexadecimal digits -+ `;`. They will also be parsed and turned into the corresponding -unicode codepoints in the AST. -. +[Hexadecimal numeric character +references](@) consist of `` + +either `X` or `x` + a string of 1-8 hexadecimal digits + `;`. +They too are parsed as the corresponding Unicode character (this +time specified with a hexadecimal numeral instead of decimal). + +```````````````````````````````` example " ആ ಫ ." ആ ಫ
-. +```````````````````````````````` + Here are some nonentities: +```````````````````````````````` example +  &x; +&ThisIsNotDefined; &hi?; . -  &x; &ThisIsWayTooLongToBeAnEntityIsntIt; &hi?; -. -  &x; &#; &#x; &ThisIsWayTooLongToBeAnEntityIsntIt; &hi?;
-. +  &x; &#; &#x; +&ThisIsNotDefined; &hi?;
+```````````````````````````````` -Although HTML5 does accept some entities without a trailing semicolon -(such as `©`), these are not recognized as entities here, because it -makes the grammar too ambiguous: -. +Although HTML5 does accept some entity references +without a trailing semicolon (such as `©`), these are not +recognized here, because it makes the grammar too ambiguous: + +```````````````````````````````` example © .©
-. +```````````````````````````````` + Strings that are not on the list of HTML5 named entities are not -recognized as entities either: +recognized as entity references either: -. +```````````````````````````````` example &MadeUpEntity; .&MadeUpEntity;
-. +```````````````````````````````` -Entities are recognized in any context besides code spans or -code blocks, including raw HTML, URLs, [link title]s, and -[fenced code block] [info string]s: -. +Entity and numeric character references are recognized in any +context besides code spans or code blocks, including +URLs, [link titles], and [fenced code block][] [info strings]: + +```````````````````````````````` example . -. +```````````````````````````````` -. + +```````````````````````````````` example [foo](/föö "föö") . -. +```````````````````````````````` -. + +```````````````````````````````` example [foo] [foo]: /föö "föö" . -. +```````````````````````````````` -. + +```````````````````````````````` example ``` föö foo ``` .foo
-.
+````````````````````````````````
-Entities are treated as literal text in code spans and code blocks:
-.
+Entity and numeric character references are treated as literal
+text in code spans and code blocks:
+
+```````````````````````````````` example
`föö`
.
föö
föfö
-.
+````````````````````````````````
+
## Code spans
-A [backtick string](@backtick-string)
+A [backtick string](@)
is a string of one or more backtick characters (`` ` ``) that is neither
preceded nor followed by a backtick.
-A [code span](@code-span) begins with a backtick string and ends with
+A [code span](@) begins with a backtick string and ends with
a backtick string of equal length. The contents of the code span are
the characters between the two backtick strings, with leading and
-trailing spaces and [line ending]s removed, and
+trailing spaces and [line endings] removed, and
[whitespace] collapsed to single spaces.
This is a simple code span:
-.
+```````````````````````````````` example
`foo`
.
foo
foo ` bar
``
foo
foo bar baz
foo `` bar
foo\
bar`
*foo*
[not a link](/foo
)
<a href="
">`
<http://foo.bar.
baz>`
```foo``
-. +```````````````````````````````` -. + +```````````````````````````````` example `foo .`foo
-. +```````````````````````````````` + ## Emphasis and strong emphasis @@ -5173,24 +5711,24 @@ no emphasis: foo_bar_baz The rules given below capture all of these patterns, while allowing for efficient parsing strategies that do not backtrack. -First, some definitions. A [delimiter run](@delimiter-run) is either +First, some definitions. A [delimiter run](@) is either a sequence of one or more `*` characters that is not preceded or followed by a `*` character, or a sequence of one or more `_` characters that is not preceded or followed by a `_` character. -A [left-flanking delimiter run](@left-flanking-delimiter-run) is -a [delimiter run] that is (a) not followed by [unicode whitespace], +A [left-flanking delimiter run](@) is +a [delimiter run] that is (a) not followed by [Unicode whitespace], and (b) either not followed by a [punctuation character], or -preceded by [unicode whitespace] or a [punctuation character]. +preceded by [Unicode whitespace] or a [punctuation character]. For purposes of this definition, the beginning and the end of -the line count as unicode whitespace. +the line count as Unicode whitespace. -A [right-flanking delimiter run](@right-flanking-delimiter-run) is -a [delimiter run] that is (a) not preceded by [unicode whitespace], +A [right-flanking delimiter run](@) is +a [delimiter run] that is (a) not preceded by [Unicode whitespace], and (b) either not preceded by a [punctuation character], or -followed by [unicode whitespace] or a [punctuation character]. +followed by [Unicode whitespace] or a [punctuation character]. For purposes of this definition, the beginning and the end of -the line count as unicode whitespace. +the line count as Unicode whitespace. Here are some examples of delimiter runs. @@ -5236,40 +5774,40 @@ are a bit more complex than the ones given here.) The following rules define emphasis and strong emphasis: -1. A single `*` character [can open emphasis](@can-open-emphasis) +1. A single `*` character [can open emphasis](@) iff (if and only if) it is part of a [left-flanking delimiter run]. 2. A single `_` character [can open emphasis] iff it is part of a [left-flanking delimiter run] and either (a) not part of a [right-flanking delimiter run] - or (b) part of a [right-flanking delimeter run] + or (b) part of a [right-flanking delimiter run] preceded by punctuation. -3. A single `*` character [can close emphasis](@can-close-emphasis) +3. A single `*` character [can close emphasis](@) iff it is part of a [right-flanking delimiter run]. 4. A single `_` character [can close emphasis] iff it is part of a [right-flanking delimiter run] and either (a) not part of a [left-flanking delimiter run] - or (b) part of a [left-flanking delimeter run] + or (b) part of a [left-flanking delimiter run] followed by punctuation. -5. A double `**` [can open strong emphasis](@can-open-strong-emphasis) +5. A double `**` [can open strong emphasis](@) iff it is part of a [left-flanking delimiter run]. 6. A double `__` [can open strong emphasis] iff it is part of a [left-flanking delimiter run] and either (a) not part of a [right-flanking delimiter run] - or (b) part of a [right-flanking delimeter run] + or (b) part of a [right-flanking delimiter run] preceded by punctuation. -7. A double `**` [can close strong emphasis](@can-close-strong-emphasis) +7. A double `**` [can close strong emphasis](@) iff it is part of a [right-flanking delimiter run]. 8. A double `__` [can close strong emphasis] it is part of a [right-flanking delimiter run] and either (a) not part of a [left-flanking delimiter run] - or (b) part of a [left-flanking delimeter run] + or (b) part of a [left-flanking delimiter run] followed by punctuation. 9. Emphasis begins with a delimiter that [can open emphasis] and ends @@ -5330,141 +5868,157 @@ These rules can be illustrated through a series of examples. Rule 1: -. +```````````````````````````````` example *foo bar* .foo bar
-. +```````````````````````````````` + This is not emphasis, because the opening `*` is followed by whitespace, and hence not part of a [left-flanking delimiter run]: -. +```````````````````````````````` example a * foo bar* .a * foo bar*
-. +```````````````````````````````` + This is not emphasis, because the opening `*` is preceded by an alphanumeric and followed by punctuation, and hence not part of a [left-flanking delimiter run]: -. +```````````````````````````````` example a*"foo"* .a*"foo"*
-. +```````````````````````````````` + Unicode nonbreaking spaces count as whitespace, too: -. +```````````````````````````````` example * a * .* a *
-. +```````````````````````````````` + Intraword emphasis with `*` is permitted: -. +```````````````````````````````` example foo*bar* .foobar
-. +```````````````````````````````` -. + +```````````````````````````````` example 5*6*78 .5678
-. +```````````````````````````````` + Rule 2: -. +```````````````````````````````` example _foo bar_ .foo bar
-. +```````````````````````````````` + This is not emphasis, because the opening `_` is followed by whitespace: -. +```````````````````````````````` example _ foo bar_ ._ foo bar_
-. +```````````````````````````````` + This is not emphasis, because the opening `_` is preceded by an alphanumeric and followed by punctuation: -. +```````````````````````````````` example a_"foo"_ .a_"foo"_
-. +```````````````````````````````` + Emphasis with `_` is not allowed inside words: -. +```````````````````````````````` example foo_bar_ .foo_bar_
-. +```````````````````````````````` -. + +```````````````````````````````` example 5_6_78 .5_6_78
-. +```````````````````````````````` -. + +```````````````````````````````` example пристаням_стремятся_ .пристаням_стремятся_
-. +```````````````````````````````` + Here `_` does not generate emphasis, because the first delimiter run is right-flanking and the second left-flanking: -. +```````````````````````````````` example aa_"bb"_cc .aa_"bb"_cc
-. +```````````````````````````````` + This is emphasis, even though the opening delimiter is both left- and right-flanking, because it is preceded by punctuation: -. +```````````````````````````````` example foo-_(bar)_ .foo-(bar)
-. +```````````````````````````````` + Rule 3: This is not emphasis, because the closing delimiter does not match the opening delimiter: -. +```````````````````````````````` example _foo* ._foo*
-. +```````````````````````````````` + This is not emphasis, because the closing `*` is preceded by whitespace: -. +```````````````````````````````` example *foo bar * .*foo bar *
-. +```````````````````````````````` + A newline also counts as whitespace: -. +```````````````````````````````` example *foo bar * . @@ -5472,34 +6026,38 @@ A newline also counts as whitespace:*(*foo)
-. +```````````````````````````````` + The point of this restriction is more easily appreciated with this example: -. +```````````````````````````````` example *(*foo*)* .(foo)
-. +```````````````````````````````` + Intraword emphasis with `*` is allowed: -. +```````````````````````````````` example *foo*bar .foobar
-. +```````````````````````````````` + Rule 4: @@ -5507,164 +6065,184 @@ Rule 4: This is not emphasis, because the closing `_` is preceded by whitespace: -. +```````````````````````````````` example _foo bar _ ._foo bar _
-. +```````````````````````````````` + This is not emphasis, because the second `_` is preceded by punctuation and followed by an alphanumeric: -. +```````````````````````````````` example _(_foo) ._(_foo)
-. +```````````````````````````````` + This is emphasis within emphasis: -. +```````````````````````````````` example _(_foo_)_ .(foo)
-. +```````````````````````````````` + Intraword emphasis is disallowed for `_`: -. +```````````````````````````````` example _foo_bar ._foo_bar
-. +```````````````````````````````` -. + +```````````````````````````````` example _пристаням_стремятся ._пристаням_стремятся
-. +```````````````````````````````` -. + +```````````````````````````````` example _foo_bar_baz_ .foo_bar_baz
-. +```````````````````````````````` + This is emphasis, even though the closing delimiter is both left- and right-flanking, because it is followed by punctuation: -. +```````````````````````````````` example _(bar)_. .(bar).
-. +```````````````````````````````` + Rule 5: -. +```````````````````````````````` example **foo bar** .foo bar
-. +```````````````````````````````` + This is not strong emphasis, because the opening delimiter is followed by whitespace: -. +```````````````````````````````` example ** foo bar** .** foo bar**
-. +```````````````````````````````` + This is not strong emphasis, because the opening `**` is preceded by an alphanumeric and followed by punctuation, and hence not part of a [left-flanking delimiter run]: -. +```````````````````````````````` example a**"foo"** .a**"foo"**
-. +```````````````````````````````` + Intraword strong emphasis with `**` is permitted: -. +```````````````````````````````` example foo**bar** .foobar
-. +```````````````````````````````` + Rule 6: -. +```````````````````````````````` example __foo bar__ .foo bar
-. +```````````````````````````````` + This is not strong emphasis, because the opening delimiter is followed by whitespace: -. +```````````````````````````````` example __ foo bar__ .__ foo bar__
-. +```````````````````````````````` + A newline counts as whitespace: -. +```````````````````````````````` example __ foo bar__ .__ foo bar__
-. +```````````````````````````````` + This is not strong emphasis, because the opening `__` is preceded by an alphanumeric and followed by punctuation: -. +```````````````````````````````` example a__"foo"__ .a__"foo"__
-. +```````````````````````````````` + Intraword strong emphasis is forbidden with `__`: -. +```````````````````````````````` example foo__bar__ .foo__bar__
-. +```````````````````````````````` -. + +```````````````````````````````` example 5__6__78 .5__6__78
-. +```````````````````````````````` -. + +```````````````````````````````` example пристаням__стремятся__ .пристаням__стремятся__
-. +```````````````````````````````` -. + +```````````````````````````````` example __foo, __bar__, baz__ .foo, bar, baz
-. +```````````````````````````````` + This is strong emphasis, even though the opening delimiter is both left- and right-flanking, because it is preceded by punctuation: -. +```````````````````````````````` example foo-__(bar)__ .foo-(bar)
-. +```````````````````````````````` + Rule 7: @@ -5672,11 +6250,12 @@ Rule 7: This is not strong emphasis, because the closing delimiter is preceded by whitespace: -. +```````````````````````````````` example **foo bar ** .**foo bar **
-. +```````````````````````````````` + (Nor can it be interpreted as an emphasized `*foo bar *`, because of Rule 11.) @@ -5684,215 +6263,242 @@ Rule 11.) This is not strong emphasis, because the second `**` is preceded by punctuation and followed by an alphanumeric: -. +```````````````````````````````` example **(**foo) .**(**foo)
-. +```````````````````````````````` + The point of this restriction is more easily appreciated with these examples: -. +```````````````````````````````` example *(**foo**)* .(foo)
-. +```````````````````````````````` -. + +```````````````````````````````` example **Gomphocarpus (*Gomphocarpus physocarpus*, syn. *Asclepias physocarpa*)** .Gomphocarpus (Gomphocarpus physocarpus, syn. Asclepias physocarpa)
-. +```````````````````````````````` -. + +```````````````````````````````` example **foo "*bar*" foo** .foo "bar" foo
-. +```````````````````````````````` + Intraword emphasis: -. +```````````````````````````````` example **foo**bar .foobar
-. +```````````````````````````````` + Rule 8: This is not strong emphasis, because the closing delimiter is preceded by whitespace: -. +```````````````````````````````` example __foo bar __ .__foo bar __
-. +```````````````````````````````` + This is not strong emphasis, because the second `__` is preceded by punctuation and followed by an alphanumeric: -. +```````````````````````````````` example __(__foo) .__(__foo)
-. +```````````````````````````````` + The point of this restriction is more easily appreciated with this example: -. +```````````````````````````````` example _(__foo__)_ .(foo)
-. +```````````````````````````````` + Intraword strong emphasis is forbidden with `__`: -. +```````````````````````````````` example __foo__bar .__foo__bar
-. +```````````````````````````````` -. + +```````````````````````````````` example __пристаням__стремятся .__пристаням__стремятся
-. +```````````````````````````````` -. + +```````````````````````````````` example __foo__bar__baz__ .foo__bar__baz
-. +```````````````````````````````` + This is strong emphasis, even though the closing delimiter is both left- and right-flanking, because it is followed by punctuation: -. +```````````````````````````````` example __(bar)__. .(bar).
-. +```````````````````````````````` + Rule 9: Any nonempty sequence of inline elements can be the contents of an emphasized span. -. +```````````````````````````````` example *foo [bar](/url)* .foo bar
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo bar* .foo bar
-. +```````````````````````````````` + In particular, emphasis and strong emphasis can be nested inside emphasis: -. +```````````````````````````````` example _foo __bar__ baz_ .foo bar baz
-. +```````````````````````````````` -. + +```````````````````````````````` example _foo _bar_ baz_ .foo bar baz
-. +```````````````````````````````` -. + +```````````````````````````````` example __foo_ bar_ .foo bar
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo *bar** .foo bar
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo **bar** baz* .foo bar baz
-. +```````````````````````````````` + But note: -. +```````````````````````````````` example *foo**bar**baz* .foobarbaz
-. +```````````````````````````````` + The difference is that in the preceding case, the internal delimiters [can close emphasis], while in the cases with spaces, they cannot. -. +```````````````````````````````` example ***foo** bar* .foo bar
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo **bar*** .foo bar
-. +```````````````````````````````` + Note, however, that in the following case we get no strong emphasis, because the opening delimiter is closed by the first `*` before `bar`: -. +```````````````````````````````` example *foo**bar*** .foobar**
-. +```````````````````````````````` + Indefinite levels of nesting are possible: -. +```````````````````````````````` example *foo **bar *baz* bim** bop* .foo bar baz bim bop
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo [*bar*](/url)* .foo bar
-. +```````````````````````````````` + There can be no empty emphasis or strong emphasis: -. +```````````````````````````````` example ** is not an empty emphasis .** is not an empty emphasis
-. +```````````````````````````````` -. + +```````````````````````````````` example **** is not an empty strong emphasis .**** is not an empty strong emphasis
-. +```````````````````````````````` + Rule 10: @@ -5900,431 +6506,492 @@ Rule 10: Any nonempty sequence of inline elements can be the contents of an strongly emphasized span. -. +```````````````````````````````` example **foo [bar](/url)** .foo bar
-. +```````````````````````````````` -. + +```````````````````````````````` example **foo bar** .foo bar
-. +```````````````````````````````` + In particular, emphasis and strong emphasis can be nested inside strong emphasis: -. +```````````````````````````````` example __foo _bar_ baz__ .foo bar baz
-. +```````````````````````````````` -. + +```````````````````````````````` example __foo __bar__ baz__ .foo bar baz
-. +```````````````````````````````` -. + +```````````````````````````````` example ____foo__ bar__ .foo bar
-. +```````````````````````````````` -. + +```````````````````````````````` example **foo **bar**** .foo bar
-. +```````````````````````````````` -. + +```````````````````````````````` example **foo *bar* baz** .foo bar baz
-. +```````````````````````````````` + But note: -. +```````````````````````````````` example **foo*bar*baz** .foobarbaz**
-. +```````````````````````````````` + The difference is that in the preceding case, the internal delimiters [can close emphasis], while in the cases with spaces, they cannot. -. +```````````````````````````````` example ***foo* bar** .foo bar
-. +```````````````````````````````` -. + +```````````````````````````````` example **foo *bar*** .foo bar
-. +```````````````````````````````` + Indefinite levels of nesting are possible: -. +```````````````````````````````` example **foo *bar **baz** bim* bop** .foo bar baz bim bop
-. +```````````````````````````````` -. + +```````````````````````````````` example **foo [*bar*](/url)** .foo bar
-. +```````````````````````````````` + There can be no empty emphasis or strong emphasis: -. +```````````````````````````````` example __ is not an empty emphasis .__ is not an empty emphasis
-. +```````````````````````````````` -. + +```````````````````````````````` example ____ is not an empty strong emphasis .____ is not an empty strong emphasis
-. +```````````````````````````````` + Rule 11: -. +```````````````````````````````` example foo *** .foo ***
-. +```````````````````````````````` -. + +```````````````````````````````` example foo *\** .foo *
-. +```````````````````````````````` -. + +```````````````````````````````` example foo *_* .foo _
-. +```````````````````````````````` -. + +```````````````````````````````` example foo ***** .foo *****
-. +```````````````````````````````` -. + +```````````````````````````````` example foo **\*** .foo *
-. +```````````````````````````````` -. + +```````````````````````````````` example foo **_** .foo _
-. +```````````````````````````````` + Note that when delimiters do not match evenly, Rule 11 determines that the excess literal `*` characters will appear outside of the emphasis, rather than inside it: -. +```````````````````````````````` example **foo* .*foo
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo** .foo*
-. +```````````````````````````````` -. + +```````````````````````````````` example ***foo** .*foo
-. +```````````````````````````````` -. + +```````````````````````````````` example ****foo* .***foo
-. +```````````````````````````````` -. + +```````````````````````````````` example **foo*** .foo*
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo**** .foo***
-. +```````````````````````````````` + Rule 12: -. +```````````````````````````````` example foo ___ .foo ___
-. +```````````````````````````````` -. + +```````````````````````````````` example foo _\__ .foo _
-. +```````````````````````````````` -. + +```````````````````````````````` example foo _*_ .foo *
-. +```````````````````````````````` -. + +```````````````````````````````` example foo _____ .foo _____
-. +```````````````````````````````` -. + +```````````````````````````````` example foo __\___ .foo _
-. +```````````````````````````````` -. + +```````````````````````````````` example foo __*__ .foo *
-. +```````````````````````````````` -. + +```````````````````````````````` example __foo_ ._foo
-. +```````````````````````````````` + Note that when delimiters do not match evenly, Rule 12 determines that the excess literal `_` characters will appear outside of the emphasis, rather than inside it: -. +```````````````````````````````` example _foo__ .foo_
-. +```````````````````````````````` -. + +```````````````````````````````` example ___foo__ ._foo
-. +```````````````````````````````` -. + +```````````````````````````````` example ____foo_ .___foo
-. +```````````````````````````````` -. + +```````````````````````````````` example __foo___ .foo_
-. +```````````````````````````````` -. + +```````````````````````````````` example _foo____ .foo___
-. +```````````````````````````````` + Rule 13 implies that if you want emphasis nested directly inside emphasis, you must use different delimiters: -. +```````````````````````````````` example **foo** .foo
-. +```````````````````````````````` -. + +```````````````````````````````` example *_foo_* .foo
-. +```````````````````````````````` -. + +```````````````````````````````` example __foo__ .foo
-. +```````````````````````````````` -. + +```````````````````````````````` example _*foo*_ .foo
-. +```````````````````````````````` + However, strong emphasis within strong emphasis is possible without switching delimiters: -. +```````````````````````````````` example ****foo**** .foo
-. +```````````````````````````````` -. + +```````````````````````````````` example ____foo____ .foo
-. +```````````````````````````````` + Rule 13 can be applied to arbitrarily long sequences of delimiters: -. +```````````````````````````````` example ******foo****** .foo
-. +```````````````````````````````` + Rule 14: -. +```````````````````````````````` example ***foo*** .foo
-. +```````````````````````````````` -. + +```````````````````````````````` example _____foo_____ .foo
-. +```````````````````````````````` + Rule 15: -. +```````````````````````````````` example *foo _bar* baz_ .foo _bar baz_
-. +```````````````````````````````` -. + +```````````````````````````````` example **foo*bar** .foobar*
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo __bar *baz bim__ bam* .foo bar *baz bim bam
-. +```````````````````````````````` + Rule 16: -. +```````````````````````````````` example **foo **bar baz** .**foo bar baz
-. +```````````````````````````````` -. + +```````````````````````````````` example *foo *bar baz* .*foo bar baz
-. +```````````````````````````````` + Rule 17: -. +```````````````````````````````` example *[bar*](/url) .*bar*
-. +```````````````````````````````` -. + +```````````````````````````````` example _foo [bar_](/url) ._foo bar_
-. +```````````````````````````````` -. + +```````````````````````````````` example **
a *
a _
[link](/my uri)
-. +```````````````````````````````` -. + +```````````````````````````````` example [link]() . - -. +[link](</my uri>)
+```````````````````````````````` -The destination cannot contain line breaks, even with pointy braces: -. +```````````````````````````````` example [link](foo bar) .[link](foo bar)
-. +```````````````````````````````` -. + +```````````````````````````````` example [link]([link](
[link](foo(and(bar)))
-. +```````````````````````````````` -. + +```````````````````````````````` example [link](foo(and\(bar\))) . -. +```````````````````````````````` -. + +```````````````````````````````` example [link]([link](/url "title "and" title")
-. +```````````````````````````````` + But it is easy to work around this by using a different quote type: -. +```````````````````````````````` example [link](/url 'title "and" title') . -. +```````````````````````````````` + (Note: `Markdown.pl` did allow double quotes inside a double-quoted title, and its test suite included a test demonstrating this. But it is hard to see a good rationale for the extra complexity this brings, since there are already many ways---backslash escaping, -entities, or using a different quote type for the enclosing title---to -write titles containing double quotes. `Markdown.pl`'s handling of -titles has a number of other strange features. For example, it allows -single-quoted titles in inline links, but not reference links. And, in -reference links but not inline links, it allows a title to begin with -`"` and end with `)`. `Markdown.pl` 1.0.1 even allows titles with no closing -quotation mark, though 1.0.2b8 does not. It seems preferable to adopt -a simple, rational rule that works the same way in inline links and -link reference definitions.) +entity and numeric character references, or using a different +quote type for the enclosing title---to write titles containing +double quotes. `Markdown.pl`'s handling of titles has a number +of other strange features. For example, it allows single-quoted +titles in inline links, but not reference links. And, in +reference links but not inline links, it allows a title to begin +with `"` and end with `)`. `Markdown.pl` 1.0.1 even allows +titles with no closing quotation mark, though 1.0.2b8 does not. +It seems preferable to adopt a simple, rational rule that works +the same way in inline links and link reference definitions.) [Whitespace] is allowed around the destination and title: -. +```````````````````````````````` example [link]( /uri "title" ) . -. +```````````````````````````````` + But it is not allowed between the link text and the following parenthesis: -. +```````````````````````````````` example [link] (/uri) .[link] (/uri)
-. +```````````````````````````````` + The link text may contain balanced brackets, but not unbalanced ones, unless they are escaped: -. +```````````````````````````````` example [link [foo [bar]]](/uri) . -. +```````````````````````````````` -. + +```````````````````````````````` example [link] bar](/uri) .[link] bar](/uri)
-. +```````````````````````````````` -. + +```````````````````````````````` example [link [bar](/uri) .[link bar
-. +```````````````````````````````` -. + +```````````````````````````````` example [link \[bar](/uri) . -. +```````````````````````````````` + The link text may contain inline content: -. +```````````````````````````````` example [link *foo **bar** `#`*](/uri) . -. +```````````````````````````````` -. + +```````````````````````````````` example [](/uri) . -. +```````````````````````````````` + However, links may not contain other links, at any level of nesting. -. +```````````````````````````````` example [foo [bar](/uri)](/uri) .[foo bar](/uri)
-. +```````````````````````````````` -. + +```````````````````````````````` example [foo *[bar [baz](/uri)](/uri)*](/uri) .[foo [bar baz](/uri)](/uri)
-. +```````````````````````````````` -. + +```````````````````````````````` example ](uri2)](uri3) .*foo*
-. +```````````````````````````````` -. + +```````````````````````````````` example [foo *bar](baz*) . -. +```````````````````````````````` + Note that brackets that *aren't* part of links do not take precedence: -. +```````````````````````````````` example *foo [bar* baz] .foo [bar baz]
-. +```````````````````````````````` + These cases illustrate the precedence of HTML tags, code spans, and autolinks over link grouping: -. +```````````````````````````````` example [foo[foo
[foo](/uri)
[foohttp://example.com/?search=](uri)
-. +```````````````````````````````` + -There are three kinds of [reference link](@reference-link)s: +There are three kinds of [reference link](@)s: [full](#full-reference-link), [collapsed](#collapsed-reference-link), and [shortcut](#shortcut-reference-link). -A [full reference link](@full-reference-link) -consists of a [link text], optional [whitespace], and a [link label] +A [full reference link](@) +consists of a [link text] immediately followed by a [link label] that [matches] a [link reference definition] elsewhere in the document. -A [link label](@link-label) begins with a left bracket (`[`) and ends +A [link label](@) begins with a left bracket (`[`) and ends with the first right bracket (`]`) that is not backslash-escaped. Between these brackets there must be at least one [non-whitespace character]. Unescaped square bracket characters are not allowed in -[link label]s. A link label can have at most 999 +[link labels]. A link label can have at most 999 characters inside the square brackets. -One label [matches](@matches) +One label [matches](@) another just in case their normalized forms are equal. To normalize a -label, perform the *unicode case fold* and collapse consecutive internal +label, perform the *Unicode case fold* and collapse consecutive internal [whitespace] to a single space. If there are multiple matching reference link definitions, the one that comes first in the document is used. (It is desirable in such cases to emit a warning.) @@ -6732,176 +7447,222 @@ matching [link reference definition]. Here is a simple example: -. +```````````````````````````````` example [foo][bar] [bar]: /url "title" . -. +```````````````````````````````` + The rules for the [link text] are the same as with -[inline link]s. Thus: +[inline links]. Thus: The link text may contain balanced brackets, but not unbalanced ones, unless they are escaped: -. +```````````````````````````````` example [link [foo [bar]]][ref] [ref]: /uri . -. +```````````````````````````````` -. + +```````````````````````````````` example [link \[bar][ref] [ref]: /uri . -. +```````````````````````````````` + The link text may contain inline content: -. +```````````````````````````````` example [link *foo **bar** `#`*][ref] [ref]: /uri . -. +```````````````````````````````` -. + +```````````````````````````````` example [][ref] [ref]: /uri . -. +```````````````````````````````` + However, links may not contain other links, at any level of nesting. -. +```````````````````````````````` example [foo [bar](/uri)][ref] [ref]: /uri . -. +```````````````````````````````` -. + +```````````````````````````````` example [foo *bar [baz][ref]*][ref] [ref]: /uri . -. +```````````````````````````````` -(In the examples above, we have two [shortcut reference link]s + +(In the examples above, we have two [shortcut reference links] instead of one [full reference link].) The following cases illustrate the precedence of link text grouping over emphasis grouping: -. +```````````````````````````````` example *[foo*][ref] [ref]: /uri .*foo*
-. +```````````````````````````````` -. + +```````````````````````````````` example [foo *bar][ref] [ref]: /uri . -. +```````````````````````````````` + These cases illustrate the precedence of HTML tags, code spans, and autolinks over link grouping: -. +```````````````````````````````` example [foo[foo
[foo][ref]
[foohttp://example.com/?search=][ref]
-. +```````````````````````````````` + Matching is case-insensitive: -. +```````````````````````````````` example [foo][BaR] [bar]: /url "title" . -. +```````````````````````````````` + Unicode case fold is used: -. +```````````````````````````````` example [Толпой][Толпой] is a Russian word. [ТОЛПОЙ]: /url .Толпой is a Russian word.
-. +```````````````````````````````` + Consecutive internal [whitespace] is treated as one space for purposes of determining matching: -. +```````````````````````````````` example [Foo bar]: /url [Baz][Foo bar] . -. +```````````````````````````````` -There can be [whitespace] between the [link text] and the [link label]: -. +No [whitespace] is allowed between the [link text] and the +[link label]: + +```````````````````````````````` example [foo] [bar] [bar]: /url "title" . - -. +[foo] bar
+```````````````````````````````` -. + +```````````````````````````````` example [foo] [bar] [bar]: /url "title" . - -. +[foo] +bar
+```````````````````````````````` + + +This is a departure from John Gruber's original Markdown syntax +description, which explicitly allows whitespace between the link +text and the link label. It brings reference links in line with +[inline links], which (according to both original Markdown and +this spec) cannot have whitespace after the link text. More +importantly, it prevents inadvertent capture of consecutive +[shortcut reference links]. If whitespace is allowed between the +link text and the link label, then in the following we will have +a single reference link, not two shortcut reference links, as +intended: + +``` markdown +[foo] +[bar] + +[foo]: /url1 +[bar]: /url2 +``` + +(Note that [shortcut reference links] were introduced by Gruber +himself in a beta version of `Markdown.pl`, but never included +in the official syntax description. Without shortcut reference +links, it is harmless to allow space between the link text and +link label; but once shortcut references are introduced, it is +too dangerous to allow this, as it frequently leads to +unintended results.) -When there are multiple matching [link reference definition]s, +When there are multiple matching [link reference definitions], the first is used: -. +```````````````````````````````` example [foo]: /url1 [foo]: /url2 @@ -6909,70 +7670,88 @@ the first is used: [bar][foo] . -. +```````````````````````````````` + Note that matching is performed on normalized strings, not parsed inline content. So the following does not match, even though the labels define equivalent inline content: -. +```````````````````````````````` example [bar][foo\!] [foo!]: /url .[bar][foo!]
-. +```````````````````````````````` + -[Link label]s cannot contain brackets, unless they are +[Link labels] cannot contain brackets, unless they are backslash-escaped: -. +```````````````````````````````` example [foo][ref[] [ref[]: /uri .[foo][ref[]
[ref[]: /uri
-. +```````````````````````````````` -. + +```````````````````````````````` example [foo][ref[bar]] [ref[bar]]: /uri .[foo][ref[bar]]
[ref[bar]]: /uri
-. +```````````````````````````````` -. + +```````````````````````````````` example [[[foo]]] [[[foo]]]: /url .[[[foo]]]
[[[foo]]]: /url
-. +```````````````````````````````` -. + +```````````````````````````````` example [foo][ref\[] [ref\[]: /uri . +```````````````````````````````` + + +Note that in this example `]` is not backslash-escaped: + +```````````````````````````````` example +[bar\\]: /uri + +[bar\\] . + +```````````````````````````````` + A [link label] must contain at least one [non-whitespace character]: -. +```````````````````````````````` example [] []: /uri .[]
[]: /uri
-. +```````````````````````````````` -. + +```````````````````````````````` example [ ] @@ -6983,57 +7762,63 @@ A [link label] must contain at least one [non-whitespace character]: ][ ]: /uri
-. +```````````````````````````````` + -A [collapsed reference link](@collapsed-reference-link) +A [collapsed reference link](@) consists of a [link label] that [matches] a [link reference definition] elsewhere in the -document, optional [whitespace], and the string `[]`. +document, followed by the string `[]`. The contents of the first link label are parsed as inlines, which are used as the link's text. The link's URI and title are provided by the matching reference link definition. Thus, `[foo][]` is equivalent to `[foo][foo]`. -. +```````````````````````````````` example [foo][] [foo]: /url "title" . -. +```````````````````````````````` -. + +```````````````````````````````` example [*foo* bar][] [*foo* bar]: /url "title" . -. +```````````````````````````````` + The link labels are case-insensitive: -. +```````````````````````````````` example [Foo][] [foo]: /url "title" . -. +```````````````````````````````` -As with full reference links, [whitespace] is allowed -between the two sets of brackets: -. +As with full reference links, [whitespace] is not +allowed between the two sets of brackets: + +```````````````````````````````` example [foo] [] [foo]: /url "title" . - -. +foo +[]
+```````````````````````````````` -A [shortcut reference link](@shortcut-reference-link) + +A [shortcut reference link](@) consists of a [link label] that [matches] a [link reference definition] elsewhere in the document and is not followed by `[]` or a link label. @@ -7042,132 +7827,144 @@ which are used as the link's text. the link's URI and title are provided by the matching link reference definition. Thus, `[foo]` is equivalent to `[foo][]`. -. +```````````````````````````````` example [foo] [foo]: /url "title" . -. +```````````````````````````````` -. + +```````````````````````````````` example [*foo* bar] [*foo* bar]: /url "title" . -. +```````````````````````````````` -. + +```````````````````````````````` example [[*foo* bar]] [*foo* bar]: /url "title" .[foo bar]
-. +```````````````````````````````` -. + +```````````````````````````````` example [[bar [foo] [foo]: /url .[[bar foo
-. +```````````````````````````````` + The link labels are case-insensitive: -. +```````````````````````````````` example [Foo] [foo]: /url "title" . -. +```````````````````````````````` + A space after the link text should be preserved: -. +```````````````````````````````` example [foo] bar [foo]: /url .foo bar
-. +```````````````````````````````` + If you just want bracketed text, you can backslash-escape the opening bracket to avoid links: -. +```````````````````````````````` example \[foo] [foo]: /url "title" .[foo]
-. +```````````````````````````````` + Note that this is a link, because a link label ends with the first following closing bracket: -. +```````````````````````````````` example [foo*]: /url *[foo*] .*foo*
-. +```````````````````````````````` + Full references take precedence over shortcut references: -. +```````````````````````````````` example [foo][bar] [foo]: /url1 [bar]: /url2 . -. +```````````````````````````````` + In the following case `[bar][baz]` is parsed as a reference, `[foo]` as normal text: -. +```````````````````````````````` example [foo][bar][baz] [baz]: /url .[foo]bar
-. +```````````````````````````````` + Here, though, `[foo][bar]` is parsed as a reference, since `[bar]` is defined: -. +```````````````````````````````` example [foo][bar][baz] [baz]: /url1 [bar]: /url2 . -. +```````````````````````````````` + Here `[foo]` is not parsed as a shortcut reference, because it is followed by a link label (even though `[bar]` is not defined): -. +```````````````````````````````` example [foo][bar][baz] [baz]: /url1 [foo]: /url2 .[foo]bar
-. +```````````````````````````````` + ## Images Syntax for images is like the syntax for links, with one difference. Instead of [link text], we have an -[image description](@image-description). The rules for this are the +[image description](@). The rules for this are the same as for [link text], except that (a) an image description starts with ` .My
+[]
![[foo]]
[[foo]]: /url "title"
-. +```````````````````````````````` + The link labels are case-insensitive: -. +```````````````````````````````` example ![Foo] [foo]: /url "title" .![foo]
-. +```````````````````````````````` + If you want a link after a literal `!`, backslash-escape the `!`: -. +```````````````````````````````` example \![foo] [foo]: /url "title" .!foo
-. +```````````````````````````````` + ## Autolinks -[Autolink](@autolink)s are absolute URIs and email addresses inside +[Autolink](@)s are absolute URIs and email addresses inside `<` and `>`. They are parsed as links, with the URL or email address as the link label. -A [URI autolink](@uri-autolink) consists of `<`, followed by an +A [URI autolink](@) consists of `<`, followed by an [absolute URI] not containing `<`, followed by `>`. It is parsed as a link to the URI, with the URI as the link's label. -An [absolute URI](@absolute-uri), +An [absolute URI](@), for these purposes, consists of a [scheme] followed by a colon (`:`) followed by zero or more characters other than ASCII [whitespace] and control characters, `<`, and `>`. If -the URI includes these characters, you must use percent-encoding +the URI includes these characters, they must be percent-encoded (e.g. `%20` for a space). -The following [schemes](@scheme) -are recognized (case-insensitive): -`coap`, `doi`, `javascript`, `aaa`, `aaas`, `about`, `acap`, `cap`, -`cid`, `crid`, `data`, `dav`, `dict`, `dns`, `file`, `ftp`, `geo`, `go`, -`gopher`, `h323`, `http`, `https`, `iax`, `icap`, `im`, `imap`, `info`, -`ipp`, `iris`, `iris.beep`, `iris.xpc`, `iris.xpcs`, `iris.lwz`, `ldap`, -`mailto`, `mid`, `msrp`, `msrps`, `mtqp`, `mupdate`, `news`, `nfs`, -`ni`, `nih`, `nntp`, `opaquelocktoken`, `pop`, `pres`, `rtsp`, -`service`, `session`, `shttp`, `sieve`, `sip`, `sips`, `sms`, `snmp`,` -soap.beep`, `soap.beeps`, `tag`, `tel`, `telnet`, `tftp`, `thismessage`, -`tn3270`, `tip`, `tv`, `urn`, `vemmi`, `ws`, `wss`, `xcon`, -`xcon-userid`, `xmlrpc.beep`, `xmlrpc.beeps`, `xmpp`, `z39.50r`, -`z39.50s`, `adiumxtra`, `afp`, `afs`, `aim`, `apt`,` attachment`, `aw`, -`beshare`, `bitcoin`, `bolo`, `callto`, `chrome`,` chrome-extension`, -`com-eventbrite-attendee`, `content`, `cvs`,` dlna-playsingle`, -`dlna-playcontainer`, `dtn`, `dvb`, `ed2k`, `facetime`, `feed`, -`finger`, `fish`, `gg`, `git`, `gizmoproject`, `gtalk`, `hcp`, `icon`, -`ipn`, `irc`, `irc6`, `ircs`, `itms`, `jar`, `jms`, `keyparc`, `lastfm`, -`ldaps`, `magnet`, `maps`, `market`,` message`, `mms`, `ms-help`, -`msnim`, `mumble`, `mvn`, `notes`, `oid`, `palm`, `paparazzi`, -`platform`, `proxy`, `psyc`, `query`, `res`, `resource`, `rmi`, `rsync`, -`rtmp`, `secondlife`, `sftp`, `sgn`, `skype`, `smb`, `soldat`, -`spotify`, `ssh`, `steam`, `svn`, `teamspeak`, `things`, `udp`, -`unreal`, `ut2004`, `ventrilo`, `view-source`, `webcal`, `wtai`, -`wyciwyg`, `xfire`, `xri`, `ymsgr`. +For purposes of this spec, a [scheme](@) is any sequence +of 2--32 characters beginning with an ASCII letter and followed +by any combination of ASCII letters, digits, or the symbols plus +("+"), period ("."), or hyphen ("-"). Here are some valid autolinks: -. +```````````````````````````````` examplehttp://foo.bar.baz/test?q=hello&id=22&boolean
-. +```````````````````````````````` -. + +```````````````````````````````` example<http://foo.bar/baz bim>
-. +```````````````````````````````` + Backslash-escapes do not work inside autolinks: -. +```````````````````````````````` example<foo+@bar.example.com>
-. +```````````````````````````````` + These are not autolinks: -. +```````````````````````````````` example <> .<>
-. +```````````````````````````````` -. -<heck://bing.bong>
-. -. +```````````````````````````````` example < http://foo.bar > .< http://foo.bar >
-. +```````````````````````````````` + +```````````````````````````````` example +<m:abc>
+```````````````````````````````` + + +```````````````````````````````` example<foo.bar.baz>
-. +```````````````````````````````` -. -<localhost:5001/foo>
-. -. +```````````````````````````````` example http://example.com .http://example.com
-. +```````````````````````````````` -. + +```````````````````````````````` example foo@bar.example.com .foo@bar.example.com
-. +```````````````````````````````` + ## Raw HTML @@ -7542,388 +8383,416 @@ so custom tags (and even, say, DocBook tags) may be used. Here is the grammar for tags: -A [tag name](@tag-name) consists of an ASCII letter +A [tag name](@) consists of an ASCII letter followed by zero or more ASCII letters, digits, or hyphens (`-`). -An [attribute](@attribute) consists of [whitespace], +An [attribute](@) consists of [whitespace], an [attribute name], and an optional [attribute value specification]. -An [attribute name](@attribute-name) +An [attribute name](@) consists of an ASCII letter, `_`, or `:`, followed by zero or more ASCII letters, digits, `_`, `.`, `:`, or `-`. (Note: This is the XML specification restricted to ASCII. HTML5 is laxer.) -An [attribute value specification](@attribute-value-specification) +An [attribute value specification](@) consists of optional [whitespace], a `=` character, optional [whitespace], and an [attribute value]. -An [attribute value](@attribute-value) +An [attribute value](@) consists of an [unquoted attribute value], a [single-quoted attribute value], or a [double-quoted attribute value]. -An [unquoted attribute value](@unquoted-attribute-value) +An [unquoted attribute value](@) is a nonempty string of characters not including spaces, `"`, `'`, `=`, `<`, `>`, or `` ` ``. -A [single-quoted attribute value](@single-quoted-attribute-value) +A [single-quoted attribute value](@) consists of `'`, zero or more characters not including `'`, and a final `'`. -A [double-quoted attribute value](@double-quoted-attribute-value) +A [double-quoted attribute value](@) consists of `"`, zero or more characters not including `"`, and a final `"`. -An [open tag](@open-tag) consists of a `<` character, a [tag name], -zero or more [attributes](@attribute], optional [whitespace], an optional `/` +An [open tag](@) consists of a `<` character, a [tag name], +zero or more [attributes], optional [whitespace], an optional `/` character, and a `>` character. -A [closing tag](@closing-tag) consists of the string ``, a +A [closing tag](@) consists of the string ``, a [tag name], optional [whitespace], and the character `>`. -An [HTML comment](@html-comment) consists of ``, +An [HTML comment](@) consists of ``, where *text* does not start with `>` or `->`, does not end with `-`, and does not contain `--`. (See the [HTML5 spec](http://www.w3.org/TR/html5/syntax.html#comments).) -A [processing instruction](@processing-instruction) +A [processing instruction](@) consists of the string ``, a string of characters not including the string `?>`, and the string `?>`. -A [declaration](@declaration) consists of the +A [declaration](@) consists of the string ``, and the character `>`. -A [CDATA section](@cdata-section) consists of +A [CDATA section](@) consists of the string ``, and the string `]]>`. -An [HTML tag](@html-tag) consists of an [open tag], a [closing tag], +An [HTML tag](@) consists of an [open tag], a [closing tag], an [HTML comment], a [processing instruction], a [declaration], or a [CDATA section]. Here are some simple open tags: -. +```````````````````````````````` exampleFoo
<33> <__>
-. +```````````````````````````````` + Illegal attribute names: -. +```````````````````````````````` example .<a h*#ref="hi">
-. +```````````````````````````````` + Illegal attribute values: -. +```````````````````````````````` example .</a href="foo">
-. +```````````````````````````````` + Comments: -. +```````````````````````````````` example foo .foo
-. +```````````````````````````````` -. + +```````````````````````````````` example foo .foo <!-- not a comment -- two hyphens -->
-. +```````````````````````````````` + Not comments: -. +```````````````````````````````` example foo foo --> foo .foo <!--> foo -->
foo <!-- foo--->
-. +```````````````````````````````` + Processing instructions: -. +```````````````````````````````` example foo .foo
-. +```````````````````````````````` + Declarations: -. +```````````````````````````````` example foo .foo
-. +```````````````````````````````` + CDATA sections: -. +```````````````````````````````` example foo &<]]> .foo &<]]>
-. +```````````````````````````````` -Entities are preserved in HTML attributes: +Entity and numeric character references are preserved in HTML +attributes: + +```````````````````````````````` example +foo . - -. - -. + +```````````````````````````````` + Backslash escapes do not work in HTML attributes: +```````````````````````````````` example +foo . - -. - -. + +```````````````````````````````` -. + +```````````````````````````````` example .<a href=""">
-. +```````````````````````````````` + ## Hard line breaks A line break (not in a code span or HTML tag) that is preceded by two or more spaces and does not occur at the end of a block -is parsed as a [hard line break](@hard-line-break) (rendered +is parsed as a [hard line break](@) (rendered in HTML as a `foo
baz
foo
baz
foo
baz
foo
bar
foo
bar
foo
bar
foo
bar
code span
code\ span
foo\
-. +```````````````````````````````` -. + +```````````````````````````````` example foo .foo
-. +```````````````````````````````` -. + +```````````````````````````````` example ### foo\ .foo baz
-. +```````````````````````````````` + Spaces at the end of the line and beginning of the next line are removed: -. +```````````````````````````````` example foo baz .foo baz
-. +```````````````````````````````` + A conforming parser may render a soft line break in HTML either as a line break or as a space. @@ -7963,34 +8834,37 @@ as hard line breaks. Any characters not given an interpretation by the above rules will be parsed as plain textual content. -. +```````````````````````````````` example hello $.;'there .hello $.;'there
-. +```````````````````````````````` -. + +```````````````````````````````` example Foo χρῆν .Foo χρῆν
-. +```````````````````````````````` + Internal spaces are preserved verbatim: -. +```````````````````````````````` example Multiple spaces .Multiple spaces
-. +```````````````````````````````` + -# Appendix: A parsing strategy {-} +# Appendix: A parsing strategy In this appendix we describe some features of the parsing strategy used in the CommonMark reference implementations. -## Overview {-} +## Overview Parsing has two phases: @@ -8000,7 +8874,7 @@ list items, and so on---is constructed. Text is assigned to these blocks but not parsed. Link reference definitions are parsed and a map of links is constructed. -2. In the second phase, the raw text contents of paragraphs and headers +2. In the second phase, the raw text contents of paragraphs and headings are parsed into sequences of Markdown inline elements (strings, code spans, links, emphasis, and so on), using the map of link references constructed in phase 1. @@ -8028,7 +8902,7 @@ marked by arrows: "aliquando id" ``` -## Phase 1: block structure {-} +## Phase 1: block structure Each line that is processed has an effect on this tree. The line is analyzed and, depending on its contents, the document may be altered @@ -8063,10 +8937,10 @@ matched block. 3. Finally, we look at the remainder of the line (after block markers like `>`, list markers, and indentation have been consumed). This is text that can be incorporated into the last open -block (a paragraph, code block, header, or raw HTML). +block (a paragraph, code block, heading, or raw HTML). -Setext headers are formed when we detect that the second line of -a paragraph is a setext header line. +Setext headings are formed when we see a line of a paragraph +that is a setext heading line. Reference link definitions are detected when a paragraph is closed; the accumulated text lines are parsed to see if they begin with @@ -8170,12 +9044,12 @@ We thus obtain the final tree: "aliquando id" ``` -## Phase 2: inline structure {-} +## Phase 2: inline structure Once all of the input has been parsed, all open blocks are closed. We then "walk the tree," visiting every node, and parse raw -string contents of paragraphs and headers as inlines. At this +string contents of paragraphs and headings as inlines. At this point we have seen all the link reference definitions, so we can resolve reference links as we go. @@ -8201,7 +9075,7 @@ Notice how the [line ending] in the first paragraph has been parsed as a `softbreak`, and the asterisks in the first list item have become an `emph`. -### An algorithm for parsing nested emphasis and links {-} +### An algorithm for parsing nested emphasis and links By far the trickiest part of inline parsing is handling emphasis, strong emphasis, links, and images. This is done using the following @@ -8213,7 +9087,7 @@ When we're parsing inlines and we hit either - a `[` or `. +add a pointer to this text node to the [delimiter stack](@). The [delimiter stack] is a doubly linked list. Each element contains a pointer to a text node, plus information about @@ -8231,7 +9105,7 @@ procedure (see below). When we hit the end of the input, we call the *process emphasis* procedure (see below), with `stack_bottom` = NULL. -#### *look for link or image* {-} +#### *look for link or image* Starting at the top of the delimiter stack, we look backwards through the stack for an opening `[` or `![` delimiter. @@ -8262,7 +9136,7 @@ through the stack for an opening `[` or `![` delimiter. `[` delimiters before the opening delimiter to *inactive*. (This will prevent us from getting links within links.) -#### *process emphasis* {-} +#### *process emphasis* Parameter `stack_bottom` sets a lower bound to how far we descend in the [delimiter stack]. If it is NULL, we can