Examples with PreserverHtmlEntityToken org.eclipse.mylyn.wikitext.asciidoc.internal.token.PreserverHtmlEntityToken used on opensource projects

Example 1 with PreserverHtmlEntityToken

use of org.eclipse.mylyn.wikitext.asciidoc.internal.token.PreserverHtmlEntityToken in project mylyn.docs by eclipse.

the class AsciiDocLanguage method addStandardTokens.

@Override
protected void addStandardTokens(PatternBasedSyntax tokenSyntax) {
    // HTML entities are preserved
    tokenSyntax.add(new PreserverHtmlEntityToken());
    // line ending with a + will cause a line Break
    // $NON-NLS-1$
    tokenSyntax.add(new PatternLineBreakReplacementToken("(\\s\\+)\\s*$"));
}