Examples with IToken org.eclipse.jface.text.rules.IToken used on opensource projects

Example 76 with IToken

use of org.eclipse.jface.text.rules.IToken in project erlide_eclipse by erlang.

the class ErlangCharRuleTest method simpleChar.

@Test
public void simpleChar() {
    final ErlangCharRule rule = new ErlangCharRule(token);
    scanner = new StringCharacterScanner("$z ");
    final IToken tk = rule.evaluate(scanner);
    assertEquals(token, tk);
    assertEquals(" ", scanner.getCurrentContent());
    assertEquals("$z", scanner.getScannedContent());
}

Example 77 with IToken

use of org.eclipse.jface.text.rules.IToken in project erlide_eclipse by erlang.

the class ErlangCharRule method evaluate.

@Override
public IToken evaluate(final ICharacterScanner scanner) {
    int c = scanner.read();
    if (c == '$') {
        final EscapeRule escape = new EscapeRule(token);
        final IToken tk = escape.evaluate(scanner);
        if (tk == Token.UNDEFINED) {
            c = scanner.read();
        }
        return token;
    }
    scanner.unread();
    return Token.UNDEFINED;
}