Examples with CodePointCharStream org.antlr.v4.runtime.CodePointCharStream used on opensource projects

Example 31 with CodePointCharStream

use of org.antlr.v4.runtime.CodePointCharStream in project antlr4 by antlr.

the class TestCodePointCharStream method singleEmojiCodePointLookAheadPastEndShouldReturnEOF.

@Test
public void singleEmojiCodePointLookAheadPastEndShouldReturnEOF() {
    CodePointCharStream s = CharStreams.fromString(new StringBuilder().appendCodePoint(0x1F4A9).toString());
    assertEquals(IntStream.EOF, s.LA(2));
    assertEquals(0, s.index());
}

Example 32 with CodePointCharStream

use of org.antlr.v4.runtime.CodePointCharStream in project antlr4 by antlr.

the class TestCodePointCharStream method singleLatinCodePointLookAheadPastEndShouldReturnEOF.

@Test
public void singleLatinCodePointLookAheadPastEndShouldReturnEOF() {
    CodePointCharStream s = CharStreams.fromString("X");
    assertEquals(IntStream.EOF, s.LA(2));
}

Example 33 with CodePointCharStream

use of org.antlr.v4.runtime.CodePointCharStream in project antlr4 by antlr.

the class TestCodePointCharStream method singleEmojiCodePointLookAheadShouldReturnCodePoint.

@Test
public void singleEmojiCodePointLookAheadShouldReturnCodePoint() {
    CodePointCharStream s = CharStreams.fromString(new StringBuilder().appendCodePoint(0x1F4A9).toString());
    assertEquals(0x1F4A9, s.LA(1));
    assertEquals(0, s.index());
}

Example 34 with CodePointCharStream

use of org.antlr.v4.runtime.CodePointCharStream in project antlr4 by antlr.

the class TestCodePointCharStream method toStringWithLatin.

@Test
public void toStringWithLatin() {
    CodePointCharStream s = CharStreams.fromString("0123456789");
    assertEquals("0123456789", s.toString());
}

Example 35 with CodePointCharStream

use of org.antlr.v4.runtime.CodePointCharStream in project antlr4 by antlr.

the class TestCodePointCharStream method getTextWithCJK.

@Test
public void getTextWithCJK() {
    CodePointCharStream s = CharStreams.fromString("01234䂔6789");
    assertEquals("34䂔67", s.getText(Interval.of(3, 7)));
}