Examples with UTF8CodePointDecoder org.antlr.v4.runtime.UTF8CodePointDecoder used on opensource projects

Example 11 with UTF8CodePointDecoder

use of org.antlr.v4.runtime.UTF8CodePointDecoder in project antlr4 by antlr.

the class TestUTF8CodePointDecoder method decodingNonShortestFormInReplaceModeWritesSubstitutionCharacter.

@Test
public void decodingNonShortestFormInReplaceModeWritesSubstitutionCharacter() throws Exception {
    UTF8CodePointDecoder decoder = new UTF8CodePointDecoder(CodingErrorAction.REPLACE);
    // 0xC1 0x9C would decode to \ (U+005C) if we didn't have this check
    ByteBuffer utf8BytesIn = ByteBuffer.wrap(new byte[] { (byte) 0xC1, (byte) 0x9C });
    IntBuffer codePointsOut = IntBuffer.allocate(1);
    IntBuffer result = decoder.decodeCodePointsFromBuffer(utf8BytesIn, codePointsOut, true);
    result.flip();
    assertEquals(1, result.remaining());
    assertEquals(0xFFFD, result.get(0));
}