Examples with HCatWriter org.apache.hive.hcatalog.data.transfer.HCatWriter used on opensource projects

Example 1 with HCatWriter

use of org.apache.hive.hcatalog.data.transfer.HCatWriter in project hive by apache.

the class DataWriterMaster method runsInMaster.

private static WriterContext runsInMaster(Map<String, String> config) throws HCatException {
    WriteEntity.Builder builder = new WriteEntity.Builder();
    WriteEntity entity = builder.withTable(config.get("table")).build();
    HCatWriter writer = DataTransferFactory.getHCatWriter(entity, config);
    WriterContext info = writer.prepareWrite();
    return info;
}

Example 2 with HCatWriter

use of org.apache.hive.hcatalog.data.transfer.HCatWriter in project hive by apache.

the class TestReaderWriter method runsInSlave.

private void runsInSlave(WriterContext context) throws HCatException {
    HCatWriter writer = DataTransferFactory.getHCatWriter(context);
    writer.write(new HCatRecordItr());
}

Example 3 with HCatWriter

use of org.apache.hive.hcatalog.data.transfer.HCatWriter in project hive by apache.

the class TestReaderWriter method runsInMaster.

private WriterContext runsInMaster(Map<String, String> config) throws Exception {
    WriteEntity.Builder builder = new WriteEntity.Builder();
    WriteEntity entity = builder.withTable("mytbl").build();
    HCatWriter writer = DataTransferFactory.getHCatWriter(entity, config);
    WriterContext info = writer.prepareWrite();
    return info;
}

Example 4 with HCatWriter

use of org.apache.hive.hcatalog.data.transfer.HCatWriter in project hive by apache.

the class DataWriterMaster method commit.

private static void commit(Map<String, String> config, boolean status, WriterContext cntxt) throws HCatException {
    WriteEntity.Builder builder = new WriteEntity.Builder();
    WriteEntity entity = builder.withTable(config.get("table")).build();
    HCatWriter writer = DataTransferFactory.getHCatWriter(entity, config);
    if (status) {
        writer.commit(cntxt);
    } else {
        writer.abort(cntxt);
    }
}

Example 5 with HCatWriter

use of org.apache.hive.hcatalog.data.transfer.HCatWriter in project hive by apache.

the class DataWriterSlave method main.

public static void main(String[] args) throws FileNotFoundException, IOException, ClassNotFoundException {
    ObjectInputStream ois = new ObjectInputStream(new FileInputStream(args[0]));
    WriterContext cntxt = (WriterContext) ois.readObject();
    ois.close();
    HCatWriter writer = DataTransferFactory.getHCatWriter(cntxt);
    writer.write(new HCatRecordItr(args[1]));
}