Search in sources :

Example 6 with Schema

use of org.apache.carbondata.sdk.file.Schema in project carbondata by apache.

the class BinaryUtil method binaryToCarbon.

public static void binaryToCarbon(String sourceImageFolder, String outputPath, String sufAnnotation, final String sufImage) throws Exception {
    Field[] fields = new Field[5];
    fields[0] = new Field("binaryId", DataTypes.INT);
    fields[1] = new Field("binaryName", DataTypes.STRING);
    fields[2] = new Field("binary", DataTypes.BINARY);
    fields[3] = new Field("labelName", DataTypes.STRING);
    fields[4] = new Field("labelContent", DataTypes.STRING);
    CarbonWriter writer = CarbonWriter.builder().outputPath(outputPath).withCsvInput(new Schema(fields)).withBlockSize(256).writtenBy("binaryExample").withPageSizeInMb(1).build();
    binaryToCarbon(sourceImageFolder, writer, sufAnnotation, sufImage);
}
Also used : Field(org.apache.carbondata.core.metadata.datatype.Field) Schema(org.apache.carbondata.sdk.file.Schema) CarbonWriter(org.apache.carbondata.sdk.file.CarbonWriter)

Aggregations

Field (org.apache.carbondata.core.metadata.datatype.Field)6 Schema (org.apache.carbondata.sdk.file.Schema)6 CarbonWriter (org.apache.carbondata.sdk.file.CarbonWriter)4 File (java.io.File)2 CarbonReader (org.apache.carbondata.sdk.file.CarbonReader)2 Configuration (org.apache.hadoop.conf.Configuration)2 Logger (org.apache.log4j.Logger)2 FilenameFilter (java.io.FilenameFilter)1 IOException (java.io.IOException)1 CarbonRow (org.apache.carbondata.core.datastore.row.CarbonRow)1 ColumnExpression (org.apache.carbondata.core.scan.expression.ColumnExpression)1 LiteralExpression (org.apache.carbondata.core.scan.expression.LiteralExpression)1 EqualToExpression (org.apache.carbondata.core.scan.expression.conditional.EqualToExpression)1 Test (org.junit.Test)1