Examples with FrontendException org.apache.pig.impl.logicalLayer.FrontendException used on opensource projects

Example 36 with FrontendException

use of org.apache.pig.impl.logicalLayer.FrontendException in project shifu by ShifuML.

the class GuaguaParquetMapReduceClient method getPigSchemaFromMultipleFiles.

/**
 * @param fileSchema
 *            the parquet schema from the file
 * @param keyValueMetaData
 *            the extra meta data from the files
 * @return the pig schema according to the file
 */
static Schema getPigSchemaFromMultipleFiles(MessageType fileSchema, Map<String, Set<String>> keyValueMetaData) {
    Set<String> pigSchemas = PigMetaData.getPigSchemas(keyValueMetaData);
    if (pigSchemas == null) {
        return pigSchemaConverter.convert(fileSchema);
    }
    Schema mergedPigSchema = null;
    for (String pigSchemaString : pigSchemas) {
        try {
            mergedPigSchema = union(mergedPigSchema, parsePigSchema(pigSchemaString));
        } catch (FrontendException e) {
            throw new ParquetDecodingException("can not merge " + pigSchemaString + " into " + mergedPigSchema, e);
        }
    }
    return mergedPigSchema;
}