Search in sources :

Example 6 with ModifiableHadoopConfiguration

use of org.janusgraph.hadoop.config.ModifiableHadoopConfiguration in project janusgraph by JanusGraph.

the class HadoopVertexScanMapper method setup.

@Override
protected void setup(Context context) throws IOException, InterruptedException {
    /* Don't call super implementation super.setup(context); */
    org.apache.hadoop.conf.Configuration hadoopConf = DEFAULT_COMPAT.getContextConfiguration(context);
    ModifiableHadoopConfiguration scanConf = ModifiableHadoopConfiguration.of(JanusGraphHadoopConfiguration.MAPRED_NS, hadoopConf);
    VertexScanJob vertexScan = getVertexScanJob(scanConf);
    ModifiableConfiguration graphConf = getJanusGraphConfiguration(context);
    JanusGraph graph = JanusGraphFactory.open(graphConf);
    job = VertexJobConverter.convert(graph, vertexScan);
    metrics = new HadoopContextScanMetrics(context);
    finishSetup(scanConf, graphConf);
}
Also used : JanusGraph(org.janusgraph.core.JanusGraph) VertexScanJob(org.janusgraph.graphdb.olap.VertexScanJob) ModifiableConfiguration(org.janusgraph.diskstorage.configuration.ModifiableConfiguration) ModifiableHadoopConfiguration(org.janusgraph.hadoop.config.ModifiableHadoopConfiguration)

Aggregations

ModifiableHadoopConfiguration (org.janusgraph.hadoop.config.ModifiableHadoopConfiguration)6 ModifiableConfiguration (org.janusgraph.diskstorage.configuration.ModifiableConfiguration)2 JanusGraphHadoopConfiguration (org.janusgraph.hadoop.config.JanusGraphHadoopConfiguration)2 Map (java.util.Map)1 ExecutionException (java.util.concurrent.ExecutionException)1 TimeoutException (java.util.concurrent.TimeoutException)1 IPartitioner (org.apache.cassandra.dht.IPartitioner)1 JanusGraph (org.janusgraph.core.JanusGraph)1 RelationType (org.janusgraph.core.RelationType)1 JanusGraphIndex (org.janusgraph.core.schema.JanusGraphIndex)1 RelationTypeIndex (org.janusgraph.core.schema.RelationTypeIndex)1 SchemaAction (org.janusgraph.core.schema.SchemaAction)1 BackendException (org.janusgraph.diskstorage.BackendException)1 AbstractCassandraStoreManager (org.janusgraph.diskstorage.cassandra.AbstractCassandraStoreManager)1 Configuration (org.janusgraph.diskstorage.configuration.Configuration)1 GraphDatabaseConfiguration (org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration)1 VertexScanJob (org.janusgraph.graphdb.olap.VertexScanJob)1 IndexRemoveJob (org.janusgraph.graphdb.olap.job.IndexRemoveJob)1 HBaseBinaryInputFormat (org.janusgraph.hadoop.formats.hbase.HBaseBinaryInputFormat)1 HadoopScanMapper (org.janusgraph.hadoop.scan.HadoopScanMapper)1