Search in sources :

Example 1 with DataNodeMetrics

use of org.apache.hadoop.hdfs.server.datanode.metrics.DataNodeMetrics in project hadoop by apache.

the class TestDataXceiverLazyPersistHint method getMockDn.

private static DataNode getMockDn(NonLocalLazyPersist nonLocalLazyPersist) throws IOException {
    Configuration conf = new HdfsConfiguration();
    conf.setBoolean(DFS_DATANODE_NON_LOCAL_LAZY_PERSIST, nonLocalLazyPersist == NonLocalLazyPersist.ALLOWED);
    DatanodeRegistration mockDnReg = mock(DatanodeRegistration.class);
    DataNodeMetrics mockMetrics = mock(DataNodeMetrics.class);
    DataNode mockDn = mock(DataNode.class);
    when(mockDn.getConf()).thenReturn(conf);
    DNConf dnConf = new DNConf(mockDn);
    when(mockDn.getDnConf()).thenReturn(dnConf);
    when(mockDn.getMetrics()).thenReturn(mockMetrics);
    when(mockDn.getDNRegistrationForBP("Dummy-pool")).thenReturn(mockDnReg);
    return mockDn;
}
Also used : DatanodeRegistration(org.apache.hadoop.hdfs.server.protocol.DatanodeRegistration) Configuration(org.apache.hadoop.conf.Configuration) DataNodeMetrics(org.apache.hadoop.hdfs.server.datanode.metrics.DataNodeMetrics)

Example 2 with DataNodeMetrics

use of org.apache.hadoop.hdfs.server.datanode.metrics.DataNodeMetrics in project hadoop by apache.

the class StripedBlockReconstructor method run.

@Override
public void run() {
    getDatanode().incrementXmitsInProgress();
    try {
        initDecoderIfNecessary();
        getStripedReader().init();
        stripedWriter.init();
        reconstruct();
        stripedWriter.endTargetBlocks();
    // Currently we don't check the acks for packets, this is similar as
    // block replication.
    } catch (Throwable e) {
        LOG.warn("Failed to reconstruct striped block: {}", getBlockGroup(), e);
        getDatanode().getMetrics().incrECFailedReconstructionTasks();
    } finally {
        getDatanode().decrementXmitsInProgress();
        final DataNodeMetrics metrics = getDatanode().getMetrics();
        metrics.incrECReconstructionTasks();
        metrics.incrECReconstructionBytesRead(getBytesRead());
        metrics.incrECReconstructionRemoteBytesRead(getRemoteBytesRead());
        metrics.incrECReconstructionBytesWritten(getBytesWritten());
        getStripedReader().close();
        stripedWriter.close();
    }
}
Also used : DataNodeMetrics(org.apache.hadoop.hdfs.server.datanode.metrics.DataNodeMetrics)

Aggregations

DataNodeMetrics (org.apache.hadoop.hdfs.server.datanode.metrics.DataNodeMetrics)2 Configuration (org.apache.hadoop.conf.Configuration)1 DatanodeRegistration (org.apache.hadoop.hdfs.server.protocol.DatanodeRegistration)1