Search in sources :

Example 6 with Environment

use of org.nd4j.linalg.heartbeat.reports.Environment in project deeplearning4j by deeplearning4j.

the class SparkDl4jMultiLayer method update.

private void update(int mr, long mg) {
    Environment env = EnvironmentUtils.buildEnvironment();
    env.setNumCores(mr);
    env.setAvailableMemory(mg);
    Task task = ModelSerializer.taskByModel(network);
    Heartbeat.getInstance().reportEvent(Event.SPARK, env, task);
}
Also used : Task(org.nd4j.linalg.heartbeat.reports.Task) Environment(org.nd4j.linalg.heartbeat.reports.Environment)

Aggregations

Environment (org.nd4j.linalg.heartbeat.reports.Environment)6 Task (org.nd4j.linalg.heartbeat.reports.Task)3 Heartbeat (org.nd4j.linalg.heartbeat.Heartbeat)2 ArrayList (java.util.ArrayList)1 HashMap (java.util.HashMap)1 List (java.util.List)1 Map (java.util.Map)1 AtomicInteger (java.util.concurrent.atomic.AtomicInteger)1 AtomicLong (java.util.concurrent.atomic.AtomicLong)1 JavaSparkContext (org.apache.spark.api.java.JavaSparkContext)1 FlatMapFunction (org.apache.spark.api.java.function.FlatMapFunction)1 Pair (org.deeplearning4j.berkeley.Pair)1 InMemoryLookupTable (org.deeplearning4j.models.embeddings.inmemory.InMemoryLookupTable)1 VocabWord (org.deeplearning4j.models.word2vec.VocabWord)1 VocabCache (org.deeplearning4j.models.word2vec.wordstore.VocabCache)1 CountCumSum (org.deeplearning4j.spark.text.functions.CountCumSum)1 TextPipeline (org.deeplearning4j.spark.text.functions.TextPipeline)1 Ignore (org.junit.Ignore)1 Test (org.junit.Test)1 INDArray (org.nd4j.linalg.api.ndarray.INDArray)1