Search in sources :

Example 6 with DataPullProperties

use of com.homeaway.datapullclient.config.DataPullProperties in project datapull by homeaway.

the class DataPullTask method toString.

@Override
public String toString() {
    final DataPullProperties dataPullProperties = this.config.getDataPullProperties();
    final EMRProperties emrProperties = this.config.getEmrProperties();
    return "DataPullTask{" + "taskId='" + this.taskId + '\'' + ", jsonS3Path='" + this.jsonS3Path + '\'' + ", logFilePath='" + dataPullProperties.getLogFilePath() + '\'' + ", s3RepositoryBucketName='" + dataPullProperties.getS3BucketName() + '\'' + ", s3JarPath='" + this.s3JarPath + '\'' + ", instanceCount=" + emrProperties.getInstanceCount() + ", masterType='" + emrProperties.getMasterType() + '\'' + ", slaveType='" + emrProperties.getSlaveType() + '\'' + ", serviceRole='" + emrProperties.getServiceRole() + '\'' + ", jobFlowRole='" + emrProperties.getJobFlowRole() + '\'' + ", emrReleaseVersion='" + emrProperties.getEmrRelease() + '\'' + ", config=" + this.config + '}';
}
Also used : DataPullProperties(com.homeaway.datapullclient.config.DataPullProperties) EMRProperties(com.homeaway.datapullclient.config.EMRProperties)

Aggregations

DataPullProperties (com.homeaway.datapullclient.config.DataPullProperties)6 EMRProperties (com.homeaway.datapullclient.config.EMRProperties)4 AmazonS3 (com.amazonaws.services.s3.AmazonS3)3 DataPullClientConfig (com.homeaway.datapullclient.config.DataPullClientConfig)3 ClusterProperties (com.homeaway.datapullclient.input.ClusterProperties)3 java.util (java.util)3 Collectors (java.util.stream.Collectors)3 Slf4j (lombok.extern.slf4j.Slf4j)3 Autowired (org.springframework.beans.factory.annotation.Autowired)3 AmazonElasticMapReduce (com.amazonaws.services.elasticmapreduce.AmazonElasticMapReduce)2 com.amazonaws.services.s3.model (com.amazonaws.services.s3.model)2 JsonNode (com.fasterxml.jackson.databind.JsonNode)2 ObjectMapper (com.fasterxml.jackson.databind.ObjectMapper)2 ObjectNode (com.fasterxml.jackson.databind.node.ObjectNode)2 DataPullContext (com.homeaway.datapullclient.config.DataPullContext)2 DataPullContextHolder (com.homeaway.datapullclient.config.DataPullContextHolder)2 InvalidPointedJsonException (com.homeaway.datapullclient.exception.InvalidPointedJsonException)2 ProcessingException (com.homeaway.datapullclient.exception.ProcessingException)2 JsonInputFile (com.homeaway.datapullclient.input.JsonInputFile)2 Migration (com.homeaway.datapullclient.input.Migration)2