Search in sources :

Example 1 with FlatFileItemWriter

use of org.springframework.batch.item.file.FlatFileItemWriter in project Spring-Family by Sierou-Java.

the class Main method main.

public static void main(String[] args) {
    try {
        String[] configLocations = { "classpath*:applicationContext.xml" };
        ApplicationContext applicationContext = new ClassPathXmlApplicationContext(configLocations);
        JobLauncher jobLauncher = applicationContext.getBean(JobLauncher.class);
        JobRepository jobRepository = applicationContext.getBean(JobRepository.class);
        PlatformTransactionManager transactionManager = applicationContext.getBean(PlatformTransactionManager.class);
        // 创建reader
        FlatFileItemReader<DeviceCommand> flatFileItemReader = new FlatFileItemReader<>();
        flatFileItemReader.setResource(new FileSystemResource("/project/Spring-Family-Parent/Spring-Family-Batch/src/main/resources/batch-data.csv"));
        // // 转换数据
        flatFileItemReader.setLineMapper(new DemoLineMapper());
        // 创建processor 对数据进行操作
        DemoProcessor helloItemProcessor = new DemoProcessor();
        // 创建writer
        FlatFileItemWriter<DeviceCommand> flatFileItemWriter = new FlatFileItemWriter<>();
        flatFileItemWriter.setResource(new FileSystemResource("/project/Spring-Family-Parent/Spring-Family-Batch/src/main/resources/batch-data.csv"));
        flatFileItemWriter.setLineAggregator(new DemoLineAggregator());
        // 创建Step
        StepBuilderFactory stepBuilderFactory = new StepBuilderFactory(jobRepository, transactionManager);
        Step step = stepBuilderFactory.get("step").<DeviceCommand, DeviceCommand>chunk(1).reader(// 读操作
        flatFileItemReader).processor(// 处理操作
        helloItemProcessor).writer(// 写操作
        flatFileItemWriter).build();
        // 创建Job
        JobBuilderFactory jobBuilderFactory = new JobBuilderFactory(jobRepository);
        Job job = jobBuilderFactory.get("job").start(step).build();
        // 启动任务
        jobLauncher.run(job, new JobParameters());
    } catch (JobExecutionAlreadyRunningException e) {
        e.printStackTrace();
    } catch (JobRestartException e) {
        e.printStackTrace();
    } catch (JobInstanceAlreadyCompleteException e) {
        e.printStackTrace();
    } catch (JobParametersInvalidException e) {
        e.printStackTrace();
    }
}
Also used : JobLauncher(org.springframework.batch.core.launch.JobLauncher) FlatFileItemReader(org.springframework.batch.item.file.FlatFileItemReader) DemoProcessor(org.family.processor.DemoProcessor) JobExecutionAlreadyRunningException(org.springframework.batch.core.repository.JobExecutionAlreadyRunningException) FileSystemResource(org.springframework.core.io.FileSystemResource) Step(org.springframework.batch.core.Step) JobRepository(org.springframework.batch.core.repository.JobRepository) ApplicationContext(org.springframework.context.ApplicationContext) ClassPathXmlApplicationContext(org.springframework.context.support.ClassPathXmlApplicationContext) ClassPathXmlApplicationContext(org.springframework.context.support.ClassPathXmlApplicationContext) JobParametersInvalidException(org.springframework.batch.core.JobParametersInvalidException) Job(org.springframework.batch.core.Job) DemoLineAggregator(org.family.aggregator.DemoLineAggregator) StepBuilderFactory(org.springframework.batch.core.configuration.annotation.StepBuilderFactory) DeviceCommand(org.family.dto.DeviceCommand) PlatformTransactionManager(org.springframework.transaction.PlatformTransactionManager) JobInstanceAlreadyCompleteException(org.springframework.batch.core.repository.JobInstanceAlreadyCompleteException) JobBuilderFactory(org.springframework.batch.core.configuration.annotation.JobBuilderFactory) DemoLineMapper(org.family.mapper.DemoLineMapper) FlatFileItemWriter(org.springframework.batch.item.file.FlatFileItemWriter) JobParameters(org.springframework.batch.core.JobParameters) JobRestartException(org.springframework.batch.core.repository.JobRestartException)

Example 2 with FlatFileItemWriter

use of org.springframework.batch.item.file.FlatFileItemWriter in project nixmash-blog by mintster.

the class DemoJobConfiguration method demoJobWriter.

@Bean
public ItemWriter<PostDTO> demoJobWriter() {
    FlatFileItemWriter<PostDTO> writer = new FlatFileItemWriter<>();
    writer.setResource(new FileSystemResource("/home/daveburke/web/nixmashspring/posts.csv"));
    DelimitedLineAggregator<PostDTO> delLineAgg = new DelimitedLineAggregator<>();
    delLineAgg.setDelimiter(";");
    BeanWrapperFieldExtractor<PostDTO> fieldExtractor = new BeanWrapperFieldExtractor<>();
    fieldExtractor.setNames(new String[] { "postTitle" });
    delLineAgg.setFieldExtractor(fieldExtractor);
    writer.setLineAggregator(delLineAgg);
    return writer;
}
Also used : BeanWrapperFieldExtractor(org.springframework.batch.item.file.transform.BeanWrapperFieldExtractor) FlatFileItemWriter(org.springframework.batch.item.file.FlatFileItemWriter) PostDTO(com.nixmash.blog.jpa.dto.PostDTO) FileSystemResource(org.springframework.core.io.FileSystemResource) DelimitedLineAggregator(org.springframework.batch.item.file.transform.DelimitedLineAggregator) Bean(org.springframework.context.annotation.Bean)

Example 3 with FlatFileItemWriter

use of org.springframework.batch.item.file.FlatFileItemWriter in project RecordManager2 by moravianlibrary.

the class ExportRecordsJobConfig method exportRecordsWriter.

@Bean(name = "exportRecordsJob:exportRecordsWriter")
@StepScope
public FlatFileItemWriter<String> exportRecordsWriter(@Value("#{jobParameters[" + Constants.JOB_PARAM_OUT_FILE + "]}") String filename) throws Exception {
    FlatFileItemWriter<String> fileWritter = new FlatFileItemWriter<String>();
    fileWritter.setAppendAllowed(false);
    fileWritter.setShouldDeleteIfExists(true);
    fileWritter.setEncoding("UTF-8");
    fileWritter.setLineAggregator(new PassThroughLineAggregator<String>());
    fileWritter.setResource(new FileSystemResource(filename));
    fileWritter.afterPropertiesSet();
    return fileWritter;
}
Also used : FlatFileItemWriter(org.springframework.batch.item.file.FlatFileItemWriter) FileSystemResource(org.springframework.core.io.FileSystemResource) StepScope(org.springframework.batch.core.configuration.annotation.StepScope) SqlPagingQueryProviderFactoryBean(org.springframework.batch.item.database.support.SqlPagingQueryProviderFactoryBean) Bean(org.springframework.context.annotation.Bean)

Aggregations

FlatFileItemWriter (org.springframework.batch.item.file.FlatFileItemWriter)3 FileSystemResource (org.springframework.core.io.FileSystemResource)3 Bean (org.springframework.context.annotation.Bean)2 PostDTO (com.nixmash.blog.jpa.dto.PostDTO)1 DemoLineAggregator (org.family.aggregator.DemoLineAggregator)1 DeviceCommand (org.family.dto.DeviceCommand)1 DemoLineMapper (org.family.mapper.DemoLineMapper)1 DemoProcessor (org.family.processor.DemoProcessor)1 Job (org.springframework.batch.core.Job)1 JobParameters (org.springframework.batch.core.JobParameters)1 JobParametersInvalidException (org.springframework.batch.core.JobParametersInvalidException)1 Step (org.springframework.batch.core.Step)1 JobBuilderFactory (org.springframework.batch.core.configuration.annotation.JobBuilderFactory)1 StepBuilderFactory (org.springframework.batch.core.configuration.annotation.StepBuilderFactory)1 StepScope (org.springframework.batch.core.configuration.annotation.StepScope)1 JobLauncher (org.springframework.batch.core.launch.JobLauncher)1 JobExecutionAlreadyRunningException (org.springframework.batch.core.repository.JobExecutionAlreadyRunningException)1 JobInstanceAlreadyCompleteException (org.springframework.batch.core.repository.JobInstanceAlreadyCompleteException)1 JobRepository (org.springframework.batch.core.repository.JobRepository)1 JobRestartException (org.springframework.batch.core.repository.JobRestartException)1