JSR-352, Spring Batch and You

9/13/13 4:33 PMJSR-352, Spring Batch, and You

of 94http://mminella.github.io/jsr352-springbatch-and-you/?print-pdf#/

JSR-352, SPRING BATCH,JSR-352, SPRING BATCH,AND YOUAND YOU

Created by / Michael T Minella @michaelminella

WHO IS THIS GUY?WHO IS THIS GUY?

Author of Pro Spring BatchMember of the expert group for JSR-352Project lead for Spring Batch

I DO A LOT OF BATCH ;)I DO A LOT OF BATCH ;)

NO NEED TO TAKE NOTES!NO NEED TO TAKE NOTES!These talks are being recorded...These slides and code are on Github

FIND IT ALL HEREFIND IT ALL HERE

JSR-352JSR-352

SPRING BATCH'S IMPLE‐SPRING BATCH'S IMPLE‐MENTATION OF JSR-352MENTATION OF JSR-352

SPRING BATCH BEYONDSPRING BATCH BEYONDJSR-352JSR-352

EXPECTATIONSEXPECTATIONSBasic knowledge of SpringBasic knowledge of Spring Batch

? WHEN YOU HAVE THEM? WHEN YOU HAVE THEM

JSR-352JSR-352

JSR-352 introduces an exciting new Javaspecification for building, deploying, and

running batch applications.- Chris Vignola

SPRING'S INVOLVEMENTSPRING'S INVOLVEMENT

SPRING BATCH IS ASPRING BATCH IS ALEADER IN THE SPACELEADER IN THE SPACE

RESULTS OF THE SPEC?RESULTS OF THE SPEC?

STRUCTURALLY THESTRUCTURALLY THESAMESAME

33API for building batch componentsA DSL for configuring batch componentsA contract of how batch components interact

HIGH LEVEL DIFFERENCESHIGH LEVEL DIFFERENCES

SPRING BATCH JOBSPRING BATCH JOB<job id="personJob"> <step id="step1"> <tasklet> <chunk commit-interval="5" reader="itemReader" processor="itemProcessor" writer="itemWriter" /> </tasklet> </step></job>

JSR-352 JOBJSR-352 JOB<job id="personJob"> <step id="step1"> <chunk item-count="5"> <reader ref="itemReader"/> <processor ref="itemProcessor"/> <writer ref="itemWriter"/> </chunk> </step></job>

<job id="personJob"> <step id="step1"> <tasklet> <chunk commit-interval="5" reader="itemReader" processor="itemProcessor" writer="itemWriter"/> </tasklet> </step></job>

<job id="personJob"> <step id="step1"> <chunk item-count="5"> <reader ref="itemReader"/> <processor ref="itemProcessor"/> <writer ref="itemWriter"/> </chunk> </step></job>

DEPENDENCY INJECTIONDEPENDENCY INJECTIONFoundational technology of Spring BatchNot required with JSR-352

REFERENCES IN JSR-352REFERENCES IN JSR-352<job id="personJob"> <step id="step1"> <chunk item-count="5"> <reader ref="itemReader"/> <processor ref="itemProcessor"/> <writer ref="itemWriter"/> </chunk> </step></job>

REFERENCES POINT TO 1REFERENCES POINT TO 1OF 3 PLACESOF 3 PLACES

Spring beanbatch.xml definitionThe class itself

SPRING BEANSPRING BEAN<bean id="itemWriter" class="org.springframework.batch.item.xml.StaxEventItemWriter" <property name="resource" ref="outputFile" /> <property name="marshaller" ref="customerMarshaller" /> <property name="rootTagName" value="customers" /></bean>

BATCH.XMLBATCH.XML<batch-artifacts xmlns="http://xmlns.jcp.org/xml/ns/javaee">

</batch-artifacts>

THE CLASS ITSELFTHE CLASS ITSELF<job id="personJob"> <step id="step1"> <chunk item-count="5"> <reader ref="org.sf.jsr.demo.ItemReader"/> <processor ref="org.sf.jsr.demo.ItemProcessor"/> <writer ref="org.sf.jsr.demo.ItemWriter"/> </chunk> </step></job>

PROPERTIESPROPERTIESSpring injects them on bean definitionsJSR-352 injects properties from the job definitionJSR-352 properties are Strings only

SPRING BATCH JOBSPRING BATCH JOB<job id="formatJob"> <step id="step1"> <tasklet> <chunk reader="fileReader" writer="xmlWriter" commit-interval="#{jobParameters['commit.interval']}"/> </tasklet> </step></job>

JSR-352 JOBJSR-352 JOB<job id="personJob"> <step id="step1"> <chunk item-count="#{jobParameters['commit.interval']}"> <reader ref="fileReader"> <properties> <property name="fileName" value="#{jobParameters['input.fileName']}" </properties> </reader> <writer ref="xmlWriter"> <properties> <property name="fileName" value="#{jobParameters['output.fileName']}" </properties> </writer> </chunk> </step></job>

INJECTION OF PROPER‐INJECTION OF PROPER‐TIESTIES

@Inject@BatchPropertypublic String fileName;

@Inject@BatchProperty(name="otherProperty")public String otherProperty;

LET'S BUILD AN APP!LET'S BUILD AN APP!

00:00 -00:34

LOGS OF A VIRAL VIDEOLOGS OF A VIRAL VIDEOReleased in 2003.Downloaded 1.1 million times the first 2 weeksSince been downloaded 40 million times since it wasmoved to YouTube2008, Andy Baio posted the Apache logs for the first 6monthsFile is 1.6 GB unzipped and available via BitTorentFile was originally called "ghyslain_razaa.wmv"File was later renamed to "Star_Wars_Kid.wmv"

WHO WAS WATCHINGWHO WAS WATCHINGTHIS VIDEO?THIS VIDEO?

OUR JOBOUR JOB

STEP PROCESSING MOD‐STEP PROCESSING MOD‐ELSELS

BATCHLETBATCHLET

BATCHLET = STOPPABLE‐BATCHLET = STOPPABLE‐TASKLETTASKLET

public interface Tasklet { RepeatStatus execute(StepContribution contribution, ChunkContext chunkContext) throws Exception;}

public interface StoppableTasklet extends Tasklet { void stop();}

public interface Batchlet { public String process() throws Exception; public void stop() throws Exception; }

STEP 1...SPLIT THE FILESTEP 1...SPLIT THE FILE

LAUNCHINGLAUNCHING

JOBOPERATORJOBOPERATORJobOperator jobOperator = BatchRuntime.getJobOperator();

// startlong jobExecutionId = jobOperator.start("myJob", new Properties());

// restartlong newJobExecutionId = jobOperator.restart(jobExecutionId, new Properties());

// stopjobOperator.stop(jobExecutionid);

CHUNK PROCESSINGCHUNK PROCESSING

SPRING BATCHSPRING BATCH

SPRING BATCH REALLYSPRING BATCH REALLY

JSR-352JSR-352

CHUNK RELATED INTER‐CHUNK RELATED INTER‐FACESFACES

ItemReaderItemProcessorItemWriter

CHECKPOINTSCHECKPOINTSItemCustom

STEP 2...IMPORT THE FILESTEP 2...IMPORT THE FILE

ERROR HANDLINGERROR HANDLING

SKIPSKIP<job id="skip" xmlns="http://xmlns.jcp.org/xml/ns/javaee" version="1.0"> <step id="step1"> <chunk skip-limit="3"> <reader ref="retryableListReader"/> <writer ref="fileWriter"/>  <skippable-exception-classes> <include class="java.lang.RuntimeException"/> </skippable-exception-classes> </chunk> </step></job>

RETRYRETRY<job id="retry" xmlns="http://xmlns.jcp.org/xml/ns/javaee" version="1.0"> <step id="step1"> <chunk retry-limit="3"> <reader ref="retryableListReader"/> <writer ref="fileWriter"/>

<retryable-exception-classes> <include class="java.lang.RuntimeException"/> </retryable-exception-classes> </chunk> </step></job>

READ RETRIESREAD RETRIESSpring Batch hasn't supported read retriesJSR-352 allows read retriesExisting Spring Batch readers won't support read retry with3.0

SCALINGSCALING

SPLITSSPLITSSame as Spring Batch

PARTITIONINGPARTITIONINGExecutes chunks or multiple instances of Batchlets inparallelTwo configuration options

Hardcoded in XMLPartitionMapper

Adds two additional concepts...

PARTITION REDUCERPARTITION REDUCERProvides a hook for compensating logic upon failureReally just a specializedStepListener/StepExecutionListenr

PARTITION COLLECTOR/PARTITION COLLECTOR/ANALYZERANALYZER

Collector collects data from batch artifactsAnalyzer allows the ability to set ExitStatus after apartitioned step

SPRING BATCH'SSPRING BATCH'SIMPLEMENTATIONIMPLEMENTATION

SPRING BATCH STATUSSPRING BATCH STATUSReleased 3.0.0.M2 last nightPasses > 50% of the TCK tests3.0 will be JSR-352 compliant

"RAW" JSR-352 VERSION"RAW" JSR-352 VERSIONClasses: 8Lines of custom code: 826

33API for building batch componentsA DSL for configuring batch componentsA contract of how batch components interact

COMPONENTS!!!COMPONENTS!!!

JSR-352 PROVIDES 0JSR-352 PROVIDES 0IMPLEMENTATIONSIMPLEMENTATIONS

ITEM READERSITEM READERSAggregateItemReader

AmqpItemReader

FlatFileItemReader

HibernateCursorItemReader

HibernatePagingItemReader

IbatisPagingItemReader

ItemReaderAdapter

JdbcCursorItemReader

JdbcPagingItemReader

JmsItemReader

JpaPagingItemReader

ListItemReader

MongoItemReader

Neo4jItemReader

RepositoryItemReader

StoredProcedureItemReader

StaxEventItemReader

ITEM WRITERSITEM WRITERS

SAME APP...SPRING-IFIEDSAME APP...SPRING-IFIED

COMPARISONCOMPARISON

"RAW" JSR-352 VERSION"RAW" JSR-352 VERSIONClasses: 8Lines of custom code: 826

SPRING JSR-352 VERSIONSPRING JSR-352 VERSIONClasses: 5Lines of custom code: 596

BEYOND JSR-352BEYOND JSR-352

SPRING!SPRING!

TYPE SAFE PROPERTIESTYPE SAFE PROPERTIES

NO INHERITENCENO INHERITENCE

SCALABILITYSCALABILITY

JSR-352 IS SINGLE JVMJSR-352 IS SINGLE JVMONLYONLY

SPRING BATCH SCALESSPRING BATCH SCALESBEYOND 1 JVMBEYOND 1 JVM

REMOTE CHUNKINGREMOTE CHUNKING

REMOTE PARTITIONINGREMOTE PARTITIONING

BATCH DOESN'T OCCURBATCH DOESN'T OCCURIN A VACUUMIN A VACUUM

LAUNCHING JOBS VIALAUNCHING JOBS VIAMESSAGESMESSAGES

SPRING HADOOPSPRING HADOOP

SPRING XDSPRING XD

FIND THIS DECK ANDFIND THIS DECK ANDDEMO CODE:DEMO CODE:

Github

KEEP IN TOUCH!KEEP IN TOUCH!Michael Minella

Twitter: Github:

Spring BatchSite: Session replays on YouTube:

SpringSite:

@MichaelMinellamminella

Spring BatchYouTube

Spring IO

JSR-352, Spring Batch and You

Technology

Adopt JSR 354

I - Machine Intelligence Lab · Web viewLDAA #$10 JSR INIT_SCI JSR INIT_MOTOR JSR INIT_SHAFT JSR INIT_SENSOR JSR INIT_AD LDAA #4 STAA XX * Start position set to 4,4 STAA YY LDAA #1

Understanding Java Batch (JSR-352) Application Server Understanding Java Batch (JSR-352) This document can be found on the web at: Search for document number WP102706 under the category

JSR-299: Java Contexts and Dependency Injection · JSR-299: Java Contexts and Dependency Injection JSR-299 Expert Group Version: Revised Public Review Draft

Summer Batch - Reference Guide - BLU AGE · ization solutions. By sharing our experiences, we managed to focus on very essentials parts of JSR-352 specification, covering needs for

Introducing JSR-283

J2ME - Wirtualna Polskai.wp.pl/a/i/infoshare/2007_materialy/InfoShare2007_MSokolowski_J2ME_OSA.pdf• JSR 172 J2ME Web Services • JSR 177 Security and Trust Services API • JSR

jsr - JSCALE - Leading Provider of Digital Scales · jsr Created Date: 20150128153116Z

ประแจขันปอนด์ - JSR...Mechanic Hand Tools 113 Designed by JSR GROUP Copyright 2015 JSR GROUP, All rights reserved. j,qXq[a]bAlXS,bpYlXwqTsHqAVqGYbshpV TORQUE

Java-Batch - muchsoftJava-Batch JSR-352 Der neue Standard in Java EE 7 Thomas Much 13.05.2014

Magento jsr

JSR 352 “Batch Applications for the Java Platform”

JSR-286: Portlet Specification 2 - ApacheConarchive.apachecon.com/us2007/downloads/ApacheConUS... · JSR-286: Portlet Specification 2.0 for Portal and Portlet Developers JSR-286:

Java EE 7 アプリケーション設計ガイド - IBMpublic.dhe.ibm.com/software/dw/jp/websphere/was/javaee7_appguide/Java... · JSR-352 Batch Applications for Java Platform 本文書の位置づけ

jsriasacademy.in JSR

Seven Barriers JSR

JSR 82 (bluetooth obex)

JSR 352 Batch Applications for the Java Platformdownload.oracle.com/otn-pub/jcp/batch-1_0_revA...ItemReaders and ItemWriters. However, because of the JSR 352 operations, callbacks,

JSR 292 Cookbook

Step-by-Step Implementation Guide...• Step – this is the heart of the batch processing. The JSR 352 specification document provides a very nice description of this: A Step contains