SlideShare a Scribd company logo

How to use batch component

Download as PPTX, PDF
sivachandra mandalapu, profile picture
sivachandra mandalapu

The document describes how to use the Batch component in Mule applications. The Batch component allows processing messages in batches by splitting messages into individual records, performing actions on each record, and reporting results. The document includes an example Mule flow that uses a Batch job to iterate over a list of maps and perform database updates on each item. It logs output showing the batch job processing the records and handling any errors.

Education
1 of 14
Download to read offline
1
2
3
4
5
6
7
8
9
10
11
12
13
14
How to use Batch component 28-05-2015
Abstract • The main motto of this PPT is How to use Batch component in our applications.
Introduction • Mule possesses the ability to process messages in batches. Within an application, you can initiate a batch job which is a block of code that splits messages into individual records, performs actions upon each record, then reports on the results and potentially pushes the processed output to other systems or queues. This functionality is particularly useful when working with streaming input or when engineering "near real-time" data integration between SaaS applications.
Example
.mflow • <?xml version="1.0" encoding="UTF-8"?> • <mule xmlns:tracking="http://www.mulesoft.org/schema/mule/ee/tracking" xmlns:db="http://www.mulesoft.org/schema/mule/db" xmlns:batch="http://www.mulesoft.org/schema/mule/batch" xmlns:http="http://www.mulesoft.org/schema/mule/http" xmlns="http://www.mulesoft.org/schema/mule/core" xmlns:doc="http://www.mulesoft.org/schema/mule/documentation" • xmlns:spring="http://www.springframework.org/schema/beans" • xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" • xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-current.xsd • http://www.mulesoft.org/schema/mule/core http://www.mulesoft.org/schema/mule/core/current/mule.xsd • http://www.mulesoft.org/schema/mule/http http://www.mulesoft.org/schema/mule/http/current/mule-http.xsd • http://www.mulesoft.org/schema/mule/batch http://www.mulesoft.org/schema/mule/batch/current/mule-batch.xsd • http://www.mulesoft.org/schema/mule/db http://www.mulesoft.org/schema/mule/db/current/mule-db.xsd • http://www.mulesoft.org/schema/mule/ee/tracking http://www.mulesoft.org/schema/mule/ee/tracking/current/mule-tracking-ee.xsd"> • <http:listener-config name="HTTP_Listener_Configuration" host="0.0.0.0" port="8089" doc:name="HTTP Listener Configuration"/> • <db:generic-config name="Generic_Database_Configuration" url="jdbc:sqlserver://localhost:1433;databaseName=SOA_VMES_DB;user=****;password=****;" driverClassName="com.microsoft.sqlserver.jdbc.SQLServerDriver" doc:name="Generic Database Configuration"/> • <batch:job name="SampleBatch" max-failed-records="-1"> • <batch:process-records> • <batch:step name="Batch_Step"> • <logger message="--Batch step--#[payload]--" level="INFO" doc:name="Logger"/> • <foreach doc:name="For Each"> • <logger message="--for each--batch step--#[payload]" level="INFO" doc:name="Logger"/> • <choice doc:name="Choice"> • <when expression="#[payload==5]"> • <db:update config-ref="Generic_Database_Configuration" doc:name="Database"> • <db:parameterized-query><![CDATA[update mytable22 set status='successsuccesssuccesssuccesssuccesssuccess' where num=#[payload]]]></db:parameterized-query> • </db:update> • </when> • <otherwise> • <db:update config-ref="Generic_Database_Configuration" doc:name="Database"> • <db:parameterized-query><![CDATA[update mytable22 set status='Success' where num=#[payload]]]></db:parameterized-query> • </db:update> • </otherwise> • </choice> • </foreach> • </batch:step>
• <batch:step name="Batch_Step1" accept-policy="ONLY_FAILURES"> • <logger message="--step1--#[payload]" level="INFO" doc:name="Logger"/> • <foreach doc:name="For Each"> • <logger message="--for each--batch step1--#[payload]--" level="INFO" doc:name="Logger"/> • <db:update config-ref="Generic_Database_Configuration" doc:name="Database"> • <db:parameterized-query><![CDATA[update mytable22 set status='batch fail' where num=#[payload]]]></db:parameterized-query> • </db:update> • </foreach> • </batch:step> • </batch:process-records> • <batch:on-complete> • <logger message="--complete--#[message.payload]" level="INFO" doc:name="Logger"/> • </batch:on-complete> • </batch:job> • <flow name="SampleFlow"> • <http:listener config-ref="HTTP_Listener_Configuration" path="/*" doc:name="HTTP"/> • <logger level="INFO" doc:name="Logger" message="--Hai"/> • <expression-component doc:name="Expression"><![CDATA[import java.util.List; • import java.util.Map; • import java.util.ArrayList; • import java.util.HashMap; • List l1 = new ArrayList(); • Map m2 = new HashMap(); • m2.put("b","2"); • m2.put("c","3"); • l1.add(m2); • Map m1 = new HashMap(); • m1.put("a","1"); • l1.add(m1); • Map m4 = new HashMap(); • m4.put("e","5"); • l1.add(m4); • Map m3 = new HashMap(); • m3.put("d","4"); • l1.add(m3); • payload = l1; • return payload;]]></expression-component> • <logger message="--main flow--#[payload]" level="INFO" doc:name="Logger"/> • <batch:execute name="SampleBatch" doc:name="SampleBatch"/> • </flow> • </mule>
• Output: • Data in DB: • Before execute: After execute:
• INFO 2016-05-28 18:51:48,882 [main] org.mule.module.launcher.MuleDeploymentService: • ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ • + Started app 'Sample' + • ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ • INFO 2016-05-28 18:51:48,886 [main] org.mule.module.launcher.DeploymentDirectoryWatcher: • ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ • + Mule is up and kicking (every 5000ms) + • ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ • INFO 2016-05-28 18:51:49,040 [main] org.mule.module.launcher.StartupSummaryDeploymentListener: • ********************************************************************** • * - - + DOMAIN + - - * - - + STATUS + - - * • ********************************************************************** • * default * DEPLOYED * • ********************************************************************** • ******************************************************************************************************* • * - - + APPLICATION + - - * - - + DOMAIN + - - * - - + STATUS + - - * • ******************************************************************************************************* • * Sample * default * DEPLOYED * • ******************************************************************************************************* • INFO 2016-05-28 18:51:53,201 [[Sample].HTTP_Listener_Configuration.worker.01] org.mule.api.processor.LoggerMessageProcessor: --Hai • INFO 2016-05-28 18:51:53,253 [[Sample].HTTP_Listener_Configuration.worker.01] org.mule.api.processor.LoggerMessageProcessor: --main flow--[{b=2, c=3}, {a=1}, {e=5}, {d=4}] • INFO 2016-05-28 18:51:53,354 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.DefaultBatchEngine: Created instance dc959d50-24fc-11e6-b3de- 30d420524153 for batch job SampleBatch • INFO 2016-05-28 18:51:53,359 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.DefaultBatchEngine: Batch job SampleBatch has no input phase. Creating job instance • INFO 2016-05-28 18:51:53,383 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.queue.BatchQueueLoader: Starting loading phase for instance 'dc959d50-24fc-11e6-b3de-30d420524153' of job 'SampleBatch' • INFO 2016-05-28 18:51:53,548 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.queue.BatchQueueLoader: Finished loading phase for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch. 4 records were loaded • INFO 2016-05-28 18:51:53,562 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.DefaultBatchEngine: Started execution of instance 'dc959d50- 24fc-11e6-b3de-30d420524153' of job 'SampleBatch' • INFO 2016-05-28 18:51:53,711 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --Batch step--{b=2, c=3}-- • INFO 2016-05-28 18:51:53,713 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step--2 • INFO 2016-05-28 18:52:00,519 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step--3 • INFO 2016-05-28 18:52:00,605 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --Batch step--{a=1}-- • INFO 2016-05-28 18:52:00,605 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step--1 • INFO 2016-05-28 18:52:00,617 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --Batch step--{e=5}-- • INFO 2016-05-28 18:52:00,617 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step--5 • INFO 2016-05-28 18:52:02,765 [batch-job-SampleBatch-work-manager.01] com.mulesoft.module.batch.DefaultBatchStep: Found exception processing record on step 'Batch_Step' for job instance 'dc959d50-24fc-11e6-b3de-30d420524153' of job 'SampleBatch'. • This is the first record to show this exception on this step for this job instance. Subsequent records with the same failureswill not be logged for performance and log readability reasons:
• ******************************************************************************** • Message : String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException). Message payload is of type: String • Type : org.mule.api.MessagingException • Code : MULE_ERROR--2 • Payload : 5 • JavaDoc : http://www.mulesoft.org/docs/site/current3/apidocs/org/mule/api/MessagingException.html • ******************************************************************************** • Exception stack is: • 1. String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException) • com.microsoft.sqlserver.jdbc.SQLServerException:216 (null) • 2. String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException). Message payload is of type: String (org.mule.api.MessagingException) • org.mule.module.db.internal.processor.AbstractDbMessageProcessor:93 (http://www.mulesoft.org/docs/site/current3/apidocs/org/mule/api/MessagingException.html) • ******************************************************************************** • Root Exception stack trace: • com.microsoft.sqlserver.jdbc.SQLServerException: String or binary data would be truncated. • at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:216) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1515) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:404) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:350) • at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:5696) • at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1715) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:180) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:155) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeUpdate(SQLServerPreparedStatement.java:314) • at org.mule.module.db.internal.domain.autogeneratedkey.NoAutoGeneratedKeyStrategy.executeUpdate(NoAutoGeneratedKeyStrategy.java:55) • at org.mule.module.db.internal.domain.executor.UpdateExecutor.doExecuteQuery(UpdateExecutor.java:43) • at org.mule.module.db.internal.domain.executor.AbstractSingleQueryExecutor.execute(AbstractSingleQueryExecutor.java:48) • at org.mule.module.db.internal.processor.UpdateMessageProcessor.doExecuteQuery(UpdateMessageProcessor.java:59) • at org.mule.module.db.internal.processor.AbstractSingleQueryDbMessageProcessor.executeQuery(AbstractSingleQueryDbMessageProcessor.java:42) • at org.mule.module.db.internal.processor.AbstractDbMessageProcessor.process(AbstractDbMessageProcessor.java:66) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.routing.AbstractSelectiveRouter.processEventWithProcessor(AbstractSelectiveRouter.java:303) • at org.mule.routing.AbstractSelectiveRouter.routeWithProcessors(AbstractSelectiveRouter.java:293)
• at org.mule.routing.AbstractSelectiveRouter.process(AbstractSelectiveRouter.java:193) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:98) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.routing.outbound.AbstractMessageSequenceSplitter.processParts(AbstractMessageSequenceSplitter.java:129) • at org.mule.routing.outbound.AbstractMessageSequenceSplitter.process(AbstractMessageSequenceSplitter.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule... • ******************************************************************************** • INFO 2016-05-28 18:52:02,768 [batch-job-SampleBatch-work-manager.01] com.mulesoft.module.batch.DefaultBatchStep: Found exception processing record on step 'Batch_Step' for job instance 'dc959d50-24fc-11e6-b3de-30d420524153' of job 'SampleBatch'. • This is the first record to show this exception on this step for this job instance. Subsequent records with the same failureswill not be logged for performance and log readability reasons: • ******************************************************************************** • Message : String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException). Message payload is of type: String • Type : org.mule.api.MessagingException • Code : MULE_ERROR--2 • Payload : 5 • JavaDoc : http://www.mulesoft.org/docs/site/current3/apidocs/org/mule/api/MessagingException.html • ******************************************************************************** • Exception stack is: • 1. String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException) • com.microsoft.sqlserver.jdbc.SQLServerException:216 (null) • 2. String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException). Message payload is of type: String (org.mule.api.MessagingException) • org.mule.module.db.internal.processor.AbstractDbMessageProcessor:93 (http://www.mulesoft.org/docs/site/current3/apidocs/org/mule/api/MessagingException.html) • ******************************************************************************** • Root Exc • com.microsoft.sqlserver.jdbc.SQLServerException: String or binary data would be truncated. • at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:216) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1515) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:404) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:350) • at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:5696) eption stack trace:
• at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1715) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:180) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:155) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeUpdate(SQLServerPreparedStatement.java:314) • at org.mule.module.db.internal.domain.autogeneratedkey.NoAutoGeneratedKeyStrategy.executeUpdate(NoAutoGeneratedKeyStrategy.java:55) • at org.mule.module.db.internal.domain.executor.UpdateExecutor.doExecuteQuery(UpdateExecutor.java:43) • at org.mule.module.db.internal.domain.executor.AbstractSingleQueryExecutor.execute(AbstractSingleQueryExecutor.java:48) • at org.mule.module.db.internal.processor.UpdateMessageProcessor.doExecuteQuery(UpdateMessageProcessor.java:59) • at org.mule.module.db.internal.processor.AbstractSingleQueryDbMessageProcessor.executeQuery(AbstractSingleQueryDbMessageProcessor.java:42) • at org.mule.module.db.internal.processor.AbstractDbMessageProcessor.process(AbstractDbMessageProcessor.java:66) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.routing.AbstractSelectiveRouter.processEventWithProcessor(AbstractSelectiveRouter.java:303) • at org.mule.routing.AbstractSelectiveRouter.routeWithProcessors(AbstractSelectiveRouter.java:293) • at org.mule.routing.AbstractSelectiveRouter.process(AbstractSelectiveRouter.java:193) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:98) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.routing.outbound.AbstractMessageSequenceSplitter.processParts(AbstractMessageSequenceSplitter.java:129) • at org.mule.routing.outbound.AbstractMessageSequenceSplitter.process(AbstractMessageSequenceSplitter.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule... • ********************************************************************************
• INFO 2016-05-28 18:52:02,769 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --Batch step--{d=4}-- • INFO 2016-05-28 18:52:02,769 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step-- 4 • INFO 2016-05-28 18:52:03,049 [batch-job-SampleBatch-work-manager.01] com.mulesoft.module.batch.DefaultBatchStep: Step Batch_Step finished processing all records for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch • INFO 2016-05-28 18:52:03,095 [batch-job-SampleBatch-work-manager.02] org.mule.api.processor.LoggerMessageProcessor: --step1--{e=5} • INFO 2016-05-28 18:52:03,096 [batch-job-SampleBatch-work-manager.02] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step1--5-- • INFO 2016-05-28 18:52:03,488 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.engine.DefaultBatchEngine: Starting execution of onComplete phase for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch • INFO 2016-05-28 18:52:03,508 [batch-job-SampleBatch-work-manager.02] org.mule.api.processor.LoggerMessageProcessor: --complete-- com.mulesoft.module.batch.ImmutableBatchJobResult@1fa547d1 • INFO 2016-05-28 18:52:03,509 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.engine.DefaultBatchEngine: Finished execution of onComplete phase for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch • INFO 2016-05-28 18:52:03,509 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.engine.DefaultBatchEngine: Finished execution for instance 'dc959d50-24fc-11e6-b3de-30d420524153' of job 'SampleBatch'. Total Records processed: 4. Successful records: 3. Failed Records: 1 • INFO 2016-05-28 18:52:03,511 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.engine.DefaultBatchEngine: • ************************************************************************************************************************* *************************************** • * - - + Exception Type + - - * - - + Step + - - * - - + Count + - - * • ************************************************************************************************************************* *************************************** • * com.mulesoft.module.batch.exception.BatchException * Batch_Step * 1 * • ************************************************************************************************************************* *************************************** • INFO 2016-05-28 18:52:03,524 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.DefaultBatchStep: Step Batch_Step1 finished processing all records for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch
• Flow of execution: 1. URL to trigger the service from browser http://localhost:8089 2. a. Service will update the status to ‘Success’ for the records whose num is other than 5 b. It will fail while trying to update the status as ‘successsuccesssuccesssuccesssuccesssuccess’ for the num 5 because the length of the status excides the size of the column. Hence, the failed map will process in Batch_Step1 and will update the status as ‘batch fail’ for the record whose num is 5
References • https://docs.mulesoft.com/mule-user- guide/v/3.6/batch-processing

More Related Content

PPTX
Apache Flink Training: DataSet API Basics
Flink Forward
 
PPTX
Flink Batch Processing and Iterations
Sameer Wadkar
 
PPTX
Apache Flink Training: DataStream API Part 2 Advanced
Flink Forward
 
PPTX
Michael Häusler – Everyday flink
Flink Forward
 
PDF
Real time and reliable processing with Apache Storm
Andrea Iacono
 
PDF
Integrate Solr with real-time stream processing applications
lucenerevolution
 
PDF
Building Distributed System with Celery on Docker Swarm
Wei Lin
 
PPTX
Flink 0.10 @ Bay Area Meetup (October 2015)
Stephan Ewen
 
Apache Flink Training: DataSet API Basics
Flink Forward
 
Flink Batch Processing and Iterations
Sameer Wadkar
 
Apache Flink Training: DataStream API Part 2 Advanced
Flink Forward
 
Michael Häusler – Everyday flink
Flink Forward
 
Real time and reliable processing with Apache Storm
Andrea Iacono
 
Integrate Solr with real-time stream processing applications
lucenerevolution
 
Building Distributed System with Celery on Docker Swarm
Wei Lin
 
Flink 0.10 @ Bay Area Meetup (October 2015)
Stephan Ewen
 

What's hot (20)

PPTX
Create & Execute First Hadoop MapReduce Project in.pptx
vishal choudhary
 
PDF
PythonBrasil[8] - CPython for dummies
Tatiana Al-Chueyr
 
PDF
Real-time Stream Processing with Apache Flink @ Hadoop Summit
Gyula Fóra
 
PDF
Introduction to Twitter Storm
Uwe Printz
 
PDF
Distributed real time stream processing- why and how
Petr Zapletal
 
PPT
Anatomy of classic map reduce in hadoop
Rajesh Ananda Kumar
 
PPTX
Rally - Benchmarking_as_a_service - Openstack meetup
Ananth Padmanabhan
 
PDF
Hadoop Summit Europe 2014: Apache Storm Architecture
P. Taylor Goetz
 
PDF
Postgres Vienna DB Meetup 2014
Michael Renner
 
PPTX
BD-zero lecture.pptx
vishal choudhary
 
PPTX
EX-6-Implement Matrix Multiplication with Hadoop Map Reduce.pptx
vishal choudhary
 
PPTX
Hadoop MapReduce Introduction and Deep Insight
Hanborq Inc.
 
KEY
Testing Hadoop jobs with MRUnit
Eric Wendelin
 
PDF
An Introduction To PostgreSQL Triggers
Jim Mlodgenski
 
PDF
Monitoring InfluxEnterprise
InfluxData
 
PDF
Moving In: how to port your content from * to Drupal
Emma Jane Hogbin Westby
 
PPTX
An introduction to Test Driven Development on MapReduce
Ananth PackkilDurai
 
PDF
MAVRL Workshop 2014 - pymatgen-db & custodian
University of California, San Diego
 
DOCX
Big data unit iv and v lecture notes qb model exam
Indhujeni
 
PPT
Hive User Meeting August 2009 Facebook
ragho
 
Create & Execute First Hadoop MapReduce Project in.pptx
vishal choudhary
 
PythonBrasil[8] - CPython for dummies
Tatiana Al-Chueyr
 
Real-time Stream Processing with Apache Flink @ Hadoop Summit
Gyula Fóra
 
Introduction to Twitter Storm
Uwe Printz
 
Distributed real time stream processing- why and how
Petr Zapletal
 
Anatomy of classic map reduce in hadoop
Rajesh Ananda Kumar
 
Rally - Benchmarking_as_a_service - Openstack meetup
Ananth Padmanabhan
 
Hadoop Summit Europe 2014: Apache Storm Architecture
P. Taylor Goetz
 
Postgres Vienna DB Meetup 2014
Michael Renner
 
BD-zero lecture.pptx
vishal choudhary
 
EX-6-Implement Matrix Multiplication with Hadoop Map Reduce.pptx
vishal choudhary
 
Hadoop MapReduce Introduction and Deep Insight
Hanborq Inc.
 
Testing Hadoop jobs with MRUnit
Eric Wendelin
 
An Introduction To PostgreSQL Triggers
Jim Mlodgenski
 
Monitoring InfluxEnterprise
InfluxData
 
Moving In: how to port your content from * to Drupal
Emma Jane Hogbin Westby
 
An introduction to Test Driven Development on MapReduce
Ananth PackkilDurai
 
MAVRL Workshop 2014 - pymatgen-db & custodian
University of California, San Diego
 
Big data unit iv and v lecture notes qb model exam
Indhujeni
 
Hive User Meeting August 2009 Facebook
ragho
 
Ad

Viewers also liked (15)

PDF
Душевые кабины Friges – Приложение 5 от Stockist Italy
P.L.T. Forniture Industriali S.r.l.
 
PDF
13CSP
Nicholas Banahene
 
PPTX
Daniela vrnoga
Daniela Vrnoga
 
PDF
Reference Enquiry Form Kim 210568
Kim Kj
 
PDF
Eng Council CEng
Peter Mulholland
 
PPTX
Mule esb with amazon s3 Integration
sivachandra mandalapu
 
PPTX
Integration with dropbox using mule esb
sivachandra mandalapu
 
PPTX
Overview of GST
Mitesh Katira
 
PDF
Laudo de tcnicod e vistoria predial
Wallace Stanford
 
PPTX
Children’s book
bobbiehaslam
 
PDF
Apostila engenharia civil concreto armado recomendacoes
Edson D. Vizentin
 
PDF
EENA 2016 - Customer service in a PSAP (2/3)
EENA (European Emergency Number Association)
 
PPTX
Cadbury marketing stratergy
Payal Golui
 
PPTX
7aloulaaaaaaaa projet final
hala youness
 
PPTX
Les instruments musicales
hala youness
 
Душевые кабины Friges – Приложение 5 от Stockist Italy
P.L.T. Forniture Industriali S.r.l.
 
13CSP
Nicholas Banahene
 
Daniela vrnoga
Daniela Vrnoga
 
Reference Enquiry Form Kim 210568
Kim Kj
 
Eng Council CEng
Peter Mulholland
 
Mule esb with amazon s3 Integration
sivachandra mandalapu
 
Integration with dropbox using mule esb
sivachandra mandalapu
 
Overview of GST
Mitesh Katira
 
Laudo de tcnicod e vistoria predial
Wallace Stanford
 
Children’s book
bobbiehaslam
 
Apostila engenharia civil concreto armado recomendacoes
Edson D. Vizentin
 
EENA 2016 - Customer service in a PSAP (2/3)
EENA (European Emergency Number Association)
 
Cadbury marketing stratergy
Payal Golui
 
7aloulaaaaaaaa projet final
hala youness
 
Les instruments musicales
hala youness
 
Ad

Similar to How to use batch component (20)

PPTX
How to use database component using stored procedure call
prathyusha vadla
 
PPTX
J unit
Durga Prasad Kakarla
 
PPTX
Junit in mule
Sunil Komarapu
 
PPTX
Junit in mule
F K
 
PPTX
Junit in mule
AbdulImrankhan7
 
PPTX
Junit in mule demo
javeed_mhd
 
PDF
Data herding
unbracketed
 
PDF
Data herding
unbracketed
 
PPTX
For each component
F K
 
PPTX
For each component
Sunil Komarapu
 
PPTX
For each component in mule
javeed_mhd
 
PPTX
For each component
AbdulImrankhan7
 
PPTX
For each component in mule
Rajkattamuri
 
PPTX
Hadoop cluster performance profiler
Ihor Bobak
 
PPTX
For Each Component
Durga Prasad Kakarla
 
PDF
PaaSTA: Autoscaling at Yelp
Nathan Handler
 
PPTX
How to use for each component
maheshtheapex
 
PPTX
Reference exception strategy
sivachandra mandalapu
 
PDF
TYPO3 Scheduler
Krystian Szymukowicz
 
PPTX
Enjoy Munit with Mule
Bui Kiet
 
How to use database component using stored procedure call
prathyusha vadla
 
J unit
Durga Prasad Kakarla
 
Junit in mule
Sunil Komarapu
 
Junit in mule
F K
 
Junit in mule
AbdulImrankhan7
 
Junit in mule demo
javeed_mhd
 
Data herding
unbracketed
 
Data herding
unbracketed
 
For each component
F K
 
For each component
Sunil Komarapu
 
For each component in mule
javeed_mhd
 
For each component
AbdulImrankhan7
 
For each component in mule
Rajkattamuri
 
Hadoop cluster performance profiler
Ihor Bobak
 
For Each Component
Durga Prasad Kakarla
 
PaaSTA: Autoscaling at Yelp
Nathan Handler
 
How to use for each component
maheshtheapex
 
Reference exception strategy
sivachandra mandalapu
 
TYPO3 Scheduler
Krystian Szymukowicz
 
Enjoy Munit with Mule
Bui Kiet
 

More from sivachandra mandalapu (20)

PPTX
Mock component in munit
sivachandra mandalapu
 
PPTX
Jms selector
sivachandra mandalapu
 
PPTX
Sftplite
sivachandra mandalapu
 
PPTX
Object store
sivachandra mandalapu
 
PPTX
How to use SFTP
sivachandra mandalapu
 
PPTX
How to use secure property placeholder
sivachandra mandalapu
 
PPTX
Specifying a default exception strategy
sivachandra mandalapu
 
PPTX
Defining global exception strategies
sivachandra mandalapu
 
PPTX
Validate json schema
sivachandra mandalapu
 
PPTX
Validation
sivachandra mandalapu
 
PPTX
Property place holder
sivachandra mandalapu
 
PPTX
Collection aggregator
sivachandra mandalapu
 
PPTX
Cloud hub deployment
sivachandra mandalapu
 
PPTX
Securing api with_o_auth2
sivachandra mandalapu
 
PPTX
Deployment options for mule applications
sivachandra mandalapu
 
PPTX
Setting up organization with api access
sivachandra mandalapu
 
PPTX
API gateway setup
sivachandra mandalapu
 
PPTX
Splitter
sivachandra mandalapu
 
PPTX
Expression
sivachandra mandalapu
 
PPTX
Bean as Datasource
sivachandra mandalapu
 
Mock component in munit
sivachandra mandalapu
 
Jms selector
sivachandra mandalapu
 
Sftplite
sivachandra mandalapu
 
Object store
sivachandra mandalapu
 
How to use SFTP
sivachandra mandalapu
 
How to use secure property placeholder
sivachandra mandalapu
 
Specifying a default exception strategy
sivachandra mandalapu
 
Defining global exception strategies
sivachandra mandalapu
 
Validate json schema
sivachandra mandalapu
 
Validation
sivachandra mandalapu
 
Property place holder
sivachandra mandalapu
 
Collection aggregator
sivachandra mandalapu
 
Cloud hub deployment
sivachandra mandalapu
 
Securing api with_o_auth2
sivachandra mandalapu
 
Deployment options for mule applications
sivachandra mandalapu
 
Setting up organization with api access
sivachandra mandalapu
 
API gateway setup
sivachandra mandalapu
 
Splitter
sivachandra mandalapu
 
Expression
sivachandra mandalapu
 
Bean as Datasource
sivachandra mandalapu
 

Recently uploaded (20)

PPTX
Final Presentation General Medicine 03-08-2024.pptx
ZaheerAhmad228692
 
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
home
 
PDF
Classroom Observation Tools for Teachers
Nicaramirez
 
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
Nitin Suresh
 
PPTX
History, Philosophy and sociology of education (1).pptx
tmdth1
 
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
MilindKhedekar2
 
PDF
advance database management system book.pdf
hinamannan364
 
PPTX
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
Samruddhi Khonde
 
PPTX
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
Nitin Suresh
 
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
ArchitectAFMMohiuddi
 
PPTX
Lesson notes of climatology university.
sgladness67
 
PPTX
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
greciamaycalambro
 
PDF
1_English_Language_Set_2.pdf probationary
emailjagmeetsingh9
 
PDF
Empowerment Technology for Senior High School Guide
solthereseamericandr
 
PDF
Weekly quiz Compilation Jan -July 25.pdf
Nitin Suresh
 
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
S LS
 
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
JericEstaco2
 
PPTX
Radiologic_Anatomy_of_the_Brachial_plexus [final].pptx
atiaruhi95
 
PDF
Indian roads congress 037 - 2012 Flexible pavement
offersjackpot
 
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
DrBincy A. S
 
Final Presentation General Medicine 03-08-2024.pptx
ZaheerAhmad228692
 
202450812 BayCHI UCSC-SV 20250812 v17.pptx
home
 
Classroom Observation Tools for Teachers
Nicaramirez
 
Chinmaya Tiranga quiz Grand Finale.pdf
Nitin Suresh
 
History, Philosophy and sociology of education (1).pptx
tmdth1
 
Practical Manual AGRO-233 Principles and Practices of Natural Farming
MilindKhedekar2
 
advance database management system book.pdf
hinamannan364
 
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
Samruddhi Khonde
 
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
Nitin Suresh
 
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
ArchitectAFMMohiuddi
 
Lesson notes of climatology university.
sgladness67
 
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
greciamaycalambro
 
1_English_Language_Set_2.pdf probationary
emailjagmeetsingh9
 
Empowerment Technology for Senior High School Guide
solthereseamericandr
 
Weekly quiz Compilation Jan -July 25.pdf
Nitin Suresh
 
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
S LS
 
A powerpoint presentation on the Revised K-10 Science Shaping Paper
JericEstaco2
 
Radiologic_Anatomy_of_the_Brachial_plexus [final].pptx
atiaruhi95
 
Indian roads congress 037 - 2012 Flexible pavement
offersjackpot
 
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
DrBincy A. S
 

How to use batch component

  • 1. How to use Batch component 28-05-2015
  • 2. Abstract • The main motto of this PPT is How to use Batch component in our applications.
  • 3. Introduction • Mule possesses the ability to process messages in batches. Within an application, you can initiate a batch job which is a block of code that splits messages into individual records, performs actions upon each record, then reports on the results and potentially pushes the processed output to other systems or queues. This functionality is particularly useful when working with streaming input or when engineering "near real-time" data integration between SaaS applications.
  • 5. .mflow • <?xml version="1.0" encoding="UTF-8"?> • <mule xmlns:tracking="http://www.mulesoft.org/schema/mule/ee/tracking" xmlns:db="http://www.mulesoft.org/schema/mule/db" xmlns:batch="http://www.mulesoft.org/schema/mule/batch" xmlns:http="http://www.mulesoft.org/schema/mule/http" xmlns="http://www.mulesoft.org/schema/mule/core" xmlns:doc="http://www.mulesoft.org/schema/mule/documentation" • xmlns:spring="http://www.springframework.org/schema/beans" • xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" • xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-current.xsd • http://www.mulesoft.org/schema/mule/core http://www.mulesoft.org/schema/mule/core/current/mule.xsd • http://www.mulesoft.org/schema/mule/http http://www.mulesoft.org/schema/mule/http/current/mule-http.xsd • http://www.mulesoft.org/schema/mule/batch http://www.mulesoft.org/schema/mule/batch/current/mule-batch.xsd • http://www.mulesoft.org/schema/mule/db http://www.mulesoft.org/schema/mule/db/current/mule-db.xsd • http://www.mulesoft.org/schema/mule/ee/tracking http://www.mulesoft.org/schema/mule/ee/tracking/current/mule-tracking-ee.xsd"> • <http:listener-config name="HTTP_Listener_Configuration" host="0.0.0.0" port="8089" doc:name="HTTP Listener Configuration"/> • <db:generic-config name="Generic_Database_Configuration" url="jdbc:sqlserver://localhost:1433;databaseName=SOA_VMES_DB;user=****;password=****;" driverClassName="com.microsoft.sqlserver.jdbc.SQLServerDriver" doc:name="Generic Database Configuration"/> • <batch:job name="SampleBatch" max-failed-records="-1"> • <batch:process-records> • <batch:step name="Batch_Step"> • <logger message="--Batch step--#[payload]--" level="INFO" doc:name="Logger"/> • <foreach doc:name="For Each"> • <logger message="--for each--batch step--#[payload]" level="INFO" doc:name="Logger"/> • <choice doc:name="Choice"> • <when expression="#[payload==5]"> • <db:update config-ref="Generic_Database_Configuration" doc:name="Database"> • <db:parameterized-query><![CDATA[update mytable22 set status='successsuccesssuccesssuccesssuccesssuccess' where num=#[payload]]]></db:parameterized-query> • </db:update> • </when> • <otherwise> • <db:update config-ref="Generic_Database_Configuration" doc:name="Database"> • <db:parameterized-query><![CDATA[update mytable22 set status='Success' where num=#[payload]]]></db:parameterized-query> • </db:update> • </otherwise> • </choice> • </foreach> • </batch:step>
  • 6. • <batch:step name="Batch_Step1" accept-policy="ONLY_FAILURES"> • <logger message="--step1--#[payload]" level="INFO" doc:name="Logger"/> • <foreach doc:name="For Each"> • <logger message="--for each--batch step1--#[payload]--" level="INFO" doc:name="Logger"/> • <db:update config-ref="Generic_Database_Configuration" doc:name="Database"> • <db:parameterized-query><![CDATA[update mytable22 set status='batch fail' where num=#[payload]]]></db:parameterized-query> • </db:update> • </foreach> • </batch:step> • </batch:process-records> • <batch:on-complete> • <logger message="--complete--#[message.payload]" level="INFO" doc:name="Logger"/> • </batch:on-complete> • </batch:job> • <flow name="SampleFlow"> • <http:listener config-ref="HTTP_Listener_Configuration" path="/*" doc:name="HTTP"/> • <logger level="INFO" doc:name="Logger" message="--Hai"/> • <expression-component doc:name="Expression"><![CDATA[import java.util.List; • import java.util.Map; • import java.util.ArrayList; • import java.util.HashMap; • List l1 = new ArrayList(); • Map m2 = new HashMap(); • m2.put("b","2"); • m2.put("c","3"); • l1.add(m2); • Map m1 = new HashMap(); • m1.put("a","1"); • l1.add(m1); • Map m4 = new HashMap(); • m4.put("e","5"); • l1.add(m4); • Map m3 = new HashMap(); • m3.put("d","4"); • l1.add(m3); • payload = l1; • return payload;]]></expression-component> • <logger message="--main flow--#[payload]" level="INFO" doc:name="Logger"/> • <batch:execute name="SampleBatch" doc:name="SampleBatch"/> • </flow> • </mule>
  • 7. • Output: • Data in DB: • Before execute: After execute:
  • 8. • INFO 2016-05-28 18:51:48,882 [main] org.mule.module.launcher.MuleDeploymentService: • ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ • + Started app 'Sample' + • ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ • INFO 2016-05-28 18:51:48,886 [main] org.mule.module.launcher.DeploymentDirectoryWatcher: • ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ • + Mule is up and kicking (every 5000ms) + • ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ • INFO 2016-05-28 18:51:49,040 [main] org.mule.module.launcher.StartupSummaryDeploymentListener: • ********************************************************************** • * - - + DOMAIN + - - * - - + STATUS + - - * • ********************************************************************** • * default * DEPLOYED * • ********************************************************************** • ******************************************************************************************************* • * - - + APPLICATION + - - * - - + DOMAIN + - - * - - + STATUS + - - * • ******************************************************************************************************* • * Sample * default * DEPLOYED * • ******************************************************************************************************* • INFO 2016-05-28 18:51:53,201 [[Sample].HTTP_Listener_Configuration.worker.01] org.mule.api.processor.LoggerMessageProcessor: --Hai • INFO 2016-05-28 18:51:53,253 [[Sample].HTTP_Listener_Configuration.worker.01] org.mule.api.processor.LoggerMessageProcessor: --main flow--[{b=2, c=3}, {a=1}, {e=5}, {d=4}] • INFO 2016-05-28 18:51:53,354 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.DefaultBatchEngine: Created instance dc959d50-24fc-11e6-b3de- 30d420524153 for batch job SampleBatch • INFO 2016-05-28 18:51:53,359 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.DefaultBatchEngine: Batch job SampleBatch has no input phase. Creating job instance • INFO 2016-05-28 18:51:53,383 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.queue.BatchQueueLoader: Starting loading phase for instance 'dc959d50-24fc-11e6-b3de-30d420524153' of job 'SampleBatch' • INFO 2016-05-28 18:51:53,548 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.queue.BatchQueueLoader: Finished loading phase for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch. 4 records were loaded • INFO 2016-05-28 18:51:53,562 [[Sample].HTTP_Listener_Configuration.worker.01] com.mulesoft.module.batch.engine.DefaultBatchEngine: Started execution of instance 'dc959d50- 24fc-11e6-b3de-30d420524153' of job 'SampleBatch' • INFO 2016-05-28 18:51:53,711 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --Batch step--{b=2, c=3}-- • INFO 2016-05-28 18:51:53,713 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step--2 • INFO 2016-05-28 18:52:00,519 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step--3 • INFO 2016-05-28 18:52:00,605 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --Batch step--{a=1}-- • INFO 2016-05-28 18:52:00,605 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step--1 • INFO 2016-05-28 18:52:00,617 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --Batch step--{e=5}-- • INFO 2016-05-28 18:52:00,617 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step--5 • INFO 2016-05-28 18:52:02,765 [batch-job-SampleBatch-work-manager.01] com.mulesoft.module.batch.DefaultBatchStep: Found exception processing record on step 'Batch_Step' for job instance 'dc959d50-24fc-11e6-b3de-30d420524153' of job 'SampleBatch'. • This is the first record to show this exception on this step for this job instance. Subsequent records with the same failureswill not be logged for performance and log readability reasons:
  • 9. • ******************************************************************************** • Message : String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException). Message payload is of type: String • Type : org.mule.api.MessagingException • Code : MULE_ERROR--2 • Payload : 5 • JavaDoc : http://www.mulesoft.org/docs/site/current3/apidocs/org/mule/api/MessagingException.html • ******************************************************************************** • Exception stack is: • 1. String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException) • com.microsoft.sqlserver.jdbc.SQLServerException:216 (null) • 2. String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException). Message payload is of type: String (org.mule.api.MessagingException) • org.mule.module.db.internal.processor.AbstractDbMessageProcessor:93 (http://www.mulesoft.org/docs/site/current3/apidocs/org/mule/api/MessagingException.html) • ******************************************************************************** • Root Exception stack trace: • com.microsoft.sqlserver.jdbc.SQLServerException: String or binary data would be truncated. • at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:216) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1515) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:404) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:350) • at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:5696) • at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1715) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:180) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:155) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeUpdate(SQLServerPreparedStatement.java:314) • at org.mule.module.db.internal.domain.autogeneratedkey.NoAutoGeneratedKeyStrategy.executeUpdate(NoAutoGeneratedKeyStrategy.java:55) • at org.mule.module.db.internal.domain.executor.UpdateExecutor.doExecuteQuery(UpdateExecutor.java:43) • at org.mule.module.db.internal.domain.executor.AbstractSingleQueryExecutor.execute(AbstractSingleQueryExecutor.java:48) • at org.mule.module.db.internal.processor.UpdateMessageProcessor.doExecuteQuery(UpdateMessageProcessor.java:59) • at org.mule.module.db.internal.processor.AbstractSingleQueryDbMessageProcessor.executeQuery(AbstractSingleQueryDbMessageProcessor.java:42) • at org.mule.module.db.internal.processor.AbstractDbMessageProcessor.process(AbstractDbMessageProcessor.java:66) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.routing.AbstractSelectiveRouter.processEventWithProcessor(AbstractSelectiveRouter.java:303) • at org.mule.routing.AbstractSelectiveRouter.routeWithProcessors(AbstractSelectiveRouter.java:293)
  • 10. • at org.mule.routing.AbstractSelectiveRouter.process(AbstractSelectiveRouter.java:193) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:98) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.routing.outbound.AbstractMessageSequenceSplitter.processParts(AbstractMessageSequenceSplitter.java:129) • at org.mule.routing.outbound.AbstractMessageSequenceSplitter.process(AbstractMessageSequenceSplitter.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule... • ******************************************************************************** • INFO 2016-05-28 18:52:02,768 [batch-job-SampleBatch-work-manager.01] com.mulesoft.module.batch.DefaultBatchStep: Found exception processing record on step 'Batch_Step' for job instance 'dc959d50-24fc-11e6-b3de-30d420524153' of job 'SampleBatch'. • This is the first record to show this exception on this step for this job instance. Subsequent records with the same failureswill not be logged for performance and log readability reasons: • ******************************************************************************** • Message : String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException). Message payload is of type: String • Type : org.mule.api.MessagingException • Code : MULE_ERROR--2 • Payload : 5 • JavaDoc : http://www.mulesoft.org/docs/site/current3/apidocs/org/mule/api/MessagingException.html • ******************************************************************************** • Exception stack is: • 1. String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException) • com.microsoft.sqlserver.jdbc.SQLServerException:216 (null) • 2. String or binary data would be truncated. (com.microsoft.sqlserver.jdbc.SQLServerException). Message payload is of type: String (org.mule.api.MessagingException) • org.mule.module.db.internal.processor.AbstractDbMessageProcessor:93 (http://www.mulesoft.org/docs/site/current3/apidocs/org/mule/api/MessagingException.html) • ******************************************************************************** • Root Exc • com.microsoft.sqlserver.jdbc.SQLServerException: String or binary data would be truncated. • at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:216) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1515) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:404) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:350) • at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:5696) eption stack trace:
  • 11. • at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1715) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:180) • at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:155) • at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeUpdate(SQLServerPreparedStatement.java:314) • at org.mule.module.db.internal.domain.autogeneratedkey.NoAutoGeneratedKeyStrategy.executeUpdate(NoAutoGeneratedKeyStrategy.java:55) • at org.mule.module.db.internal.domain.executor.UpdateExecutor.doExecuteQuery(UpdateExecutor.java:43) • at org.mule.module.db.internal.domain.executor.AbstractSingleQueryExecutor.execute(AbstractSingleQueryExecutor.java:48) • at org.mule.module.db.internal.processor.UpdateMessageProcessor.doExecuteQuery(UpdateMessageProcessor.java:59) • at org.mule.module.db.internal.processor.AbstractSingleQueryDbMessageProcessor.executeQuery(AbstractSingleQueryDbMessageProcessor.java:42) • at org.mule.module.db.internal.processor.AbstractDbMessageProcessor.process(AbstractDbMessageProcessor.java:66) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.routing.AbstractSelectiveRouter.processEventWithProcessor(AbstractSelectiveRouter.java:303) • at org.mule.routing.AbstractSelectiveRouter.routeWithProcessors(AbstractSelectiveRouter.java:293) • at org.mule.routing.AbstractSelectiveRouter.process(AbstractSelectiveRouter.java:193) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:98) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.routing.outbound.AbstractMessageSequenceSplitter.processParts(AbstractMessageSequenceSplitter.java:129) • at org.mule.routing.outbound.AbstractMessageSequenceSplitter.process(AbstractMessageSequenceSplitter.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule.execution.MessageProcessorNotificationExecutionInterceptor.execute(MessageProcessorNotificationExecutionInterceptor.java:107) • at org.mule.execution.MessageProcessorExecutionTemplate.execute(MessageProcessorExecutionTemplate.java:44) • at org.mule.processor.BlockingProcessorExecutor.executeNext(BlockingProcessorExecutor.java:88) • at org.mule.processor.BlockingProcessorExecutor.execute(BlockingProcessorExecutor.java:59) • at org.mule.execution.ExceptionToMessagingExceptionExecutionInterceptor.execute(ExceptionToMessagingExceptionExecutionInterceptor.java:24) • at org.mule... • ********************************************************************************
  • 12. • INFO 2016-05-28 18:52:02,769 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --Batch step--{d=4}-- • INFO 2016-05-28 18:52:02,769 [batch-job-SampleBatch-work-manager.01] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step-- 4 • INFO 2016-05-28 18:52:03,049 [batch-job-SampleBatch-work-manager.01] com.mulesoft.module.batch.DefaultBatchStep: Step Batch_Step finished processing all records for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch • INFO 2016-05-28 18:52:03,095 [batch-job-SampleBatch-work-manager.02] org.mule.api.processor.LoggerMessageProcessor: --step1--{e=5} • INFO 2016-05-28 18:52:03,096 [batch-job-SampleBatch-work-manager.02] org.mule.api.processor.LoggerMessageProcessor: --for each--batch step1--5-- • INFO 2016-05-28 18:52:03,488 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.engine.DefaultBatchEngine: Starting execution of onComplete phase for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch • INFO 2016-05-28 18:52:03,508 [batch-job-SampleBatch-work-manager.02] org.mule.api.processor.LoggerMessageProcessor: --complete-- com.mulesoft.module.batch.ImmutableBatchJobResult@1fa547d1 • INFO 2016-05-28 18:52:03,509 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.engine.DefaultBatchEngine: Finished execution of onComplete phase for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch • INFO 2016-05-28 18:52:03,509 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.engine.DefaultBatchEngine: Finished execution for instance 'dc959d50-24fc-11e6-b3de-30d420524153' of job 'SampleBatch'. Total Records processed: 4. Successful records: 3. Failed Records: 1 • INFO 2016-05-28 18:52:03,511 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.engine.DefaultBatchEngine: • ************************************************************************************************************************* *************************************** • * - - + Exception Type + - - * - - + Step + - - * - - + Count + - - * • ************************************************************************************************************************* *************************************** • * com.mulesoft.module.batch.exception.BatchException * Batch_Step * 1 * • ************************************************************************************************************************* *************************************** • INFO 2016-05-28 18:52:03,524 [batch-job-SampleBatch-work-manager.02] com.mulesoft.module.batch.DefaultBatchStep: Step Batch_Step1 finished processing all records for instance dc959d50-24fc-11e6-b3de-30d420524153 of job SampleBatch
  • 13. • Flow of execution: 1. URL to trigger the service from browser http://localhost:8089 2. a. Service will update the status to ‘Success’ for the records whose num is other than 5 b. It will fail while trying to update the status as ‘successsuccesssuccesssuccesssuccesssuccess’ for the num 5 because the length of the status excides the size of the column. Hence, the failed map will process in Batch_Step1 and will update the status as ‘batch fail’ for the record whose num is 5