Kafka with Spring Batch

Sajith vijesekara
2 min readApr 17, 2020

--

Last couple of days I was working project which required to read kafka Stream & pass to Spring Batch jobs.

For Above Scenario We have to Use spring batch 4.2. It supports KafkaItemReader which can directly pass to spring batch as ItemReader.

Prerequisite

  1. Kafka 2.5.0

2. Spring boot 2.2.6

For Above Solution first need to setup apache kafka with 1 zookeepr instance. Then Create Spring boot Application which need to add these dependencies.

Adding Required Configurations.

Based on spring kafka integration & spring jpa configuration we have to add following configurations.

Step 2. Create Object Class which need to be passed in kafka stream.

Step 3. Create Repositroy Class which need to save data to mysql

Step 4. Write Item Processor & Item Writer classes which need to run spring batch job.

Spring Batch Configuration

We have to add below configuration class which have the all bean configuration for spring batch setup.

And This way We can Start jobs. Then You can see that all the customer data will be saved in mysql database.

If you need any help please put message here or you can contact me here

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

--

--

Sajith vijesekara
Sajith vijesekara

Written by Sajith vijesekara

Technical Lead. Passionate about cloud computing & web security | Freelance Mobile Developer| CKAD | AWS Community Builder 🇱🇰

Responses (2)

Write a response