From the course: Building High-Throughput Data Microservices

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Spring Batch with Postgres throughput tuning

Spring Batch with Postgres throughput tuning

From the course: Building High-Throughput Data Microservices

Spring Batch with Postgres throughput tuning

- [Instructor] In this video, I'll do some throughput testing with Spring Batch. The app will read two million payment records from a file that will be inserted into Postgres. I'm running on a Mac computer with 64 gigabytes memory, eight CPU cores in a one terabyte SSD disc drive. I'll use IntelliJ which is my favorite development tool. Let me open up IntelliJ. The source code has already been loaded and all of the source code is available on the GitHub for this course. Now this particular project has many applications listed under the application folders. I'm going to focus on the batching example that reads data from a CSV file to insert into Postgres. I'll open up the batch config which contains most of the code. There is if I scroll down, there's this flat file item reader. This retrieves the data from the CSV file in a given location and it converts each one of the records or the lines in that file to this payment…

Contents