Database Automation Testing Framework

Hi,

So in my learning journey of Python & Robot Framework I have created many framework related to Web application GUI testing now it's time to create database testing framework. Before jumping into framework let's talk about database testing. Database testing consist following things (According to me):

1. Schema or Structure Testing: This involves structure of database validation. ex: destination database should have same number of tables with it's structure as source database.

2. Data Validation: This involves actual data testing which means destination database data should equally match with source database data.

3. Non-functional Testing: This involves load, stress or you can say performance testing, which basically test how much time it takes to connect to database and how much time it takes to execute query to database.

First let's list out tools which I have used to build this framework.

1. Pandas : To read excel sheet.

2. Robot Framework

3. Microsoft Excel

4. PyCharm IDE

So my framework is basically doing data validation. I have created excel sheet where I have listed queries which need to be fire on databases which will act like a test input data for this framework.

In this framework I am comparing two databases which are in my PostgreSQL RDBMS.

Now let's see the structure of the framework.

CustomLib folder contains Python script which contains functions to read excel sheet content. Results folder is a place where Robot Framework store the result of the execution. TestInputData.Robot file contains keyword related to excel sheet content. MainTestFile.Robot file contains main Robot Framework case.

So following is the flow of my framework:

1. First Framework gather content from excel sheet and store it in list variables.

2. Then First database activity will start.

3. First step will be connect to database

4. Get query and execute on database

5. Then query result store it in CSV file.

6. Then disconnect from database.

7. Steps 2 to 6 are same for second database.

8. Then comparing two CSV files using diff library.

9. Then removing those CSV files.

Here is the Robot Framework report snapshot.

If there is a difference in the file then it will be logged in reports. This framework will compare two databases. Queries listed in excel sheet should have same column in both databases. I have not yet tested with large data set therefore not sure about data limitation. You will find this framework in my GitHub repository.

Cheers!!