Leveraging Python - Automating Document Generation

Background

Retrospective analysis and reporting of all quality related data points for large number of products was to be undertaken. This required getting data and information from multiple sources, curate the same and enter into a prescribed format. For each product, information from upto 300 parameters (parameters related OOSs, OOTs, CCFs, Deviations, Market Complaints etc.) would be entered into the prescribed format. A cross functional team was formed to collect, curate and enter the information. Traditionally an excel is used for each product and multiple users enter data into this excel file. Excel file is formatted as per requirements.

Current Process

•      Excel (with multiple sheets) filled by multiple users.

•      Multiple copies of excel

•      Excel formatting issues

•      Missing content during printout

•      Synchronize last minute changes

•      >100 such excels

Solution Design

•      Review multiple existing pdfs.

•      Deconstruct the document into relevant data structures

•      Simultaneously create models and pdf generation toolkit

•      Automate calculations (i.e. calculate totals based on # entries)

•      Iterative design for product

•      Daily meetings (or more than once a day) with end users

•      Acceptance from end users on technical limitations

Technology stack

•      SQLite (database)

•      Django (backend, middleware)

•      Django admin for data entry (front end)

•      Django based templates/views etc. for status and pdf generation (front end)

Solution

•      User interface (browser based) to input relevant data

•      Web page to generate pdf documents (ready for signature)

Benefits

•      20-30% estimated time savings

•      Status page/Tracker automatically generated based on user input

•      Data centric approach – ready for analytics

Secret Ingredient - An invested end user