Image processing and computer vision model to automatically evaluate and grade handwritten mathematical equations

Auto-grading of handwritten mathematical worksheets

This repo is the part of internship project with Bosch/RBEI-EDS2. Aim of this project is to digitize the steps of solving a mathematical equation written by freehand on a paper, validating the steps and final answer of the recognized handwritten lines by maintaining the context.

Workflow

As shown, the overall solution can be divided into the following two parts:

• Workspace Detection module
• Analysis Module

Workspace Detection module is responsible for detecting multiple workspaces in a given sheet of paper using pre-defined markers.

Analysis module is responsible for detecting and localizing characters in lines in any given single workspace, and mathematically analyzing them and then drawing red, green lines depending upon their correctness.

For more detailed description on the workflow see Report.pdf

Example

Each line is corrected separately

1. Green Box represents - Line is correct
2. Red Box represents - Line is incorrect

Target algebraic equation A * X2 + B * Y

Where A = 56, B = 7, X = 3, Y = 13

For more detailed description on the workflow see Report.pdf

To evaluate and test

Example_worksheet.ipynb

Character Recognition

Use this link to download the DCCNN model for OCR part of the analysis pipeline