A mobile application using Swift with a team that scans hand-written Python code and compiles the output using OCR for use in teaching programming without having to retype code. Jamie teaches a section of Intro to Computer Science at Rutgers and she asks a lot of her students to handwrite code in preparation for exams. She found it tedious to have the students hand write their code then transfer it over to their computers, so she decided that this would be a great use for students and also those preparing for interviews!
This mobile app takes either a picture or a picture from the gallery of hand-written python code and converts it into runnable python code via Microsoft Azure, compiles it, and displays the results to your phone This project was split into 4 phases. 1) Get a picture of code and color contrast it to black and white (remove the shadows) 2) Pre-process the image to split the code line-by-line and account for accurate tabulation via flask. Pass each line of code into Microsoct Azure for OCR handwriting-to-text. Pass this code back to mobile to verify the converted code. 3) Pass a file via HTTP GET and executes as bash command to compiles and runs the code converted from the image. Uploads a gist to github to be accessible at a later time. ("this is a node.js server that does everything" - Carlin) 4) Display results on mobile. This project currently only supports python because of the difficulties for recognizing hand-written curly braces and other special symbols. We hope to support more languages in the future and implement a better system for recognizing different symbols.
More details of this project can be found on it's Devpost
Let's do a project!