MathScribe: An AI-Powered Framework for Handwritten Mathematical Expression Recognition and Solving

  • Unique Paper ID: 177236
  • PageNo: 331-340
  • Abstract:
  • Handwritten mathematical expression recognition and solving remain critical challenges in educational technology and accessibility, necessitating accurate, real-time solutions. This paper introduces MathScribe, a hybrid deep learning framework that combines convolutional neural networks (CNNs) for handwritten character recognition with a symbolic computation engine to parse and solve mathematical expressions, including differentiation and integration. Our system employs a dual-model CNN architecture (VGG16 and ResNet) to extract spatial and hierarchical features from handwritten digits and operators, fused with structural expression parsing for robust interpretation. The processed input is then evaluated using SymPy-based symbolic computation, providing step-by-step solutions. Deployed via a Streamlit web application, MathScribe allows users to upload images or draw expressions in real time, delivering solutions with an accuracy of 98.7% on the MNIST dataset and 94.2% on custom operator benchmarks. Experimental results demonstrate strong performance, with an F1-score of 97.3% and near-perfect ROC-AUC (0.998) for expression recognition. The minimal training-validation loss gap (0.15) confirms generalization efficacy. MathScribe bridges the gap between raw handwritten input and advanced mathematical problem-solving, offering a scalable tool for education and accessibility.

Copyright & License

Copyright © 2026 Authors retain the copyright of this article. This article is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

BibTeX

@article{177236,
        author = {Leni Nikitaa and Revan Bairav S G},
        title = {MathScribe: An AI-Powered Framework for Handwritten Mathematical Expression Recognition and Solving},
        journal = {International Journal of Innovative Research in Technology},
        year = {2025},
        volume = {11},
        number = {12},
        pages = {331-340},
        issn = {2349-6002},
        url = {https://ijirt.org/article?manuscript=177236},
        abstract = {Handwritten mathematical expression recognition and solving remain critical challenges in educational technology and accessibility, necessitating accurate, real-time solutions. This paper introduces MathScribe, a hybrid deep learning framework that combines convolutional neural networks (CNNs) for handwritten character recognition with a symbolic computation engine to parse and solve mathematical expressions, including differentiation and integration. Our system employs a dual-model CNN architecture (VGG16 and ResNet) to extract spatial and hierarchical features from handwritten digits and operators, fused with structural expression parsing for robust interpretation. The processed input is then evaluated using SymPy-based symbolic computation, providing step-by-step solutions. Deployed via a Streamlit web application, MathScribe allows users to upload images or draw expressions in real time, delivering solutions with an accuracy of 98.7% on the MNIST dataset and 94.2% on custom operator benchmarks. Experimental results demonstrate strong performance, with an F1-score of 97.3% and near-perfect ROC-AUC (0.998) for expression recognition. The minimal training-validation loss gap (0.15) confirms generalization efficacy. MathScribe bridges the gap between raw handwritten input and advanced mathematical problem-solving, offering a scalable tool for education and accessibility.},
        keywords = {handwritten recognition, symbolic computation, CNN, real-time processing, mathematical expression solving.},
        month = {April},
        }

Cite This Article

Nikitaa, L., & G, R. B. S. (2025). MathScribe: An AI-Powered Framework for Handwritten Mathematical Expression Recognition and Solving. International Journal of Innovative Research in Technology (IJIRT), 11(12), 331–340.

Related Articles