Towards robust real-world historical handwriting recognition
Abstract
Historical manuscripts embody important witnesses of cultural heritage.In recent years, libraries all over the world have scanned voluminous document collections and often made the scanned page images available online.However, especially for handwritten manuscripts, having a text image is not the same as having access to digital text content.Wouldn't it be great if you type just in a few words on such a website, and then you get into the relevant section of a historical document?Given the current development of advanced artificial-intelligence algorithms and the availability of fast, powerful computers, one would expect that this problem has been solved.However, a perfect translation of the pixel image to a correct Unicode text version of that document is it not generally possible [1], [2].Even modern OCR tools developed by Google, like Tesseract [3], [4] and Google document AI, as well as the well-known Google Book collection of scanned, machine-printed books cannot provide accurate text-recognition results which are acceptable in the detail [5]-[7].This lack of accuracy is especially problematic for documents that are intended for scholarly research, where the demand for accurate transcriptions is high.Even advanced machine-learning methods struggle with the recognition of machine-printed documents when the machine font shapes are complex, e.g., in 'Gothic' [8].Given this state of affairs for the case of machine-printed books one may appreciate that handwriting, with its variation and inherent sloppiness, poses many additional problems.Handwriting recognition by computers therefore is a challenging dynamic field of research in the artificial intelligence domain [9]- [11].The extraordinary performance (99.91% [12]) on the well-known MNIST benchmark data set [13] of handwritten digits may give the impression that artificial-intelligence research has solved the problem of recognizing human handwriting.As we will also explain in the section 1.1, this is not yet the case.Even well-curated 'academic' benchmarks for word recognition such as 'IAM' [14], 'RIMES' [15] and 'GW' [16] yield word-recognition accuracy performances of 95-98%.This means: a word error in every 20-50 words.Such performances are not acceptable for scholarly research in the humanities.For realistic,
Keywords
Not available
Specialisations
Similar theses
- Plant recognition, detection, and counting with deep learning Pornntiwa Pawara · University of Groningen / Centre for Information Technology · 2021
- Multimodal Deep Learning for Driver Monitoring: Integrating EEG and Vision for Robust Drowsiness Detection and Safety Enhancement Ur Rahman, Shams · Dublin City University · 2025
- Automatic speech recognition and machine translation with deep neural networks for open educational resources, parliamentary contents and broadcast media Gonzalo Vicente Garcés Díaz-Munío · Universitat Politècnica de València · 2024
- Self and semi-supervised Learning for vehicle make and model recognition in images Ricardo Nuno Alves Teixeira · 2024
- Deep Learning for Amharic Text-Image Recognition: Algorithm, Dataset and Application Birhanu Hailu Belay · Kaiserslautern University of Technology · 2021
- Zero Shot Learning for Visual Object Recognition with Generative Models Maunil R. Vyas · Arizona State University · 2020
