MIDS Capstone Project Summer 2018

AR Literacy

There is a degree of correlation between poverty and literacy rates given a geographical area. This is an abject, cyclical problem: impoverished areas with poor school systems produce less literate students resulting in less educational funding.

Augmented reality technology combined with machine vision and language techniques can be used to provide a platform that teaches children reading skills using physical books. Each one of the required skills for literacy (phonemes, phonics, vocabulary, comprehension) is a problem that has a well defined solution within the realm of machine learning. However in order to accommodate the target demographic the platform will not require a data connection and will be low cost. In this way we can leverage affordable technology to amplify the effectiveness of literacy instructors but keep the context of the learning appropriate.

If you require video captions for accessibility and this video does not have captions, click here to request video captioning.

Last updated:

October 1, 2019