Goal
"The goal is to foster fine motor skills and creative confidence in children by seamlessly merging analog drawing with digital interaction."
This is
Lumi
an interactive projection system that brings children's physical crafts to life using augmented reality and storytelling.
My Job's
User Research
Rapid Prototyping
User Interface (UI)
User Experience (UX)
Evolution
Concept & Problem
We identified that many children struggle with fine motor skills and lack creative confidence, often without adequate support at home. To address this, we conceptualized a hybrid solution where traditional crafting is enhanced by digital storytelling, transforming repetitive practice into an immersive game.
Technical Implementation
Technically, we chose Unity for flexible frontend development and implemented ArUco markers for real-time paper tracking. This allowed the system to recognize the paper's position and orientation, ensuring the digital projection remained perfectly synced with the child's physical drawing even when moved.
User Testing
We validated the prototype in primary schools, where the mix of analog and digital play sparked immediate engagement and collaboration among the children. While the core concept worked beautifully, the testing revealed we needed to improve the clarity of the instructions and provide stronger visual feedback for independent use.
Final Vision
The final evolution of the concept envisions Lumi integrated into a standard E27 light bulb socket, functioning as a regular table lamp that 'magically' activates when a story paper is detected. This removes technical friction, allowing children to jump straight back into their creative world whenever they want.
Team Members
Fabian Rafraider
Nils Philipp
Mona Kübelbeck
