YOU MAWO 3D Face Scanning App for Custom Eyewear
Turning Optician Face Scans Into Production-Ready Files for Custom Glasses
Categories
Healthcare & MedTech
Technologies used
iOS (Swift) | Structure Sensor | FaceID SDK | ARKit
About The Client
YOU MAWO is a German company that offers custom eyewear made with 3D printing. It presents itself as the first 3D printed eyewear company in Europe. Since every pair is made to measure, the company needs accurate facial data before production can start. Its partner opticians collect that data with a 3D face scanning app.
Project Overview
The Project
YOU MAWO asked Sidekick Interactive to improve the 3D scanning tool its opticians used. We developed a new 3D face scanning app, built as a native iPad app, that works with Occipital’s Structure Sensor and records each customer’s face in a way that is more useful for production. We also worked on the first iterations of automatic facial feature measurement and virtual try-on.
The Context
The company already used a 3D scanner app powered by Occipital’s Structure Sensor to offer its range of custom glasses. Opticians used it to scan their customers’ faces. The file it produced could not be used as is, so the production team had to retouch it before going further. This slowed the process down and was a significant cost for the company. Some facial data, such as pupillary distance, was also complex to measure at the time.
Challenges and Technical Constraints for a 3D Face Scanning App
The Challenge
The goal was to improve the productivity of the production team, so it would no longer have to adjust the files produced by opticians. YOU MAWO needed a 3D face scanning app that delivered a complete, correctly aligned file from the start and remained simple enough for opticians to use with their customers.
Constraints
An existing 3D scanner app built on Occipital’s Structure Sensor, whose rendering needed improvement
Scan files that had to be ready to use for the production team, with no retouching
Facial data, such as pupillary distance, that was complex to measure accurately
An app simple enough for opticians to scan their customers’ faces with ease
Our Approach and Solution for Custom Eyewear Scanning
A New iPad App Built Around the Structure Sensor
We developed a new iPad app to improve the rendering of the existing 3D scanner. It was built in Swift, with Occipital’s Structure Sensor 3D scanner, FaceID SDK and ARKit. The production team now receives a complete, ready-to-use file it can work with directly.
Facial Recognition for a Straight, Aligned 3D Model
With new algorithms and facial recognition, we set up an intelligent alignment system. By superimposing photos on the scan, the app recognizes the eyes, chin and ears, so the final 3D model comes out aligned and straight.
Measuring Pupillary Distance and Other Facial Data
Part of the project was research and development. We developed new ways to measure pupillary distance and other facial data that were hard to capture accurately. Overlaying photos on 3D scans made it possible to identify specific points on the 3D model and get a precise measurement.
Augmented Reality for the Eyewear Catalog
After this first step, we developed augmented reality to bring YOU MAWO’s product catalog to life. Through the camera, catalog images turn into video and eyewear models appear in 3D, for a richer and more immersive online shopping experience. Virtual try-on for YOU MAWO glasses was also part of the first iterations we worked on.
Results and Benefits for YOU MAWO's 3D Face Scanning App
Results
Opticians can now scan their customers’ faces with ease, and the files generated by the app are ready to use for the production team. Thanks to the alignment system, the final 3D model is straight and aligned, with no retouching needed before production. The app supports accurate data capture for custom eyewear production and more efficient manufacturing workflows.
Why YOU MAWO Chose Sidekick Interactive for Its 3D Face Scanning App
The company needed an app that could make the most of the Structure Sensor SDK while staying simple for opticians. The project combined native iOS development with research on facial measurement, and our team handled both.
“The You MaWo iPad app clearly captures the ease of use of powerful technology tools. With an application, opticians can scan the faces of their customers with ease. The challenge of the application was to provide a simple and powerful use of the 3D Structure Sensor SDK scanner, and I think we did it well!”
Gregory Cerallo, Co-Founder, Sidekick Interactive
Sidekick Interactive's Expertise in 3D Face Scanning and MedTech Apps
This project reflects our work in 3D scanning. We build 3D face scanning apps and other MedTech tools that connect specialized sensors to native mobile apps and turn raw scans into data production teams can use. Our team combines native iOS development, sensor integration and research on measurement methods.
