We are cooking a prototype. An assembly assistance in augmented reality with a 3D object recognition using machine learning.
At each steps we give some instructions in augmented reality, the machine learning model checks in real time that the assembly is correct
Tech : Occulus , depth camera ZED mini, Unity and a 3D match using the Yolo machine learning capabilities
OUR ROLE AND ACHIEVEMENTS
Development of the application : Unity , C#
Development of the machine learning for 3D object recognition, using Yolo tool.
Set up of the hardware : ZED Mini (3D depth camera) + Occulus Rift
Developments : Antoine Vanel and Valentin Rouquet