Technical Name |
Augmented Reality SDK for Real Time Image Target Recognition and 3D Object Tracking |
Project Operator |
National Taipei University |
Project Host |
林道通 |
Summary |
The project is a cross-platform AR SDK that allows creating an AR application prototype in a matter of minutes. The AR SDK uses Unity 3D to add new targets, compile mobile applications, and render 3D scenes. The AR SDK allows using planar objects and objects of random shapes as targets for AR experience. Our AR SDK provides simultaneous detection and tracking of multiple targets and allows displaying 3D scenes (any number of 3D models and rendering effects), 2D images, or text on AR targets. The detection and tracking algorithm can run in real-time on mobile phones with 640x480 and 1280x720 camera resolutions and provides state-of-the-art AR experience. In comparison to one of the most popular AR framework Vuforia, our detection of planar objects is more stable (without spatial jitter) even for small objects with poor features. For AR developers, our SDK provides a user-friendly interface and API with AR-related events to create an interactive AR experience. |
Scientific Breakthrough |
The project is a cross-platform AR SDK for image targets and 3D objects tracking. The AR SDK provides a user-friendly interface to add new targets to the system. It allows rendering animated 3D models, 2D images, or text information on real objects. For planar objects, the AR SDK needs an image of the object. For objects of random shape, the AR SDK needs multiple photos (or video) of the object from different points of view. The AR framework uses structure from motion approach to generate data necessary for AR functions. Our AR SDK allows simultaneous detection and tracking of multiple targets in real-time. The AR SDK interface allows creating an AR application prototype in a matter of minutes and developers can create interactive AR experience using its API. |
Industrial Applicability |
Our AR SDK provides a user-friendly interface for developers of AR applications and seamless AR experience for customers. This AR SDK can be applied to Multimedia Industry, Digital Contents Production, Game Development Industry, etc. |
Keyword |
Augmented reality Planar object tracking 3D object tracking Cross-platform AR applications AR development Mobile AR |