BioFace-3D: Continuous 3D Facial Reconstruction and User Authentication Through Single Earpiece Biosensor
The Problem
Camera based facial expression analysis requires users to be confined to a particular location and face a camera, hindering their practicality when the user is in motion or in poor lighting conditions. Moreover, traditional VR authentication schemes are not only inconvenient but also vulnerable to potential side-channel attacks.
The Solution
Researchers at the University of Tennessee and University of Texas, Arlington, have designed a single earpiece biosensor that can continuously and reliably sense facial movement, track 2D facial landmarks, and render 3D facial animations without visual input. Additionally, the technology is also capable of capturing both behavioral aspects, such as facial gestures, and physiological traits for two-factor authentication. This technology accurately identifies 53 facial landmarks with minimal error.
It delivers seamless, continuous 3D facial rendering and convenient authentication, resulting in a captivating virtual reality experience. This technology can be used for improved VR/AR human computer interaction, user authentication, smart home, and disability equipment integration.
Benefits
| Benefit |
|---|
| Unobtrusive, continuous, and reliable sensing without visual inputs |
| Tracks entire facial movement and 2D facial landmarks |
| Renders smooth and continuous 3D facial animations |
| Lightweight single earpiece design |
| 53 major facial landmarks recognized with low error rate |
| Incorporating user authentication alongside facial tracking |
More Information
- Gregory Sechrist, JD
- Associate Technology Manager, Multi Campus Office
- 865-974-1882 | gsechris@tennessee.edu
- UTRF Reference ID: 22046
- Patent Status: Patent Pending
Innovators
Dr. Jian Liu
Assistant Professor, Department of Electrical Engineering and Computer Science at the University of Tennessee
Dr. Liu is the director of the Mobile Sensing and Intelligence Security (MoSIS) Lab at the University of Tennessee, Knoxville. His research focuses on robust and trustworthy AI, computational sensing, system security, and smart healthcare.
Read more about Dr. Jian LiuDr. VP Nguyen
Assistant Professor; Director, Wireless & Sensor Systems Laboratory, College of Information & Computer Sciences, Institute for Applied Life Sciences, University of Massachusetts Amherst
Dr. Nguyen is the director of the Wireless and Sensor Systems Laboratory at the University of Massachusetts Amherst. His research interests are mobile/wearable computing, wireless networking, and embedded systems. He previously worked at UT Arlington.
Read more about Dr. VP Nguyen