Technology Sharing

한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina

Nanjing UniversityXu Fei(Fei Xu)、Lu Yanqing(Yanqing Lu)、Chen Ye(Ye Chen) and Yuan Songtao from Jiangsu Provincial People's Hospital (Songtao Yuan) team, inNature CommunicationsA paper titled “Frequency-encoded eye tracking smart contact lens for human–machine interaction” was published in the journal Nature Communications. The content of the paper is as follows:

I. Summary

Eye tracking technology enables efficient, natural and easy human-computer interaction by detecting users' eye movements and decoding their attention and intentions.This work proposesA miniature,No feelingBiocompatible smart contact lenses for in situ eye tracking and wireless eye-computer interaction.By adopting a frequency encoding strategy, the chip-free, battery-free contact lens successfully detects eye movements and eyelid closures.By using a time-series eye tracking algorithm, the contact lens has an extremely high angular accuracy of < 0.5°.And achievedVarious eye-computer interaction applications, such as eye-movement painting, snake game, network interaction, pan-tilt camera control, and robot vehicle control.This contact lens is expected to enrich the methods of eye tracking technology and promote the development of human-computer interaction technology.

2. Background

In recent years, the rise of flexible wearable devices has triggered a revolution in the field of human-machine interaction (HMI). Due to their skin-like mechanical properties and miniaturized and lightweight characteristics, they have established a seamless bridge between smart devices and the human body, realizing HMI functions such as tactile perception, voice recognition, gesture recognition, and motion capture. Vision provides 83% of the information when humans perceive the external world. For example, the newly released spatial computing device Apple Vision Pro uses eye tracking technology to detect the user's attention to analyze intentions and cognition, thereby achieving efficient, natural and easy eye-machine interaction. Existing eye tracking devices mainly rely on pupil center corneal reflection technology, but this technology is severely limited by ambient light, camera and light source position, and user eyelids and eyelashes, resulting in poor universality in daily consumer scenarios. Eye tracking technology based on electrooculogram (EOG) uses skin electrodes to collect eye bipolar potential signals with positive cornea and negative retina, but it is easily interfered by muscle electrical signals and has low accuracy.Therefore, there is an urgent need for a wearable and imperceptible eye tracking device to promote the development and application of eye tracking technology in various fields.

In this work, a miniature, sensorless and wireless eye-tracking smart contact lens (SCL) is proposed for eye-computer interaction.The SCL designed using frequency coding strategy and advanced spherical conformal fabrication technology consists of four passive RF tags without chips, with different operating frequencies.The portable scanning card reader is installed on the mirror frame and