Innovation Owner
Miss THITIYA JANKHONG
Student
Details
This project develops an eye-tracking system using the Tobii Eye Tracker 5 to facilitate communication for paralyzed patients. The system features a virtual keyboard, synthetic speech generation, LINE notifications, and a data dashboard to improve patient-caregiver interaction.
This project aims to design and develop an eye-tracking system to facilitate communication for paralyzed immobile patients. The system is designed to enable patients to convey their needs to caregivers or family members by detecting and tracking eye movements using the Tobii Eye Tracker 5 device. This approach serves as an alternative communication method, replacing the physical movement or speech of paralyzed patients. The system effectively detects and tracks eye movements at a distance of 55 to 85 centimeters and is designed for installation on a computer to ensure ease of use.
The program interface consists of three main sections:
- (1) A set of emotions
- (2) A set of needs
- (3) A set of additional needs
It supports input from a virtual keyboard in both Thai and English and allows users to specify additional needs through eye-tracking-enabled typing. Furthermore, the system can generate synthetic speech for text that is difficult to pronounce aloud, send notification messages via the Line application, and store usage data in a database presented in a dashboard format. System testing revealed that the optimal detection distance ranges from 65 to 75 centimeters, as this range yields an error rate of no more than 1 percent. The system accurately responds to eye movements for communication through sound within 3 seconds when interacting with various function buttons.
Objective
The objectives include studying paralyzed patient needs, designing an eye-tracking system using Tobii Eye Tracker and Unity, and implementing data logging via Google Sheets for visualization on Google Looker.
- To study the types of paralyzed patients, their symptoms, needs, and behaviors.
- To study the design of an eye-tracking system to assist communication for paralyzed patients who cannot move their bodies.
- To study and apply the Tobii Eye Tracker sensor.
- To study and apply the Unity program to create an eye-tracking system via a User Interface (UI).
- To study data transmission using HTTP requests to record data in Google Sheets and display it on a Dashboard via Google Looker.