To enable more students to receive school education anywhere and enjoy it. There are a large number of children who are absent from school for a long period of time due to truancy or illness.

 

We have developed a remote learning support system using an avatar robot that can act as a substitute for the student. Construction of a system that allows students to remotely control an avatar robot and participate in classes in real time:  

1. Focusing on eye movements that can be performed even by children and students with severe disabilities;
2. The system detects the center of gravity of the operator's pupil and analyzes the direction of gaze;
3. The robot in the classroom controls the gaze according to the direction of the operator's gaze.

​

What are you currently working on to provide a better system for children and students? To increase the sense of realism! Real-time recognition of the facial expressions of children and students operating the avatar robot. A 3D avatar reflecting the expression is displayed on the monitor. For children and students with residual functions in the upper limbs! The robot can be moved by touch input through a tablet or other device. For use by children and students with serious disabilities! In addition to the analysis of eye movements, we use a physiological measurement device to detect muscle potential. Realization of a robot operation mode that predicts the selection and decision based on the occurrence of micro organizing reactions as input triggers.