Nystagmus Recognition

Contributor

• Junho Shin(me)
• Hyunsuk Seong

My role in the team

• Video Preprocessing
• Responsible for code that converts many images into a video.
• Responsible for Pupil Tracker
• Vectorizing the continuous pupil center points.

Technical Stack

• Python
• Pyqt5
• Tensorflow
• Flask
• OpenCV

Overview

• There is a otolith in ear. This senses the movement of a person but If this otolith detached from semicircular canal, It is called Canalithiasis.
• The way to diagnose this disease is to check nystagmus.
• So we developed this software to try to sense nystagmus by AI.

System Architecture

Preview

default.mov

Feedback(reason I failed this project)

• This project's AI accurcy is only 60%...
• The resolution of nystagmus videos which were provided from hospital was lower than my phone camer's resolution.
• lack of performance of school computer for deep learning.