Project Supervised by Dr. Brian Mak Awarded Winner of HKUST President's Cup 2019
Undergraduate CSE students Padmanabhan KRISHNAMURTHY and Amrutavarsh Sanganabasappa KINAGI, was awarded President's Cup Winner with their project "Helen - An Accessibility Device for AI-based Lip Reading" under the supervision of Dr. Brian Mak.
Their project, Helen, is an accessibility device that uses deep learning to perform automatic lip reading. Helen consists of a camera connected to a Raspberry Pi that streams video to a remote device running LipNet: a deep learning model that achieves high accuracy on automatic lip reading. It can be designed to be either worn around one's neck or clipped onto one's glasses and the software workflow has been optimized to ensure that the entire process from recording video to obtaining annotations takes no more than 10 seconds.
The HKUST President's Cup is an annual event for undergraduate students of the University to compete for the awards based on outstanding achievements in research and innovation.
Congratulations again to Padmanabhan, Amrutavarsh Sanganabasappa and Dr. Mak!