Project Supervised by Dr. Brian Mak Awarded Winner of HKUST President's Cup 2019

From left to right: Padmanabhan KRISHNAMURTHY, CSE UG student; Prof. Wei SHYY, HKUST President; Amrutavarsh Sanganabasappa KINAGI, CSE UG student and Dr. Brian Mak, CSE faculty and supervisor of the project

Undergraduate CSE students Padmanabhan KRISHNAMURTHY and Amrutavarsh Sanganabasappa KINAGI, was awarded President's Cup Winner with their project "Helen - An Accessibility Device for AI-based Lip Reading" under the supervision of Dr. Brian Mak.

Their project, Helen, is an accessibility device that uses deep learning to perform automatic lip reading. Helen consists of a camera connected to a Raspberry Pi that streams video to a remote device running LipNet: a deep learning model that achieves high accuracy on automatic lip reading. It can be designed to be either worn around one's neck or clipped onto one's glasses and the software workflow has been optimized to ensure that the entire process from recording video to obtaining annotations takes no more than 10 seconds.

The HKUST President's Cup is an annual event for undergraduate students of the University to compete for the awards based on outstanding achievements in research and innovation.

Congratulations again to Padmanabhan, Amrutavarsh Sanganabasappa and Dr. Mak!

CSE students Padmanabhan KRISHNAMURTHY and Amrutavarsh Sanganabasappa KINAGI