All projects

MLOct 2022 – Dec 2022

Hearing the unheard, seeing the unseen

Deep learning project to help detect emergency gestures of sign language

  • Python
  • OpenCV
  • Katna
  • HuggingFace
  • Transformers
  • TensorFlow
  1. DataLong-range sign-language video clips
  2. ModelViT features → BiLSTM
  3. Result96% accuracy · 8 emergency words

About the project

"Hearing the unheard, seeing the unseen" is a transformative deep learning project that I undertook over two months, from October to December 2022. In this endeavor, I developed a remarkable deep learning solution that reached 96% accuracy in classifying long-range video sequences of Indian sign language gestures into eight essential categories of emergency words.

Leveraging state-of-the-art technologies, I utilized a pre-trained Vision Transformer (ViT) for feature extraction and harnessed the power of a BiLSTM network for accurate sequence classification. This project showcased my proficiency in using key tools and frameworks such as Python, OpenCV, Katna, HuggingFace, Keras, and TensorFlow to make a meaningful impact in the field of deep learning and accessibility.