Niğde Ömer Halisdemir Üniversitesi Mühendislik Bilimleri Dergisi

Yazarlar: Yelda FIRAT, Taşkın UĞURLU

Konular:Bilgisayar Bilimleri, Bilgi Sistemleri

DOI:10.28948/ngumuh.443157

Anahtar Kelimeler:Formal concept analysis,Sign language recognition,Kinect,Contour analysis,Thematic role lattices

Özet: In daily life people interact with each other to communicate their ideas, thoughts and experiences to the people around them. On the other hand, people with hearing and speech impairments are not capable of communicating with their environment in the given sense. Thus, they use sign language to communicate with others. Sign language is a non-universal language that changes depending on the country in which it's being used and enables people with hearing and speech impairments to communicate with other people through hand gestures and facial expressions. In this sense, the aim of the study is to develop Turkish Sign Language translation system that enables communication between people with speech and hearing impairments and healthy people. With this proposed system, the hand movements showing sign language are captured with the help of Kinect device and analyzed with the algorithms used in Contour Analysis. Actual meanings of the words obtained from the analyzed images were found thematic role lattices that are prepared in the frame of Formal Concept Analysis theory. The words of which actual meanings were found are displayed with the sentences in which they were used. Therefore, thanks to this system it is ensured that a disabled person can communicate with a mass crowd. The developed system also aims to contribute to the semantic analysis of the Turkish Language.

---