Geri Dön

Gesture recognition for human-machine interaction in aviation

Havacılıkta insan-makine etkileşimi için el hareketi sezme

  1. Tez No: 720819
  2. Yazar: TUĞBA ZEYBEK
  3. Danışmanlar: DOÇ. DR. UFUK SAKARYA
  4. Tez Türü: Yüksek Lisans
  5. Konular: Elektrik ve Elektronik Mühendisliği, Havacılık ve Uzay Mühendisliği, Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve Kontrol, Electrical and Electronics Engineering, Aeronautical Engineering, Computer Engineering and Computer Science and Control
  6. Anahtar Kelimeler: Human-Machine Interaction, gesture recognition, spatio-temporal, Support Vector Machine, dominant set clustering, Jest, Kümeleme, Vektör zaman serileri, İnsan-makine ilişkisi, Human-Machine Interaction, gesture recognition, spatio-temporal, Support Vector Machine, dominant set clustering, Gesture, Clustering, Vector time series, Human-machine relationship
  7. Yıl: 2022
  8. Dil: İngilizce
  9. Üniversite: Yıldız Teknik Üniversitesi
  10. Enstitü: Fen Bilimleri Enstitüsü
  11. Ana Bilim Dalı: Aviyonik Mühendisliği Ana Bilim Dalı
  12. Bilim Dalı: Aviyonik Mühendisliği Bilim Dalı
  13. Sayfa Sayısı: Belirtilmemiş.

Özet

With the developing technology, human-machine interaction (HMI) is very significant in aviation, as in every area. Hand gestures are accepted in HMI applications. Because the human hand is quite adept at controlling a device. Gesture recognition problems in HMI also have some problems due to their nature. Not every human performs the same movement in space in the same way. Even the same person cannot perform the same movement in the exact same manner. This complicates the recognition problem. Due to large in-class differences between users, the efficiency of features derived from different sensors is compared in user-independent situations. The spatio-temporal nature of gesture signals is considered for recognition and a simple statistical feature-based approach is presented that works on transformed signals. With this approach, it is time-independent and allows the transition to the energy domain. With the wavelet-based statistical feature method, the size of the new data increases considerably. It becomes difficult to analyze high-dimensional data and to find meaningful data in the data set. Linear dimension reduction techniques are applied to solve the new problem. The scenario created in the motion classes is classified after the combination of dimension reduction and classification techniques. These results are linked to the flight simulator tool. In this thesis study, in cases where the pilots are insufficient for the increasing number of UAVs, the dominant set clustering method is recommended in order to provide UAV control with less trained pilots. This method is flexible as it can be used in both civil and military fields. In critical situations, more than one intermediately trained pilot may act like a well-trained pilot. In other cases, already moderately trained pilots will suffice.

Özet (Çeviri)

With the developing technology, human-machine interaction (HMI) is very significant in aviation, as in every area. Hand gestures are accepted in HMI applications. Because the human hand is quite adept at controlling a device. Gesture recognition problems in HMI also have some problems due to their nature. Not every human performs the same movement in space in the same way. Even the same person cannot perform the same movement in the exact same manner. This complicates the recognition problem. Due to large in-class differences between users, the efficiency of features derived from different sensors is compared in user-independent situations. The spatio-temporal nature of gesture signals is considered for recognition and a simple statistical feature-based approach is presented that works on transformed signals. With this approach, it is time-independent and allows the transition to the energy domain. With the wavelet-based statistical feature method, the size of the new data increases considerably. It becomes difficult to analyze high-dimensional data and to find meaningful data in the data set. Linear dimension reduction techniques are applied to solve the new problem. The scenario created in the motion classes is classified after the combination of dimension reduction and classification techniques. These results are linked to the flight simulator tool. In this thesis study, in cases where the pilots are insufficient for the increasing number of UAVs, the dominant set clustering method is recommended in order to provide UAV control with less trained pilots. This method is flexible as it can be used in both civil and military fields. In critical situations, more than one intermediately trained pilot may act like a well-trained pilot. In other cases, already moderately trained pilots will suffice.

Benzer Tezler

  1. Hand gesture recognition for Turkish sign language using electromyography for human-robot interaction

    İnsan-robot etkileşimi için elektromyografi kullanarak Türk işaret dili için el hareketi tanıma

    MUSTAFA SEDDIQI

    Yüksek Lisans

    İngilizce

    İngilizce

    2021

    Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve Kontrolİstanbul Teknik Üniversitesi

    Bilgisayar Mühendisliği Ana Bilim Dalı

    DOÇ. DR. HATİCE KÖSE

  2. Gesture imitation learning in human-robot interaction

    Taklit yolu ile hareket öğrenme ınsan robot etkileşimi

    ITAUMA ISONG ITAUMA

    Yüksek Lisans

    İngilizce

    İngilizce

    2012

    Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve Kontrolİstanbul Teknik Üniversitesi

    Bilgisayar Mühendisliği Ana Bilim Dalı

    YRD. DOÇ. DR. HATİCE KÖSE-BAĞCİ

  3. Gesture learner machine for recognizing symbols and numbers

    Sembolleri ve sayıları tanıma için hareket öğrenen makine

    CHYA FATAH AZIZ AZIZ

    Yüksek Lisans

    İngilizce

    İngilizce

    2017

    Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve KontrolFırat Üniversitesi

    Yazılım Mühendisliği Ana Bilim Dalı

    PROF. DR. ASAF VAROL

  4. Machine learning techniques for surface electromyography based hand gesture recognition

    Yüzey elektromiyografi temelli el jesti tanıma için makine öğrenmesi teknikleri

    ENGİN KAYA

    Yüksek Lisans

    İngilizce

    İngilizce

    2018

    Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve Kontrolİstanbul Teknik Üniversitesi

    Kontrol ve Otomasyon Mühendisliği Ana Bilim Dalı

    DOÇ. DR. TUFAN KUMBASAR

  5. Development of an end-to-end sign language hand gesture recognition system using novel deep learning methods

    Yeni derin öğrenme yöntemleri kullanılarak uçtan uca bir işaret dili el hareketi tanıma sisteminin geliştirilmesi

    AHMED KASAPBAŞI

    Doktora

    İngilizce

    İngilizce

    2025

    Elektrik ve Elektronik MühendisliğiAnkara Yıldırım Beyazıt Üniversitesi

    Elektrik ve Elektronik Mühendisliği Ana Bilim Dalı

    PROF. DR. HÜSEYİN CANBOLAT