Paper: | MLSP-P3.7 |
Session: | Pattern Recognition |
Time: | Wednesday, May 17, 14:00 - 16:00 |
Presentation: |
Poster
|
Topic: |
Machine Learning for Signal Processing: Signal detection, Pattern Recognition and Classification |
Title: |
Reduced Complexity and Scaling for Asynchronous HMMs in a Bimodal Input Fusion Application |
Authors: |
Marc Al-Hames, Gerhard Rigoll, Technische Universität München, Germany |
Abstract: |
The Asynchronous Hidden Markov Model (AHMM) can model the joint likelihood of two observation sequences, even if the streams are not synchronised. Previously this model has been applied to audio-visual recognition tasks. The main drawback of the concept is its rather high training and decoding complexity. In this work we show how the complexity can be reduced significantly with advanced running indices for the calculations. Yet, the AHMM characteristics and its advantages are preserved. The improvement also allows a scaling procedure to keep numerical values in a reasonable range. In an experimental section we compare the complexity of the original and the improved concept and validate the theoretical results. Then the model is tested on a bimodal speech and gesture user input fusion task: Compared to a late fusion HMM an improvement of more than 10% absolute recognition performance has been achieved. |