Logotype Mälardalenn University

MRTC publications



A General Framework for Incremental Processing of Multimodal Inputs

Full text:  
Authors: Afshin Ameri E., Batu Akan, Baran Çürüklü, Lars Asplund
Source: International Conference on Multimodal Interaction - ICMI 2011, p 225-228, ACM New York, Alicante
 

Abstract

Humans employ different information channels (modalities) such as speech, pictures and gestures in their commu- nication. It is believed that some of these modalities are more error-prone to some specific type of data and therefore multimodality can help to reduce ambiguities in the interaction. There have been numerous efforts in implementing multimodal interfaces for computers and robots. Yet, there is no general standard framework for developing them. In this paper we propose a general framework for implementing multimodal interfaces. It is designed to perform natural language understanding, multi- modal integration and semantic analysis with an incremental pipeline and includes a multimodal grammar language, which is used for multimodal presentation and semantic meaning generation.
 

BibTeX entry

@inproceedings{Ameri_2582:2011,
   author = {Afshin Ameri E. and Batu Akan and Baran {\c{C}}{\"u}r{\"u}kl{\"u} and Lars Asplund},
   title = {A General Framework for Incremental Processing of Multimodal Inputs},
   booktitle = {International Conference on Multimodal Interaction - ICMI 2011},
   month = {November},
   year = {2011},
   pages = {225-228},
   publisher = {ACM New York},
   url = {http://www.mrtc.mdh.se/index.php?choice=publications&id=2582},
}

  • Mälardalen University |
  • Box 883 |
  • 721 23 Västerås/Eskilstuna |
  • 021-101300, 016-153600 |
  • webmaster |
  • Latest update: 2012.08.24