Multimodal Agent Interface
Mukai, Seki, Nakazawa, Watanuki & Miyoshi (1999)

Graphical agent that responds dynamically to multimodal input:

Image recognition
Speech recognition
Natural language processor

Attempts to responds with similar human nonverbal communication channels (aizuchi)

Nonverbal communication an important part of human communication

Introduction of these properties are hoped to improve 'naturalness' of dialogue

Mukai, Seki, Nakazawa, Watanuki & Miyoshi (1999): Actions - normal, 'at a loss', confusing, bow, question

Agent non-verbally responds using a dynamic and continuous model

Mukai, Seki, Nakazawa, Watanuki & Miyoshi (1999)