Speak 4 It

Speaker Name: 
Dr. Patrick Ehlen, AT&T Yellow Pages
Start Time: 
Wednesday, April 6, 2011 - 11:30am
End Time: 
Wednesday, April 6, 2011 - 1:00pm
Location: 
Engineering 2, Room 180
Organizer: 
Professor Marilyn Walker

Abstract

The recent capabilities of mobile devices and the data networks that support them have now made it possible to offer multimodal interaction capabilities to consumers which were previously only available in research prototypes. Speak4it is a consumer-oriented mobile search application that leverages multimodal input (speech and gesture) to allow users to search for local businesses by, for example, asking for information while pointing to an area on a map. While it can be easier for users, supporting multimodal input adds complexity to the contextual factors which must be handled. Starting with some theory from pragmatics and the psychology of conversation, this talk will discuss what some of these complexities are and how they can be handled to improve user experience.