Abstract:

The recent artificial intelligence (AI) boom and intelligent use of data acquired from various sensors has accelerated the development of technologies needed to realize advanced human-like capabilities in machines. AI technologies have come a long way in accurately perceiving visual scenes and understanding speech. However, one important piece of technology is still missing: natural and context-aware human-machine interaction, where machines understand their surrounding scene from the human perspective and are able to share their understanding with humans using natural language. To bridge this communication gap, we have developed and built a new AI system, called scene-aware interaction, that enables machines to translate their perception and understanding of a scene and respond to it using natural language to interact more effectively with humans. This paper introduces an example application of scene-aware interaction to car navigation systems, which will provide drivers with intuitive route guidance.