This course lays the foundations for an understanding of multimodal communication between humans and multimodal interaction between humans and machines. We begin by clarifying the basic principles of human-human communication and human-machine interaction. We then describe the processes that occur in humans when they perceive auditory, visual, and tactile signals, and how these perceptions are integrated to form multimodal perception. The signals can be generated and received by machines capable of interacting with humans in limited domains. The design of such machines will be discussed, and the limitations as well as possible solutions to overcome these limitations will be explained.
The course will be delivered in MOOC format. The entire course will be completed through TUB's ISIS course management system. To facilitate learning, videos and other learning materials will be made available through the course management system.
Basic knowledge of information and communication technologies
VL Room: Online
ISIS course: https://isis.tu-berlin.de/course/view.php?id=28037
Registration to ISIS course possible from 21.04.2022.
Please have a look into the course and its structure before the online session on 25th of April at 14:00. All links and information about the course will be provided via ISIS course. During this session we will introduce the general plan of the course and you can ask your questions. The material of the first to weeks will be available for your information at this time.
However, the actual start of the course is on April 25.