Quality and Usability

Dialog

Goal

Building and evaluating interactive dialog systems and conversational interfaces.

    Approach

    • Developing empirical and simulation based method for usability engineering of dialog system
    • Using Machine Learning, Artificial Intelligence, and Large Language Models for understanding and generation of natural language
    • Training of dialog management using reinforcement learning
    • Studying user behavior in speech and language base human machine interaction

    Teaching

    • Speech Communication
    • Seminar Machine Learning and AI for Dialog Systems
    • Study Projects, e.g., Escape Room Chatbot Challenge

    Projects

      Past Projects

      • OKS - Optimierung konversationeller Sprachschnittstellen (BMBF) [2018 - 2020]
      • Simulation of Conversational Behavior During Impaired Speech Transmissions (DFG) [2017 - 2019]
      • OurPuppet: Pflegeunterstützung mit einer interaktiven Puppe für informell Pflegende [2016 - 2019]
      • Approaches to Spoken Dialog Management (DTAG) [2018 - 2019]
      • Nautilus Speaker Characterization Corpus [2018]
      • Detection of Speaker Personality and Likability (DFG) [2015 - 2018]
      • STEAK: Spatial TelephonE conferencing for AsterisK (BMBF) [2016]
      • TTS Corporate Voice [2014 - 2015]
      • Universal Home Control Interfaces@ConnectedUsability [2013 - 2015]
      • Likeability (DFG) [2012 - 2015]
      • Speaker Recognition and Speaker Characterization through different Communication Channels [2011 - 2015]
      • Multimodal Extension for Entertain (MEX) [2013]
      • Anomaly Detection and Early Warning Systems [2013]
      • Vocalytics & SWYM [2012 - 2013]
      • Connected Life and Drive [2010 - 2013]
      • TTS Evaluation [2010 - 2013]
      • Affect-based Indexing [2010 - 2012]
      • Superior User Experience Modeling [2011 - 2012]
      • Smart Senior [2009 - 2012]
      • UserModel (DFG) [2010 - 2011]
      • MagiTact [2010 - 2011]
      • Hierarchical Multimodal Interfaces [2009 - 2011]
      • Intelligent Customer Self Service (ICSS) [2009 - 2011]
      • SpeechEval (EFRE) [2008 - 2011]
      • Thinking Head (ARC/NH & MRC) [2007 - 2011]
      • Automatic Usability Engineering Methods [2009 - 2010]
      • User Experience Quantification [2009 - 2010]
      • Universal Telecommunications Interface [2009 - 2010]
      • mmEVAL (DFG) [2008 - 2010]
      • Multimedia Content Retrieval [2008 - 2010]
      • Acoustic Massive Multichannel Systems [2008 - 2010]
      • CopperCoin [2008 - 2009]
      • Usability Modelling and Prediction [2007 - 2008]
      • Recognition of Mobile and Rich Speech (MARS) [2007 - 2008]
      • VoiceNotes [2007 - 2008]
      • MeMo [2006 - 2008]
      • Universal Telecommunication Interface (UTI) [2009 - 2007]
      • Attentive Displays
      • Multidimensional Quality of Speech
      • Predicting the Perceived Quality of Audiovisual Speech (Perc Qual AVS)
      • SmileyMap

      Topics

      • Usability engineering of dialog systems
      • Modular chatbot system
      • Large Language Models NLU and NLG
      • AI assisted human-human chat
      • Spoken dialog systems in the health domain