Oviatt, Björn Schuller, Philip R. Cohen, Daniel Sonntag, Gerasimos Potamianos, Antonio Krüger, editors
www.morganclaypoolpublishers.com
ISBN: 978-1-97000-167-9 hardcover
ISBN: 978-1-97000-164-8 paperback
ISBN: 978-1-97000-165-5 ebook
ISBN: 978-1-97000-166-2 ePub
Series ISSN: 2374-6769 print 2374-6777 electronic
DOIs:
10.1145/3015783 Book
10.1145/3015783.3015784 Preface
10.1145/3015783.3015785 Introduction
10.1145/3015783.3015786 Chapter 1
10.1145/3015783.3015787 Chapter 2
10.1145/3015783.3015788 Chapter 3
10.1145/3015783.3015789 Chapter 4
10.1145/3015783.3015790 Chapter 5
10.1145/3015783.3015791 Chapter 6
10.1145/3015783.3015792 Chapter 7
10.1145/3015783.3015793 Chapter 8
10.1145/3015783.3015794 Chapter 9
10.1145/3015783.3015795 Chapter 10
10.1145/3015783.3015796 Chapter 11
10.1145/3015783.3015797 Chapter 12
10.1145/3015783.3015798 Chapter 13
10.1145/3015783.3015799 Index, Bios, Glossary
A publication in the ACM Books series, #14
Editor in Chief: M. Tamer Özsu, University of Waterloo
First Edition
10 9 8 7 6 5 4 3 2 1
This book is dedicated to our families, whose patience and support sustained the year-long effort required to organize, write, and manage different stages of this multi-volume project.
Contents
Introduction: Scope, Trends, and Paradigm Shift in the Field of Computer Interfaces
Why Multimodal-Multisensor Interfaces Have Become Dominant
Flexible Multiple-Component Tools as a Catalyst for Performance
More Expressively Powerful Tools Are Capable of Stimulating Cognition
One Example of How Multimodal-Multisensor Interfaces Are Changing Today
Insights in the Chapters Ahead
Expert Exchange on Multidisciplinary Challenge Topic
PART I THEORY AND NEUROSCIENCE FOUNDATIONS
Chapter 1 Theoretical Foundations of Multimodal Interfaces and Systems
Sharon Oviatt
1.1 Gestalt Theory: Understanding Multimodal Coherence, Stability, and Robustness
1.2 Working Memory Theory: Performance Advantages of Distributing Multimodal Processing
1.3 Activity Theory, Embodied Cognition, and Multisensory-Multimodal Facilitation of Cognition
Karin H. James, Sophia Vinci-Booher, Felipe Munoz-Rubke
