InterfaceTechniquesforVEs-ElectricalandComputer.ppt

Multimodal Design Technologies Sidney Fels Overview Introduction Human I/O: A look at the body and mind human information processing Bringing Modalities Together Intimate and Embodied interfaces Summary Introduction Virtual Environments large, medium, and small scale include people Communicating human experience information, emotion, environment people to people people to machine Engagement of Body and Mind Introduction Techniques needed for: sensing, encoding, transmitting, storing, indexing, retrieving, compressing, recognizing and synthesizing Human body has many I/O channels Integrate Cognitive, Physical and Emotional aspects of interaction Interface should disappear Human Information Processing Input Visual channel Auditory channel Position and Motion Sensing Channel Somatic Channel Taste and Smell Channels Output Intentional neuromuscular, movable, verbal Non-intentional GSR, Heart Rate, Brain, Muscle, other Human Information Processing Decisions Tracking Memory Learning Indviduals vs. Groups Driving Trends in Interface Technologies Virtual Reality, Immersive Environments, AR Ubiquitous computing/Intelligent Environments Wearable Computing, Tangible Bits, Games, Arts, Interactive Theatre, Interactive Art WWW, Agents, Collaborative work Visual Channel Senses electromagnetic radiation (wavelength = 0.3-0.7 microns) Cones: fovea (600um), high resolution, independent Rods: periphery, low resolution, integrated 2 eyes for binocular vision 100,000 fixation points (100deg circular) Types of eye movement (six muscles): compensatory (must have target) pursuit (must have target) Tremor, flick and drift saccadic (jump from one fixation to another) Visual Channel Rods and Cones Fovea is all cones (6 million) Periphery is mostly rods (125 million) interleaved Rods activate neurons in groups higher sensitivity less resolution Cones are more one-to-one lower sensitivity more resolution Visual Channel: Movement 8-10Hz gives sensation of motion. 5 ways to make a light