Download PDF
ABSTRACT
Visual experiences by the users have transcended over the years into mixed reality environments. Their visual perception and interaction have been redefined by visual elements in spatial, multisensory, and intelligent environments. This significantly impacted the ways of seeing, sensing and engaging with the interfaces. Since visual interfaces evolved beyond flat screens, user interaction with media is no longer defined solely by visual engagement but by their spatial and sensory experiences withing the intelligent systems. The aim is to examine how gesture, motion, touch, and gaze reshape ways of seeing in multimodal space that merge visual and spatial awareness.
This research proposes a heuristic and semiotic framework to explore the post‑screen visuality. It addresses how users see, interpret, and act through mixed reality (MR) interfaces that integrate gesture, gaze and motion into visual experience. It draws areas of visual culture studies, Human–Computer Interaction (HCI), and media semiotics to investigate the role of new visual grammars and algorithms in mediating what is seen and how users navigate through hybrid digital and physical spaces.
Methodologically, the study employs a mixed approach that combines in-depth visual analysis of MR case studies, semiotic understanding of interaction cues, and qualitative user studies. The goal is to articulate design heuristics for multisensory and accessible post‑screen interfaces. The findings will contribute to both the theoretical debates in visual studies and the practical frameworks of designing future screen interactions in education, culture, and urban media contexts.
Keywords: Visual studies; Interface visuality; Media and Communication; Screen interfaces; Visual Technologies; Ways of looking; User experience (UX); Interaction design; Accessibility; inclusive design; Urban visual culture; AI and Media; New Media Technology; Interactive Media; Augmented Reality; Communication Science; User Experience, Service Design; Technology-Mediated Collaboration