Designing Interaction with Immersive Visualization for General Public

The Hong Kong University of Science and Technology
Department of Computer Science and Engineering


PhD Thesis Defence


Title: "Designing Interaction with Immersive Visualization for General Public"

By

Miss Qian ZHU


Abstract:

The evolution of immersive technologies has democratized access to new devices 
like Virtual Reality (VR) and Augmented Reality (AR) headsets among the general 
public. Following this trend, data visualization is no longer limited to 
desktops or mobile devices. It is transitioning towards future wearable 
devices, becoming ubiquitous and spatial, thereby fulfilling the demand for 
accessing and analyzing data anytime and anywhere. However, designing usable 
and effective interaction with data visualizations presented on immersive 
displays poses significant challenges.

First, general users are accustomed to using a mouse and keyboard as input 
devices, interacting with data visualizations through WIMP-based (Windows, 
Icons, Menus, Pointer) graphical user interfaces. As data visualizations 
transition to spatial environments, it is crucial to explore ways to help users 
adapt and effectively engage with visualizations through spatial interactions. 
Second, while researchers in Human- Computer Interaction (HCI) and Extended 
Reality (XR) have devised interaction techniques tailored to virtual objects, 
data visualization presents a unique challenge due to its abstract and 
non-physical nature. This requires leveraging users' kinesthetic skills and 
examining the affordances of both immersive environments and data 
visualization. In this thesis, I target general users and investigate the 
interaction design with immersive visualizations. I leverage people's inherent 
spatial perception and interaction capabilities to enhance their understanding, 
analysis, and creation of data visualizations on immersive Head-mounted 
displays (HMDs). Specifically, this thesis encompasses three key components: 
(1) crafting user-acceptable interactions to assist people in analyzing and 
using visualization in public environments; (2) designing and implementing 
interactive data story experiences to promote users' perception and 
understanding of immersive visualization; and (3) designing and implementing 
embodied interactions to support users in creating composite visualizations in 
immersive environments.

This thesis contributes to the field of Human-Computer Interaction (HCI), 
visualization, and Extended Reality (XR) by delineating new design spaces, 
novel systems, and interaction techniques for engaging with data visualization. 
Furthermore, it offers fresh insights gleaned from empirical studies to 
elucidate the usability and user experience of these interactions.


Date:                   Friday, 16 August 2024

Time:                   4:00pm - 6:00pm

Venue:                  Room 5510
                        Lifts 25/26

Zoom Meeting:           https://hkust.zoom.us/j/4087711563

Chairman:               Prof. Kristiaan NEYTS (ECE)

Committee Members:      Dr. Xiaojuan MA (Supervisor)
                        Prof. Huamin QU
                        Dr. Dan XU
                        Dr. Hai-Ning LIANG (HKUST-GZ)
                        Dr. Benjamin BACH (The Univ. of Edinburgh)