On Understanding Misleading Visualizations, Automatic Detection, And Prevention

PhD Thesis Proposal Defence


Title: "On Understanding Misleading Visualizations, Automatic Detection, And 
Prevention"

by

Mr. Yu Ho LO


Abstract:

Visualizations such as charts and graphs are used as rhetorical devices in 
news, blogs, and social media to support and further strengthen the message 
conveyed to the audience. Research shows the persuasive power of visualization. 
With equivalent information, the presence of a visualization--compared to a 
table--has a significant effect on changing or reinforcing the reade's attitude 
toward the concerned matter. Misinformation on the Internet is a significant 
challenge to societies that rely heavily on digital information. Increasingly, 
charts are included in the dissemination of misinformation. While the study of 
misinformation on the Internet often focuses on textual content, it rarely 
addresses the associated visual graphics.

This thesis examines the current state of the art in the automatic detection 
and prevention of misleading visualizations. The initial efforts in this field 
involved collecting misleading visualizations to confirm their existence. 
Researchers then conducted perceptual experiments to verify the misleading 
effects on human perception and reasoning. Automatic detection of misleading 
visualizations is a recent development in visualization research. This research 
explores the landscape of misleading visualizations by collecting over one 
thousand real-world examples and identifying 74 types of issues, forming a 
taxonomy of 12 categories. It also investigates the use of multimodal Large 
Language Models (LLMs) for detecting misleading visualizations, demonstrating 
their potential in analyzing complex charts and enhancing visualization 
literacy. Additionally, this work develops effective explanation methods, 
including Bret Victor's concept of Explorable Explanations, to educate 
audiences and guide authors in modifying misleading visualizations.

Building on the groundwork of understanding, recent breakthroughs in detection 
methods make it possible to develop prevention mechanisms such as automatic 
correction suggestions and in-situ annotations. However, further development of 
this research direction requires benchmarks to compare the performance of 
different detection and correction methods.


Date:                   Thursday, 30 May 2024

Time:                   9:30am - 11:30am

Venue:                  Room 2128A
                        Lift 19

Committee Members:      Prof. Huamin Qu (Supervisor)
                        Dr. Dimitris Papadopoulos (Chairperson)
                        Prof. Ting-Chuen Pong
                        Dr. Dan Xu