RhythmTA: A Visual-Aided Interactive System for ESL Rhythm Training via Dubbing Practice

The Hong Kong University of Science and Technology
Department of Computer Science and Engineering


MPhil Thesis Defence


Title: "RhythmTA: A Visual-Aided Interactive System for ESL Rhythm Training
via Dubbing Practice"

By

Miss Chang CHEN


Abstract:

English speech rhythm, as the temporal patterns of stressed syllables, is
essential for English as a second language (ESL) learners to produce
natural-sounding and comprehensible speech. Rhythm training is generally
based on imitation of native speech. However, it relies heavily on external
instructor feedback, preventing ESL learners from independent practice.

To address this gap, we present RhythmTA, an interactive system for ESL
learners to practice speech rhythm independently via dubbing, an imitation-
based approach. The system automatically extracts rhythm from any English
speech and introduces novel visual designs to support three stages of
dubbing practice: (1) Synchronized listening with visual aids to enhance
perception, (2) Guided repeating by visual cues for self-adjustment, and
(3) Comparative reflection from a parallel view for self-monitoring.

Our design is informed by a formative study with nine spoken English
instructors, which identified current practices and challenges in ESL
rhythm training. A user study with twelve ESL learners demonstrates that
RhythmTA effectively enhances learners' rhythm perception and shows
significant potential for improving rhythm production.


Date:                   Thursday, 18 December 2025

Time:                   10:00am - 12:00noon

Venue:                  Room 2128B
                        Lift 22

Chairperson:            Dr. Xiaojuan MA

Committee Members:      Prof. Huamin QU (Supervisor)
                        Dr. Wei XUE (AMC)