Pervasive Human-AI Collaboration in Interactive Tourism

The Hong Kong University of Science and Technology
Department of Computer Science and Engineering


MPhil Thesis Defence


Title: "Pervasive Human-AI Collaboration in Interactive Tourism"

By

Mr. Sergei SOROKIN


Abstract:

Tourism is one of the most important components of the economy for many
countries in the world. Every year, hundreds of millions of tourists from all
over the world choose certain countries for travel, booking hotels in advance
taking into account past experience. At the same time, almost every traveler,
especially choosing other countries, faces a certain lack of information during
the trip, especially regarding historical and architectural monuments,
including their detailed history in a certain context. And almost every tourist
would like to have a personal guide who could tell about any object of interest
to him in a new city. This personal guide is very expensive and not every
tourist can afford its daily accompaniment. In this paper, we present a new way
to identify cultural and historical objects and get their detailed description
using a telegram-bot. Using telegram bot, we have integrated an improved image
retrieval system and ChatGPT to create a new way of interaction for the
tourist. To get more detailed information on any tourist object, a tourist
needs to take a photo of this object directly in the telegram bot. The telegram
bot will give the original photo of the object, a URL link to the site of the
object and immediately give a detailed description of the object generated by
ChatGPT. And after that, the tourist will be able to ask ChatGPT any questions
immediately in the telegram bot, including details of the story or something
else. In this work we were using image augmentation for image retrieval to
improve the accuracy. Deep convolution neural network was used as a backbone.
As a result of the experiments conducted in the city of Tashkent, it was proved
that the proposed way of interaction for tourists is feasible and can be used
in many other applications.


Date:                   Wednesday, 30 August 2023

Time:                   4:00pm - 6:00pm

Venue:                  Room 3494
                        lifts 25/26

Committee Members:      Prof. Pan Hui (Supervisor)
                        Dr. Tristan Braud (Supervisor)
                        Prof. Gary Chan (Chairperson)
                        Prof. Pedro Sander


**** ALL are Welcome ****