Investigating Real-time Touchless Hand Interaction and Machine Learning Agents in Immersive Learning Environments

Research output: ThesisDoctoral Thesis

59 Downloads (Pure)

Abstract

The recent surge in the adoption of new technologies and innovations in connectivity, interaction technology, and artificial realities can fundamentally change the digital world. eXtended Reality (XR), with its potential to bridge the virtual and real environments, creates new possibilities to develop more engaging and productive learning experiences. Evidence is emerging that this
sophisticated technology offers new ways to improve the learning process for better student interaction and engagement. Recently, immersive technology has garnered much attention as an interactive technology that facilitates direct interaction with virtual objects in the real world. Furthermore, these virtual objects can be surrogates for real-world teaching resources, allowing for virtual labs. Thus XR could enable learning experiences that would not be
possible in impoverished educational systems worldwide. Interestingly, concepts such as virtual hand interaction and techniques such as machine learning are still not widely investigated in immersive learning. Hand interaction technologies in virtual environments can support the kinesthetic learning pedagogical approach, and the need for its touchless interaction nature has
increased exceptionally in the post-COVID world. By implementing and evaluating real-time hand interaction technology for kinesthetic learning and machine learning agents for self-guided learning, this research has addressed these underutilized technologies to demonstrate the efficiency of immersive learning. This thesis has explored different hand-tracking APIs and devices to integrate real-time hand interaction techniques. These hand interaction techniques and integrated machine learning agents using reinforcement learning are evaluated with different display devices to test compatibility. The proposed approach aims to provide self-guided, more productive, and interactive learning experiences. Further, this research has investigated ethics, privacy, and security issues in XR and covered the future of immersive learning in the Metaverse.
Original languageEnglish
QualificationDoctor of Philosophy
Awarding Institution
  • University College Dublin
Supervisors/Advisors
  • Campbell, Abraham G., Supervisor, External person
Award date15 May 2023
Publication statusPublished - Apr 2023

Fingerprint

Dive into the research topics of 'Investigating Real-time Touchless Hand Interaction and Machine Learning Agents in Immersive Learning Environments'. Together they form a unique fingerprint.

Cite this