Image by Velem - stock.adobe.com

Researchers at University of Tsukuba have developed a system that generates auditory (sound-based) virtual reality environments through natural language input. The system was evaluated for potential use in exposure therapy for post-traumatic stress disorder. Clinical specialists confirmed that it enables the rapid creation of high-quality audio scenarios without requiring specialized expertise, demonstrating practicality and therapeutic effectiveness.

Tsukuba, Japan—Post-traumatic stress disorder (PTSD) is a mental health disorder triggered by traumatic experiences such as accidents, disasters, or violence. Exposure therapy, a scientifically validated treatment for PTSD, involves the gradual re-exposure of patients to trauma-related cues to reduce anxiety and avoidance behaviors.

One major challenge in exposure therapy is tailoring recreated environments to individual patients, a process that is often time-intensive. Although virtual reality (VR)-based approaches have been explored in recent years, patient-specific customization remains difficult owing to the effort required to design bespoke environments.

In this study, researchers developed a system that automatically generates auditory VR experiences of traumatic sounds from natural language input by leveraging large language models and acoustic datasets. Users simply input a theme in text, and the system automatically generates appropriate sound materials and scenarios.

Clinical experts who tested the system reported that it was straightforward to use, produced realistic sound quality, and could be implemented in therapeutic settings with only minor adjustments. Experimental trials showed that generating a single auditory VR session required an average of 5 min (with a minimum of 50 s), meeting the time constraints of clinical practice.

Looking ahead, the researchers aim to improve the precision of the system in handling complex auditory environments with multiple overlapping sounds and to pursue further clinical validation for practical deployment.

###
This work was supported by JSPS KAKENHI Grant Number 24H00892.

Original Paper

Title of original paper:

Development and Evaluation of an Auditory VR Generative System via Natural Language Interaction to Aid Exposure Therapy for PTSD Patients

Journal:

ACM Transactions on Computing for Healthcare

DOI:

10.1145/3723048

Correspondence

Associate Professor ZEMPO Keiichi
Institute of Systems and Information Engineering, University of Tsukuba

Related Link

Institute of Systems and Information Engineering