This experiment describes the creation of a conversational character in a mixed reality empathetic experience. The framework allows for the synchronization of emotional animations of the virtual character in line with the character's dialogue text, with the aim to improve the users' empathetic experience. The dialogue is driven by a Natural Language Processing (NLP) pipeline, including automatic speech recognition, chatbot, and text to speech generation micro-services.

​

Within this framework, we present a holographic experience called ``Justin Hologram'' using "the Hololens 2" mixed reality goggles to project the virtual character into the user's field of vision. This can be used to evaluate the impact of bringing a beaver to the user's environment instead of bringing the user to the beaver’s natural environment. Interaction occurs by humanizing the beaver through human communications abilities, resulting in a conversational virtual beaver. The story-line describes the beaver’s lifestyle and problems, represented in a situation of distress. Positive experiences show the practical usability of the framework in the area of HCI.

This experiment is developing and it will be a future application with children.

​

​

​

​

​