Mixed Reality application 

Hologram where you can talk with a animal

PROJECT JUSTIN 

VIDEO DEMO 

This experiment describes the creation of a conversational character in a mixed reality empathetic experience. The framework allows for the synchronization of emotional animations of the virtual character in line with the character's dialogue text, with the aim to improve the users' empathetic experience. The dialogue is driven by a Natural Language Processing (NLP) pipeline, including automatic speech recognition, chatbot, and text to speech generation micro-services.

Within this framework, we present a holographic experience called ``Justin Hologram'' using "the Hololens 2" mixed reality goggles to project the virtual character into the user's field of vision. This can be used to evaluate the impact of bringing a beaver to the user's environment instead of bringing the user to the beaver’s natural environment. Interaction occurs by humanizing the beaver through human communications abilities, resulting in a conversational virtual beaver. The story-line describes the beaver’s lifestyle and problems, represented in a situation of distress. Positive experiences show the practical usability of the framework in the area of HCI.

This experiment is developing and it will be a future application with children.

VIDEO DEMO 

talk with justin certificate.jfif

ELEVATOR PITCH

Partners

TILBURG UNIVERSITY.jpg
cetreal logo.jpeg

Collaboration Researchers

Photo_Alexandra_Sierra-removebg-preview_

Ph.D St.  Alexandra Sierra

arbey_edited.jpg

Ing. Arbey Aragon

menno_edited.jpg

Dr. Menno Van Zaanen

Nelson_edited.jpg

Ing. Nelson Arias

angie_edited.jpg

Ph.D St.  Angie Sierra

ANDRES_edited_edited.jpg

Dr. Andres Burbano

auranueo_edited.jpg

Ing. Aura Forero

Peter_edited.jpg

MSc. Peter Bakker

johnny_edited.jpg

Ing. Johnny S. Alba

esteban plazas_edited.jpg

UX. Esteban Plazas