This project created a sensory simulation designed to conjure feelings of presence in past places.

This research project investigates how immersive systems can preserve autobiographical memory by integrating tangible objects, 3D scans of real environments, and virtual artifacts, grounded in lived experience. The project aims to create emotionally resonant linkages that evoke vivid memory recollection. Designed to support intergenerational memory sharing, these systems show promising potential for enhancing emotional well-being, strengthening familial and social bonds, and fostering a sense of telepresence, enabling communication and connection across time.

We designed a study exploring interaction with memory reconstructions and complex personal spaces using gaussian splatting paired with sensory stimuli. Using a dataset of object-specific 3D scans, home movies rendered in depth, and personal anecdotal data, we built digital twins to explore the therapeutic potential of AI-driven autobiographical simulations, with the goal of aligning an individual’s sensory experience with generative models by fusing multi-modal data. Our user study of n=16 family members showed combining sensory stimuli with gaussian splats enhanced memory vividness. Future work would lead to dynamically generated world modeling, providing users with personal multi-sensory experiences on demand.