#consumer electronics #gaming #human-machine interaction #learning #storytelling #interfaces #machine learning #affective computing #ethics #industry #interactive #computer science #interfaces #learning #entertainment #art #artificial intelligence #design #creativity #history #technology #archives
PAGE UNDER CONSTRUCTION
This project integrates real-time Stable Diffusion into TouchDesigner for dynamic virtual production. Using a high-resolution LED wall, we explore how generative AI enhances set design, props, and storytelling. Case studies show how AI streamlines workflows, enabling rapid prototyping and immersive environments for in-camera VFX and filmmaking.
The study demonstrates integration of real-time diffusion models into virtual production workflows, highlighting performance benefits when applied to in-camera VFX. Using a 2240 x 1440 1.9 mm pixel virtual production display, we explore performance benefits of real-time stable diffusion to generate immersive virtual environments.
Storytelling through Multimedia
I collected public domain 2D animations comprising a geneology of CGI from 1963 to 1987, and used fragments of the animations to create a 3D environment for storytelling.
Interacting in a 3D Timeline
Users explored a chronology of CGI history by retargeting their hand gestures via a Leap Motion Controller onto Catmulls’ “hand”.
The dialogue of the story was told by two bookended iMac G3 monitors, each animated by Parke’s faces, re-animated with the original Apple text-to-speech engine, “MacinTalk”.
A Spatial Narrative on Hardware
Using media artifacts with contemporary technology, the story of “The Machine Stops” was told through the medium of media archaeology.
Full Project Overview
3D Stereo Conversion
When displayed on a stereoscopic 3D display, the interactive animation is also rendered as "3D".
Interestingly, this process involves extracting 2D content from originally 3D animated projects, placing them in 3D space, and using modern stereoscopy to allow them to become "three-dimensional" again.
