Image credit: photo by Vib Soundrarajah © 2024 ACM SIGGRAPH
On Tuesday, 30 July, SIGGRAPH 2024 Real-Time Live! Chair Emily Hsu and team hosted an extra-special presentation of Real-Time Live! as part of the 51st conference celebration. The program was celebrating its 15th anniversary! This year, Real-Time Live! took place in person in Denver, with the exciting addition of being livestreamed on Twitch, YouTube, and SIGGRAPH 2024 Virtual Access. SIGGRAPH 2024 featured 11 live demos, each showcasing groundbreaking technology. Before diving into a recap of each demo, check out the Real-Time Live! trailer for a preview of the innovative projects presented at this year’s event, and catch the livestream playback on Virtual Access or YouTube.
AI in mixed reality – Copilot on HoloLens
These contributors from Microsoft demonstrated HoloLens, which they used to dissect an ATV to work on the cooling system and other various components. This product uses eye tracking to intersect with your hand to provide a task bar.
Enhancing Narratives with SayMotion’s text-to-3D animation and LLMs
SayMotion is a new platform where contributors demonstrated in real time how they are able to use text-to-3D animation to have a character move in the ways they desire. SayMotion provides specific prompts that can be added or moved around as needed, and at the end can all be added together for one full clip.
GenUSD: 3D scene generation made easy
GenUSD showcases how they can create a scene using only text. Their system will create the code and show the scene being created in just a matter of minutes.
Mesh Mortal Combat: Real-Time Voxelized Soft-Body Destruction
Mesh Mortal Combat, recipient of the Best in Show and Audience Choice Awards, is a virtual rage room. This contributor displayed how a character can be broken apart in this rage room by various objects.
MOVIN TRACIN’: Move Outside the Box
This team believes motion capture should be easy. MOVIN TRACIN’ has no suits or marketers, just one camera. In this presentation, the camera can capture a person in real time dancing or playing sports with accurate and seamless movement.
Phases: Augmenting a Live Audio-Visual Performance with AR
Phases uses a drum and XY control that create interactive visual and sounds with each gesture and hit. During this presentation, two spectators are wearing AR glasses, while others watch on screen. As this presentation goes on, you are able to see how the visuals take place with the sound.
Real-time AI and the Future of Creative Tools
Everyone’s favorite topic, AI. KREA is an AI creative suite that allows you to create anything, such as a realistic frog made of porcelain or your dream car, all in 4K.
Revolutionizing VFX Production with Real-Time Volumetric Effects
This demonstration showcases an innovative compression technology. They created a complex scene for PlayStation 5 level hardware where they can compress a 3-gibibyte scene to a 150-megabyte scene.
Rodin: 3D Asset Creation with a Text/Image/3D-Conditioned Large Generative Model for Creative Frontier
Rodin, after the famous sculptor, is the name of this generator. In this presentation, the team used the “welcome” figure that is located at the Denver Art Museum to generate a 3D asset in about 10 seconds. You can go on to edit the asset and create a 3D world using this generator.
VOODOO VR: One-Shot Neural Avatars for Virtual Reality
Voodoo VR captures your avatar from a single image of one’s face. You can model expressions and different views of one’s face. During this presentation, the team shows how you are able to use your expressions and voice on another’s avatar.
Warudo: Interactive and Accessible Live Performance Capture
Warudo is a virtual content creator that is able perform virtually. The approach for this platform is to enables creators with no technical background to design unique, collaborative live performances. this team demonstrated an immersive performance that was driven by the SIGGRAPH audience.
Congratulations to the winners of the Best in Show and Audience Choice awards! If you didn’t catch the year’s most eagerly awaited event or wish to relive the incredible showcase, Virtual Access attendees can view Real-Time Live! Interested in joining the excitement? Register for Virtual Access until 1 September.
