The Future of Filmmaking: AI for Volumetric Capture and Reconstruction

submitted by ilkedemir on 08/26/22 1

For more details: www.meetup.com/SF-Bay-ACM/events/281257360/ Dr. Ilke Demir, Senior Staff Research Scientist, Intel Corporation Abstract: One picture is worth a thousand words, so what have been told with videos? What about 100 simultaneous videos to reconstruct every frame of life in a 10.000 sq. ft dome? Is it enough to reconstruct and digitize us realistically? Similar to other industries, the entertainment industry is also being reshaped by AI, especially towards AR/VR consumption. Before the democratization of AI and data, such immersive experiences were lacking an essential element: photorealism. As the amount of data increased, our models got deeper, and the reality became decipherable. This talk will introduce recent deep learning advancements in 3D vision, reconstruction, and shape understanding techniques with a focus on generative models to digitize performances and scenes. Then we will shift gears with an overview of such models in 3D, and their progression on voxels, point clouds, meshes, graphs, and other 3D representations. Back to our studio, in addition to a discussion about how to process such large visual data, the challenges of scaling 10x over current capture platforms, and over 200x over state-of-the-art datasets will be presented. The talk will conclude with a sneak peek of upcoming VR/AR productions from the worlds largest volumetric capture stage at Intel Studios, as an example of real-world use cases of such AI approaches. SPEAKER BIO: (ACM Distinguished Speaker) Dr. Ilke Demir is based in Hermosa Beach, CA. In the overlap of computer vision and machine learning, Dr. Ilke Demir's research focuses on generative models for digitizing the real world, deep fake detection and generation techniques, analysis and synthesis approaches in geospatial machine learning, and computational geometry for synthesis and fabrication. Currently, she is a Senior Staff Research Scientist at Intel Corporation. Dr. Demir earned her Ph.D. and M.S. in Computer Science from Purdue University advised by Prof. Daniel Aliaga, and her B.S. in Computer Engineering from Middle East Technical University with a minor in Electrical Engineering. Her Ph.D. dissertation conceives geometric and topological shape processing approaches for reconstruction, modeling, and synthesis; which pioneered the area of proceduralization. Afterwards, Dr. Demir joined Facebook as a Postdoctoral Research Scientist working with Prof. Ramesh Raskar from MIT, where their team developed the breakthrough innovation on generative street addresses. Her research further included deep learning approaches for human behavior understanding in next generation virtual reality headsets, geospatial machine learning for map creation, and 3D reconstruction at scale. At the intersection of art and science, Dr. Demir contributed to several animated feature and VR/AR short films in Pixar Animation Studios and Intel Studios, respectively. She established the research foundations of the worldÕs largest volumetric capture studio at Intel, bridging the gap between the creative process and AI approaches. Dr. Demir has been actively involved in women in science organisms, always being an advocate for women and underrepresented minorities. www.linkedin.com/in/ilkedemir/ speakers.acm.org/speakers/demir_14351 ilkedemir.github.io Joint event with Silicon Valley ACM SIGGRAPH www.meetup.com/SV-SIGGRAPH/ 0:00 Chapter Intro 1:16 Upcoming Events 4:45 Speaker Intro 5:51 Presentation 7:03 Demo Video URL youtu.be/EAafgi5Ji4o 8:30 History of Filmmaking 9:10 World's Largest Volumetric Stage 58:59 Superhuman AR URL youtu.be/R3h4S7gtIuI 1:01:06 Q&A

Leave a comment

Be the first to comment

Collections with this video
Email
Message
×
Embed video on a website or blog
Width
px
Height
px
×
Join Huzzaz
Start collecting all your favorite videos
×
Log in
Join Huzzaz

facebook login
×
Retrieve username and password
Name
Enter your email address to retrieve your username and password
(Check your spam folder if you don't find it in your inbox)

×