Metropolis Light Transport | Two Minute Papers #16
Skills:
Reading ML Papers80%
Key Takeaways
Metropolis light transport is used for photorealistic rendering
Full Transcript
[Music] dear fellow Scholars this is 2minute papers with car if we would like to see how digitally modeled objects would look like in real life we would create a 3D model of the desired scene assign material models to the objects within and use a photorealistic rendering algorithm to finish the job it simulates rays of light that connect the camera to the light sources in the scene and compute the flow of energy between them initially after a few Rays we'll only have a rough idea on how the image should look like therefore our initial results will contain a substantial amount of noise we can get rid of this by simulating the path of millions and millions of rays that will eventually clean up our image this process where a noisy image gets clearer and clearer we call Convergence and the problem is that this can take excruciatingly long even up to hours to get a perfectly clear image with the simpler algorithms out there we generate these light paths randomly this technique we call Path tracing however in the scene that you see here most random paths can't connect the camera and the light source because this wall is in the way obstructing many of them light paths like these don't contribute anything to our calculations and are ultimately a waste of time and precious resources after generating hundreds of random light paths we have found a path that finally connects the camera with the light source without any obstructions when generating the next PATH it would be a crime not to use this knowledge to our advantage a technique called Metropolis light transport will make sure to use this valuable knowledge and upon finding a bright light path it will explore other paths that are nearby to have the best shot at creating valid unobstructed connections if we have a difficult scene at hand Metropolis light transport gives us way better results than traditional completely random path sampling techniques such as path tracing here are some equal time comparisons against path tracing to show how big of a difference this technique makes an equal time comparison means that we save the output of two algorith that we ran for the same amount of time on the same scene and see which one performs better this scene is extremely difficult in a sense that the only source of light is coming from the upper left and after the light goes through multiple glass spheres most of the light paths that we generate will be invalid as you can see the random path Tracer yields really Dreadful results well if you can call a black image or result that is and as you can see Metropolis light transport is extremely useful in these case and here's the beautiful completely cleaned up Converse result the lead author of this technique Eric V won a technical Oscar award for his work one of which was Metropolis light transport if you like the series please click on that subscribe button to become a fellow scholar thanks for watching there are millions of videos out there and you decided to take your time with this one that is amazing thank you and I'll see you next time
Original Description
Metropolis light transport is an advanced photorealistic rendering technique that is remarkably effective at finding the brighter regions of a scene and building many light paths that target these regions. The resulting algorithm is more efficient than traditional random path building algorithms, such as path tracing.
_______________________
The paper "Metropolis Light Transport" by Veach and Guibas is available here:
https://graphics.stanford.edu/papers/metro/
I held a course on photorealistic rendering at the Technical University of Vienna. Here you can learn how the physics of light works and to write programs like this:
https://www.youtube.com/playlist?list=PLujxSBD-JXgnGmsn7gEyN28P1DnRZG7qi
Recommended for you:
Manipulating Photorealistic Renderings - https://www.youtube.com/watch?v=L7MOeQw47BM&list=PLujxSBD-JXgnqDD1n-V30pKtp6Q886x7e&index=7
Ray Tracing, Subsurface Scattering @ Function 2015 - https://www.youtube.com/watch?v=qyDUvatu5M8
A more elaborate discussion on Metropolis Light Transport - https://www.youtube.com/watch?v=Zl36H9pwsHE&list=PLujxSBD-JXgnGmsn7gEyN28P1DnRZG7qi&index=33
Eric Veach's Sci-tech award speech: https://www.youtube.com/watch?v=e3ss_Ozb9Yg
Scene credits:
Italian Still Life - Bhavin Solanki - http://www.blendswap.com/blends/view/67815
Spheres - Vlad Miller (SATtva) - http://www.luxrender.net/wiki/Show-off_pack
Music: "Bet On It" by Silent Partner.
A higher resolution version of the sphere scene comparison is available here:
https://cg.tuwien.ac.at/~zsolnai/gfx/adaptive_metropolis/
The image from fxguide is available here: http://www.fxguide.com/featured/the-state-of-rendering-part-2/
Subscribe if you would like to see more of these! - http://www.youtube.com/subscription_center?add_user=keeroyz
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu
Károly Zsolnai-Fehér's links:
Patreon → https://www.patreon.com/TwoMinutePapers
Facebook → https://www.facebook.com/TwoMinutePapers/
Web → https://cg.tuwien.ac.at/~zsoln
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Two Minute Papers · Two Minute Papers · 18 of 60
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
▶
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Fluid Simulations with Blender and Wavelet Turbulence | Two Minute Papers #1
Two Minute Papers
Capturing Waves of Light With Femto-photography | Two Minute Papers #2
Two Minute Papers
Artificial Neural Networks and Deep Learning | Two Minute Papers #3
Two Minute Papers
Blender Rendering - Top 7 LuxRender Features
Two Minute Papers
Simulating Breaking Glass | Two Minute Papers #4
Two Minute Papers
Time Lapse Videos From Community Photos | Two Minute Papers #5
Two Minute Papers
AI Learns Van Gogh's Art
Two Minute Papers
Hydrographic Printing | Two Minute Papers #7
Two Minute Papers
Announcing LuxRender 1.5
Two Minute Papers
Digital Creatures Learn To Walk | Two Minute Papers #8
Two Minute Papers
Manipulating Photorealistic Renderings | Two Minute Papers #9
Two Minute Papers
Adaptive Fluid Simulations | Two Minute Papers #10
Two Minute Papers
Building Bridges With Flying Machines | Two Minute Papers #11
Two Minute Papers
Reconstructing Sound From Vibrations | Two Minute Papers #12
Two Minute Papers
Creating Photographs Using Deep Learning | Two Minute Papers #13
Two Minute Papers
Adaptive Cloth Simulations | Two Minute Papers #14
Two Minute Papers
Synthesizing Sound From Collisions | Two Minute Papers #15
Two Minute Papers
Metropolis Light Transport | Two Minute Papers #16
Two Minute Papers
3D Printing a Glockenspiel | Two Minute Papers #17
Two Minute Papers
Modeling Colliding and Merging Fluids | Two Minute Papers #18
Two Minute Papers
Recurrent Neural Network Writes Music and Shakespeare Novels | Two Minute Papers #19
Two Minute Papers
Gradients, Poisson's Equation and Light Transport | Two Minute Papers #20
Two Minute Papers
Real-Time Facial Expression Transfer | Two Minute Papers #21
Two Minute Papers
Automatic Lecture Notes From Videos | Two Minute Papers #22
Two Minute Papers
Be a Part of Two Minute Papers on Patreon!
Two Minute Papers
Recurrent Neural Network Writes Sentences About Images | Two Minute Papers #23
Two Minute Papers
How Does Deep Learning Work? | Two Minute Papers #24
Two Minute Papers
Cryptography, Perfect Secrecy and One Time Pads | Two Minute Papers #25
Two Minute Papers
Terrain Traversal with Reinforcement Learning | Two Minute Papers #26
Two Minute Papers
Multiple-Scattering Microfacet BSDFs with the Smith Model
Two Minute Papers
Google DeepMind's Deep Q-Learning & Superhuman Atari Gameplays | Two Minute Papers #27
Two Minute Papers
Are We Living In a Computer Simulation? | Two Minute Papers #28
Two Minute Papers
Artificial Superintelligence [Audio only] | Two Minute Papers #29
Two Minute Papers
Automatic Parameter Control for Metropolis Light Transport | Two Minute Papers #30
Two Minute Papers
Randomness and Bell's Inequality [Audio only] | Two Minute Papers #31
Two Minute Papers
OpenAI - Non-profit AI company by Elon Musk and Sam Altman
Two Minute Papers
How Do Genetic Algorithms Work? | Two Minute Papers #32
Two Minute Papers
Painting with Fluid Simulations | Two Minute Papers #33
Two Minute Papers
Peer Review #1 [Audio only] | Two Minute Papers
Two Minute Papers
Neural Programmer-Interpreters Learn To Write Programs | Two Minute Papers #34
Two Minute Papers
9 Cool Deep Learning Applications | Two Minute Papers #35
Two Minute Papers
Designing Cities and Furnitures With Machine Learning | Two Minute Papers #36
Two Minute Papers
Designing 3D Printable Robotic Creatures | Two Minute Papers #37
Two Minute Papers
3D Printing Objects With Caustics | Two Minute Papers #38
Two Minute Papers
Interactive Editing of Subsurface Scattering | Two Minute Papers #39
Two Minute Papers
Simulating Viscosity and Melting Fluids | Two Minute Papers #40
Two Minute Papers
What Do Virtual Objects Sound Like? | Two Minute Papers #41
Two Minute Papers
How DeepMind Conquered Go With Deep Learning (AlphaGo) | Two Minute Papers #42
Two Minute Papers
Breaking Deep Learning Systems With Adversarial Examples | Two Minute Papers #43
Two Minute Papers
Extrapolations and Crowdfunded Research (Experiment) | Two Minute Papers #44
Two Minute Papers
Biophysical Skin Aging Simulations | Two Minute Papers #45
Two Minute Papers
What is Impostor Syndrome? | Two Minute Papers #46
Two Minute Papers
Should You Take the Stairs at Work? (For Weight Loss) | Two Minute Papers #47
Two Minute Papers
Artistic Manipulation of Caustics | Two Minute Papers #48
Two Minute Papers
Deep Learning Program Learns to Paint | Two Minute Papers #49
Two Minute Papers
Interactive Photo Recoloring | Two Minute Papers #50
Two Minute Papers
How To Get Started With Machine Learning? | Two Minute Papers #51
Two Minute Papers
Awesome Research For Everyone! - Two Minute Papers Channel Trailer
Two Minute Papers
10 More Cool Deep Learning Applications | Two Minute Papers #52
Two Minute Papers
How DeepMind's AlphaGo Defeated Lee Sedol | Two Minute Papers #53
Two Minute Papers
More on: Reading ML Papers
View skill →Related Reads
📰
📰
📰
📰
A lightweight workflow for keeping up with AI conference papers
Dev.to · Daniel
Why CitedEvidence Believes Great Researchers Read Less Than You Think
Medium · AI
How to Write a Literature Review That Actually Argues Something
Medium · Machine Learning
I Built a Personal Paper Engine to Stop Losing Research Papers
Dev.to · Ethan
🎓
Tutor Explanation
DeepCamp AI