Single-shot layered reflectance separation using a polarized light field camera | Proceedings of the Eurographics Symposium on Rendering: Experimental Ideas & Implementations (2024)

1. {ARL* 10} Alexander O., Rogers M., Lambeth W., Chiang J.-Y., Ma W.-C., Wang C.-C., Debevec P.: The digital emily project: Achieving a photorealistic digital actor. Computer Graphics and Applications, IEEE 30, 4 (2010), 20--31. 2 Google ScholarDigital Library
2. {AWL13} Aittala M., Weyrich T., Lehtinen J.: Practical SVBRDF capture in the frequency domain. ACM Trans. Graph. 32, 4 (July 2013), 110:1--110:12. 2 Google ScholarDigital Library
3. {BBB* 10} Beeler T., Bickel B., Beardsley P., Sumner B., Gross M.: High-quality single-shot capture of facial geometry. ACM Trans. on Graphics (Proc. SIGGRAPH) 29, 3 (2010), 40:1--40:9. 3 Google ScholarDigital Library
4. {BHPS10} Bradley D., Heidrich W., Popa T., Sheffer A.: High resolution passive facial performance capture. ACM Transactions on Graphics (TOG) 29, 4 (2010), 41. 3, 9 Google ScholarDigital Library
5. {DHT* 00} Debevec P., Hawkins T., Tchou C., Duiker H.-P., Sarokin W., Sagar M.: Acquiring the reflectance field of a human face. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques (2000), ACM Press/Addison-Wesley Publishing Co., pp. 145--156. 2, 3 Google ScholarDigital Library
6. {DJ05} Donner C., Jensen H. W.: Light diffusion in multi-layered translucent materials. ACM Trans. Graph. 24, 3 (2005), 1032--1039. 6 Google ScholarDigital Library
7. {DRS08} Dorsey J., Rushmeier H., Sillion F.: Digital Modeling of Material Appearance. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2008. 2 Google ScholarDigital Library
8. {DWd* 08} Donner C., Weyrich T., d'Eon E., Ramamoorthi R., Rusinkiewicz S.: A layered, heterogeneous reflectance model for acquiring and rendering human skin. ACM Trans. Graph. 27, 5 (Dec. 2008), 140:1--140:12. 3 Google ScholarDigital Library
9. {FD15} Fyffe G., Debevec P.: Single-shot reflectance measurement from polarized color gradient illumination. In International Conference on Computational Photography (2015). 3Google ScholarCross Ref
10. {FHW* 11} Fyffe G., Hawkins T., Watts C., Ma W.-C., Debevec P.: Comprehensive facial performance capture. Computer Graphics Forum (Proc. Eurographics) 30, 2 (2011). 3Google ScholarCross Ref
11. {FJYY15} Fang L., Jiandong T., Yandong T., Yan W.: An image highlights removal method with polarization principle. In Proceedings of ICMMITA (2015), 402--407. 3Google Scholar
12. {GCP* 10} Ghosh A., Chen T., Peers P., Wilson C. A., Debevec P.: Circularly polarized spherical illumination reflectometry. In ACM Transactions on Graphics (TOG) (2010), vol. 29, ACM, p. 162. 3 Google ScholarDigital Library
13. {GFT* 11} Ghosh A., Fyffe G., Tunwattanapong B., Busch J., Yu X., Debevec P.: Multiview face capture using polarized spherical gradient illumination. ACM Transactions on Graphics (TOG) 30, 6 (2011), 129. 3, 6, 7 Google ScholarDigital Library
14. {GHP* 08} Ghosh A., Hawkins T., Peers P., Frederiksen S., Debevec P.: Practical modeling and acquisition of layered facial reflectance. ACM Trans. Graph. 27, 5 (Dec. 2008), 139:1--139:10. 1, 2, 3, 6, 8, 9 Google ScholarDigital Library
15. {HEAL09} Horstmeyer R., Euliss G., Athale R., Levoy M.: Flexible multimodal camera using a light field architecture. International Conference on Computational Photography (2009). 4Google ScholarCross Ref
16. {HK93} Hanrahan P., Krueger W.: Reflection from layered surfaces due to subsurface scattering. In Proceedings of ACM SIGGRAPH (1993), 165--174. 7 Google ScholarDigital Library
17. {Jac13} Jacques S. L.: Optical properties of biological tissues: a review. Med. Biol. 58 (2013), R37--61. 7Google ScholarCross Ref
18. {JMLH01} Jensen H. W., Marschner S. R., Levoy M., Hanrahan P.: A practical model for subsurface light transport. In Proceedings of ACM SIGGRAPH (2001), 511--518. 6 Google ScholarDigital Library
19. {KLMR10} Kim J., Lanman D., Mukaigawa Y., Raskar R.: Descattering transmission via angular filtering. ECCV 2010 LNCS 6311 (2010), 86--99. 4 Google ScholarDigital Library
20. {LPGD09} Lamond B., Peers P., Ghosh A., Debevec P.: Image-based separation of diffuse and specular reflections using environmental structured illumination. In IEEE International Conference on Computational Photography (ICCP) (2009). 2Google ScholarCross Ref
21. {MHP* 07} Ma W.-C., Hawkins T., Peers P., Chabert C.-F., Weiss M., Debevec P.: Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In Proceedings of the 18th Eurographics Conference on Rendering Techniques (2007), EGSR'07, Eurographics Association, pp. 183--194. 3, 5, 6, 7, 8 Google ScholarDigital Library
22. {MRK* 13} Manakov A., Restrepo J. F., Klehm O., Hegedüs R., Eisemann E., Seidel H.-P., Ihrke I.: A reconfigurable camera addon for high dynamic range, multi-spectral, polarization, and light-field imaging. ACM Trans. Graph. (Proc. SIGGRAPH 2013) 32, 4 (July 2013), 47:1--47:14. 4 Google ScholarDigital Library
23. {MZKB05} Mallick S. P., Zickler T. E., Kriegman D., Belhumeur P. N.: Beyond lambert: Reconstructing specular surfaces using color. In Computer Vision and Pattern Recognition, CVPR, IEEE Computer Society Conference on (2005), vol. 2, Ieee, pp. 619--626. 2 Google ScholarDigital Library
24. {NFB97} Nayar S. K., Fang X.-S., Boult T.: Separation of reflection components using color and polarization. Int. J. Comput. Vision 21, 3 (Feb. 1997), 163--186. 2 Google ScholarDigital Library
25. {NKGR06} Nayar S., Krichnan G., Grossberg M., Raskar R.: Fast separation of direct and global components of a scene using high frequency illumination. ACM Transactions on Graphics 25, 3 (2006), 935--943. 2, 3 Google ScholarDigital Library
26. {NLB* 05} Ng R., Levoy M., Brdif M., Duval G., Horowitz M., Hanrahan P.: Light field photography with a hand-held plenoptic camera. Stanford Tech Report (2005). 3Google Scholar
27. {NN02} Nayar S. K., Narasimhan S. G.: Assorted pixels : Multi-sampled imaging with structural models. In ECCV (June 2002). 4 Google ScholarDigital Library
28. {NN03} Narasimhan S., Nayar S.: Shedding light on the weather. In Proceedings of IEEE CVPR (2003), 665--672. 7 Google ScholarDigital Library
29. {RAWV08} Raskar R., Agrawal A., Wilson C. A., Veeraraghavan A.: Glare aware photography: 4d ray sampling for reducing glare effects of camera lenses. ACM Trans. Graph. 27, 3 (2008), 1--10. 4 Google ScholarDigital Library
30. {Sha92} Shafer S. A.: Color. Jones and Bartlett Publishers, Inc., USA, 1992, ch. Using Color to Separate Reflection Components, pp. 43--51. URL: http://dl.acm.org/citation.cfm?id=136809.136817. 2 Google ScholarDigital Library
31. {TFG* 13} Tunwattanapong B., Fyffe G., Graham P., Busch J., Yu X., Ghosh A., Debevec P.: Acquiring reflectance and shape from continuous spherical harmonic illumination. ACM Transactions on Graphics (TOG) 32, 4 (2013), 109. 2 Google ScholarDigital Library
32. {TSW* 15} Tao M., Su J.-C., Wang T.-C., Malik J., Ramamoorthi R.: Depth estimation and specular removal for glossy surfaces using point and line consistency with light-field cameras. IEEE TPAMI (2015), 1--14. 4Google Scholar
33. {VRA* 07} Veeraraghavan A., Raskar R., Agrawal A., Mohan A., Tumblin J.: Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. 26, 3 (July 2007). 3 Google ScholarDigital Library
34. {WLL*09} Weyrich T., Lawrence J., Lensch H. P. A., Rusinkiewicz S., Zickler T.: Principles of appearance acquisition and representation. Found. Trends. Comput. Graph. Vis. 4, 2 (Feb. 2009), 75--191. 2 Google ScholarDigital Library
35. {WMP* 06} Weyrich T., Matusik W., Pfister H., Bickel B., Donner C., Tu C., McAndless J., Lee J., Ngan A., Jensen H. W., Gross M.: Analysis of human faces using a measurement-based skin reflectance model. ACM Trans. Graph. 25, 3 (July 2006), 1013--1024. 3 Google ScholarDigital Library
36. {ZGP* 13} Zhu Y., Garigipati P., Peers P., Debevec P., Ghosh A.: Estimating diffusion parameters from polarized spherical-gradient illumination. IEEE Computer Graphics and Applications 33, 3 (2013), 34--43. 10 Google ScholarDigital Library

Index Terms

1. Single-shot layered reflectance separation using a polarized light field camera

   1. Computing methodologies

      1. Computer graphics

         1. Image manipulation

• Multiple light field rendering

  GRAPHITE '03: Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East Asia

  A light field is a 4D function describing the radiance across a boundary between the volume containing a scene, and the disjoint volume in which the eyepoint may be placed. Light field rendering is the process of rendering novel views of a scene ...

  Read More

• Towards passive 6D reflectance field displays

  Traditional flat screen displays present 2D images. 3D and 4D displays have been proposed making use of lenslet arrays to shape a fixed outgoing light field for horizontal or bidirectional parallax. In this article, we present different designs of multi-...

  Read More

• Light field mapping: efficient representation and hardware rendering of surface light fields

  A light field parameterized on the surface offers a natural and intuitive description of the view-dependent appearance of scenes with complex reflectance properties. To enable the use of surface light fields in real-time rendering we develop a compact ...

  Read More