Readings CMPS 290B Aut 2005

Introduction

• (no reading)

Combining images: flash/noflash, full-focus

• · Elmar EISEMANN and Frédo DURAND, Flash Photography Enhancement Via Intrinsic Relighting, SIGGRAPH 2004 [project]
  – Presented by James Davis
• · Georg PETSCHNIGG, Maneesh AGRAWALA, Hugues HOPPE, Richard SZELISKI, Michael COHEN, Kentaro TOYAMA. Digital Photography with Flash and No-Flash Image Pairs. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2004), 2004.
  -- Presented by Oliver Wang
• · Haeberli - A Multifocus Method for Controlling Depth of Field - GraficaObscura http://www.sgi.com/misc/grafica/depth/index.html
  (Powerpoint from Class, including Matlab code)
• · Burt, P. J. and Adelson, E. H. 1983. A multiresolution spline with application to image mosaics. ACM Trans. Graph. 2, 4 (Oct. 1983), 217-236.

Relighting

• "Acquiring the Reflectance Field of a Human Face"
  Debevec, P., Hawkins, T., Tchou, C., Duiker, H., Sarokin, W., and Sagar, M. Proc. SIGGRAPH, 2000.
  http://www.debevec.org/Research/LS/ (Downloadable demo available here)
  - Presented by Anne Sullivan
• · Ng, Ramamoorthi, Hanrahan, Triple Product Wavelet Integrals for All-Frequency Relighting Siggraph 04, pages 475-485
  - Presented by Adam Smith
• · Goesele, M., Granier, X., Heidrich, W., Seidel, H.-P.,Accurate light source acquisition and rendering, Proc. Siggraph 2003.
  - Presented By Jerry Yee
• · AKERS, D., LOSASSO, F., KLINGNER, J., AGRAWALA, M., RICK, J., AND HANRAHAN, P. 2003. Conveying shape and features with image-based relighting. In IEEE Visualization, 349–35.
  - Presented by Jacob Telleen
• · Performance Relighting and Reflectance Transformation with Time-Multiplexed Illumination
  Andreas Wenger Andrew Gardner Chris Tchou Jonas Unger Tim Hawkins Paul Debevec - SIGGRAPH 2005 Papers Proceedings
  http://gl.ict.usc.edu/research/LS5/index-s2005.html
  - Presented by Anne Sullivan

How to review a paper

• (read all of these)
• · Smith, A. J. 1990. The Task of the Referee. Computer 23, 4 (Apr. 1990), 65-71.
• · Jim Kajiya. How to get your SIGGRAPH paper rejected. 1993.
• · PAMI Program Committee and Referee Instructions
• · SIGGRAPH Reviewer Questions
• · CVPR Reviewer Questions

High dynamic range, tone mapping, multi-spectral

• · Nayar, S.K., Branzoi, V., Adaptive Dynamic Range Imaging:Optical Control of Pixel Exposures Over Space and Time, Proc. ICCV 2003.
• · Debevec, P. and Malik, J., Recovering High Dynamic Range Radiance Maps from Photographs, Proc. SIGGRAPH, 1997.
  - Presented by Daniel Keller (bruce@soe)
• · Schechner, Y. Y. and Nayar, S. K., Uncontrolled Modulation Imaging, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Washington DC, June 2004.
• · Schechner, Y. Y. and Nayar, S. K., Generalized Mosaicing: Wide Field of View Multispectral Imaging , IEEE Transactions of Pattern Analysis and Machine Intelligence, Vol 24, No. 10, October 2002
• · Ledda Patrick, Alan Chalmers, Tom Troscianko (University of Bristol), Helge Seetzen (Sunnybrook Technologies), Evaluation of Tone Mapping Operators using a High Dynamic Range Display 
  - Presented by Marinna Lee

Panoramas, projections

• · Szeliski, R. and Shum, H.
  "Creating Full View Panoramic Image Mosaics and Environment Maps,"
  Proc. SIGGRAPH, 1997.
• · Zomet, D. Feldman, S. Peleg, and D. Weinshall, Mosaicing New Views: The Crossed-Slits Projection, IEEE Trans. on PAMI, June 2003, pp. 741-754.
• · Shum, H. and He, L.
  "Rendering with Concentric Mosaics,"
  Proc. SIGGRAPH, 1999.
  - Presented by Robert Hero
• · Interactive Digital Photomontage
  Aseem Agarwala, Mira Dontcheva, Maneesh Agrawala , Steven Drucker, Alex Colburn, Brian Curless, David Salesin and Michael Cohen
  SIGGRAPH 2004, August 2004. pp. 294-302 - Possibly presented by Oliver Wang
• · Panoramic Video Textures
  Aseem Agarwala, Ke Colin Zheng, Chris Pal, Maneesh Agrawala , Michael Cohen, Brian Curless, David Salesin and Rick Szeliski
  SIGGRAPH 2005, August 2005. pp. 821-827. Project Website
  - Presented by Ken Hullett (auditing the class)

Image sensors, optics, catadioptric

• · Nayar, S.K., Branzoi, V., Boult, T.E.,Programmable Imaging using a Digital Micromirror Array,Proc. CVPR 2004. -- link
  - Presented by Oliver Wang
• · A General Imaging Model and a Method for Finding its Parameters, Michael D. Grossberg and Shree K. Nayar Proc. of IEEE International Conference on Computer Vision, Vancouver, Canada, July 2001.
• · A Very Fast VLSI Rangefinder, T. Kanade, A. Gruss, and L.R. Carley
  Proceedings of the 1991 IEEE International Conference on Robotics and Automation (ICRA '91), Vol. 2, April, 1991, pp. 1322-1329.
• · B. WANDELL, P. CATRYSSE, J. DICARLO, D. YANG AND A. EL GAMAL Multiple Capture Single Image Architecture with a CMOS Sensor, In Proceedings of the International Symposium on Multispectral Imaging andColor Reproduction for Digital Archives, pp. 11-17, Chiba, Japan, October 21-22 1999. (Society of Multispectral Imaging of Japan.)

BRDF, BTF

• · PTM (polynomial texture maps) paper, Tom malzbender siggraph -- link
• · Marschner, S., Westin, S., Lafortune, E., Torrance, K. and Greenberg, D.
  "Image-Based BRDF Measurement Including Human Skin,"
  Proc. EGRW, 1999.
• · Dana, K., van Ginneken, B., Nayar, S., and Koenderink, J.
  "Reflectance and Texture of Real-World Surfaces,"
  ACM TOG, vol. 18, no. 1, 1999.
  (Powerpoint from class)
• · Yu, Y., Debevec, P., Malik, J., and Hawkins, T.
  "Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs,"
  Proc. SIGGRAPH, 1999.

Super resolution , RGB mosaicing

• · Sawhney et al. Hybrid Stereo Camera: An IBR Approach for Synthesis of Very High Resolution Stereoscopic Image Sequences, SIGGRAPH 2001
• · Ramanath, Snyder, Bilbro, and Sander. Demosaicking Methods for Bayer Color Arrays, Journal of Electronic Imaging, vol. 11, no. 3, pp. 306-315.
• · Shree K. Nayar, Srinivasa G. Narasimhan. Assorted Pixels: Multi-sampled Imaging with Structural Models, ECCV (4) 2002: 636-652
• · Irani, M. and Peleg. Improving Resolution by Image Registration, Graphical Models and Image Processing, 53(3), May 1991, 231-239.

Transmission and matting, color..grey

• · Color2Gray: Salience-Preserving Color Removal, Amy A. Gooch, Sven C. Olsen, Jack Tumblin, Bruce Gooch (Northwestern University) SIGGRAPH 2005 -- link
• · Transferring Color to Greyscale Images, Tomihisa Welsh, Michael Ashikhmin, Klaus Mueller (Stony Brook University) SIGGRAPH 2002 -- link (Powerpoint from class)
• · Zongker, D., Werner, D., Curless, B., and Salesin, D.
  "Environment Matting and Compositing,"
  Proc. SIGGRAPH, 1999. -- link
• · Chuang, Y., Zongker, D., Hindorff, J., Curless, B., Salesin, D., and Szeliski, R.
  "Environment Matting Extensions: Towards Higher Accuracy and Real-Time Capture,"
  Proc. SIGGRAPH, 2000. -- link

Range Finding Surveys

• Batlle et al, Pattern Recognition 1998 Recent progress in coded structured light as a technique to solve the correspondence problem: a survey
• Blais , Journal of Electronic Imaging 2004 A review of 20 years of range sensor development
• Jarvis, PAMI 1983, A perspective on range finding techniques for computer vision
• Strand, Optical Engineering 1985, Optical three-dimensional sensing for machine vision
• Poussart and Laurendeau, Chapter 3 in Advances in Machine Vision, pg 123-159, 3-D Sensing for Industrial Computer Vision
• ·Besl, P.J. "Active, optical range imaging sensors." Machine Vision and Applications (1988) vol.1, no.2, p. 127-52. 

Shape from : focus, defocus

• · Nayar, S., Watanabe, M., and Noguchi, M. "Real-Time Focus Range Sensor," Trans. PAMI, vol. 18, no. 12, 1996. -- link_to_videos
• · Yoav Y. Schechner and Nahum Kiryati, Depth from defocus vs. stereo: How different really are they? International Journal of Computer Vision 89 pp. 141-162 (2000). [Shorter Version]

Time-of-flight

• · Product = CSEM SwissRanger
  R. Lange and P. Seitz, “Solid-State Time-of-Flight Range Camera,” IEEE Journal of Quantum Electronics , vol. 37, no. 3, March 2001.
• ·M. Kawakita and K. Iizuka and T. Aida and H. Kikuchi and H. Fujikake and J. Yonai and K. Takizawa, “Axi-Vision Camera (real-time distance-mapping camera),” Applied Optics , Opt. Soc. America, vol.39, no.22, p.3931-9, Aug 2000.
• · Product = 3DV Z-CAM
  G. Iddan and G. Yahav, “3D Imaging in the Studio,” Proc. of SPIE Videometrics and Optical Methods for 3D Shape Measurement, SPIE vol. 4298, pp. 48-55, 2001.

Multiview stereo

• · Spacetime stereo, Davis et al PAMI 05 -- link
• · A Multibaseline Stereo System with Active Illumination and Real-time Image Acquisition, S. Kang, J.A. Webb, C. Zitnick, and T. Kanade, Proceedings of the Fifth International Conference on Computer Vision (ICCV '95) -- link
• · Image-Based Visual Hulls, Matusik, W., Buehler, C., Raskar, R., Gortler, S., and McMillan, L.,Proc. SIGGRAPH, 2000.

Triangulation, laser scanner, structured light

• · Szymon Rusinkiewicz, Olaf Hall-Holt and Marc Levoy, Real-Time 3D Model Acquisition, SIGGRAPH 2002. -- link
• · BOUGUET,J.-Y.,AND PERONA, P. 3d photography on your desk. ICCV (1998).
• · A Laser Range Scanner Designed for Minimum Calibration Complexity
  James Davis, Xing Chen
  3D Imaging and Modeling (3DIM), 2001. -- link

Post processing, alignment, merging, hole filling, big-projects

• · D. Huber and M. Hebert, Fully Automatic Registration of Multiple 3D Data Sets, IEEE Computer Society Workshop on Computer Vision Beyond the Visible Spectrum(CVBVS 2001), December, 2001.
• · ICP besl, mckay
• · VRIP, siggraph, curless and levoy
• · Carr range surface estimation siggraph (2001?)
• · Davis et al hole filling 3DPVT
• · Rushmeier, H., Bernardini, F., Mittleman, J., and Taubin, G.
  "Acquiring Input for Rendering at Appropriate Levels of Detail: Digitizing a Pietà,"
  (ball-pivoting algorithm) (website)
  Proc. EGRW, 1998.
• · Levoy, M. et al.
  "The Digital Michelangelo Project: 3D Scanning of Large Statues,"
  Proc. SIGGRAPH, 2000.
• · Miyazaki, D. et al.
  "The Great Buddha Project: Modelling Cultural Heritage through Observation,"
  Proc. VSMM, 2000.

Shape from shading, photometric stereo

• · Nayar, S.K., Ikeuchi, K., Kanade, T., "Recovering shape in the presence of interreflections." 1991 IEEE International Conference on Robotics and Automation, p. 1814-19. Presented by Adam Smith
• · Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs
  A. Hertzmann, S. M. Seitz. IEEE Trans. PAMI. August 2005. Vol. 27, No. 8, pages 1254-1264.
• · Photometric Method for Determining Surface Orientation from Multiple Images (Wood, 1980) (follow-on in 1994)
• · Diego Nehab, Szymon Rusinkiewicz, James Davis, Ravi Ramamoorthi,"Efficiently Combining Positions and Normals for Precise 3D Geometry," Siggraph 2005
  - Presented by Robert Hero

Light fields

• · Steven J. Gortler, Radek Grzeszczu, Richard Szeliski, Michael F. Cohen, The Lumigraph, SIGGRAPH 1996.
• · Marc Levoy and Pat Hanrahan LightField Rendering , SIGGRAPH, 1996.
• · Matusik M., Pfister, H. etal. Image-Based 3D Photography Using Opacity Hulls, SIGGRAPH, 2002
  - Presented by Daniel Keller (bruce@soe)
• · Wood, D., Azuma, D., Aldinger, K., Curless, B., Duchamp, T., Salesin, D., and Stuetzle, W.
  "Surface Light Fields for 3D Photography,"
  Proc. SIGGRAPH, 2000.
• · Ren Ng et al. Light Field Photography with a Hand-Held Plenoptic Camera (Higher quality, 11 MB) Stanford Tech Report 2005 Presented by Anne Sullivan
• · Bennet Wilburn et al. High Performance Imaging Using Large Camera Arrays. siggraph 2005

Illumination

• · Levoy, M., Chen, B., Vaish, V., Horowitz, M., McDowall, I., Bolas, M.,Synthetic aperture confocal imaging,Proc. Siggraph 2004.
• · DICARLO, J. M., XIAO, F., AND WANDELL, B. A. 2001. Illuminating illumination In 9th Color ImagingConference, 27–34.
• · Sen, P., Chen, B., Garg, G., Marschner, S. R., Horowitz, M., Levoy, M., and Lensch, H. P. 2005. Dual photography ACM Trans. Graph. 24, 3 (Jul. 2005), 745-755
• · Raskar, R.; Tan, K-H.; Feris, R.; Yu, J.; Turk, M., "Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering Using Multi-Flash Imaging", ACM Transactions on Graphics (TOG) SIGGRAPH, ISSN: 0730-0301, Vol. 23, Issue 3, pp. 679-688, August 2004 (ACM Press, TR2004-050)
• · Andrew Gardner, Chris Tchou, Tim Hawkins, Paul Debevec. Linear Light Source Reflectometry, ACM Transactions on Graphics (SIGGRAPH 2003). 22(3), pp. 749-758, 2003.

3D displays

• · Halle, M., Autostereoscopic displays and computer graphics Computer Graphics, ACM SIGGRAPH, 31(2), May 1997, pp 58-62.
• · Perlin, K., An Autostereoscopic Display, ACM Siggraph 2000 (Is this the correct paper?)
  - Presented by Daniel Keller (bruce@soe)
• · The two-user Responsive Workbench: support for collaboration through individual views of a shared Space
  M Agrawala, AC Beers, I McDowall, B Froehlich, MT … - SIGGRAPH, 1997

• Autostereoscopic 3D Displays
  Dodgson, N.A.
  Page(s):  31- 36, IEEE Computer, August 2005

• Volumetric 3D Displays and Application Infrastructure
  Favalora, G.E.
  Page(s):  37- 44 IEEE Computer, August 2005

• Computer-Generated Holography as a Generic Display Technology
  Slinger, C.; Cameron, C.; Stanley, M.
  Page(s):  46- 53 IEEE Computer, August 2005

• Displaying Stereoscopic Images (Survey), Adam Smith, November 2005