Current progress in head-mounted display based on retinal scanning

Hu Xinrong; Liu Ying; Wang Jian; Li Chun; Sun Qiang; Li Jing; Liu Bing

Volume 43 Issue 3

Apr. 2014

Turn off MathJax

Article Contents

Article Navigation > Infrared and Laser Engineering > 2014 > 43(3): 871-878

Hu Xinrong, Liu Ying, Wang Jian, Li Chun, Sun Qiang, Li Jing, Liu Bing. Current progress in head-mounted display based on retinal scanning[J]. Infrared and Laser Engineering, 2014, 43(3): 871-878.

Citation:

Hu Xinrong, Liu Ying, Wang Jian, Li Chun, Sun Qiang, Li Jing, Liu Bing. Current progress in head-mounted display based on retinal scanning[J]. Infrared and Laser Engineering, 2014, 43(3): 871-878.

Current progress in head-mounted display based on retinal scanning

1.
Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,Changchun 130033,China;
2.
University of Chinese Academy of Sciences,Beijing 100049,China

Received Date: 2013-07-04
Rev Recd Date: 2013-08-03
Publish Date: 2014-03-25

Abstract

Recent years, along with the development of head mounted display (HMD) in lightweight and miniaturization, a new style of HMD which is based on retinal scanning is gradually becoming a research hotspot in both fields of virtual reality and helmet mounted display. With a unique scanning device to control the coherent beam generated by the laser diode (LD) and scan the beam in two dimensions to produce an image, retinal scanning display (RSD) can directly scan an image on the observer's retina, which has the advantages of large field of view, high brightness and compact structure. Based on the RSD's research reports and results of foreign countries, the basic principle and technological developments of RSD were briefly summarized. Meanwhile, the current progress and key technology in this field were emphasized. At last, a brief outlook about the future development trends and application prospect of RSD was discussed.
- head-mounted display,
- retinal scanning display,
- laser scanning

References

[1]	Sutherland I E. A head-mounted three dimensional display[C]//Fall Joint Computer Conference, 1968, 33: 757-764.
[2]
[3]
[4]	Johnson R B, Driggers R G. Encyclopedia of Optical Engineering[M]. New York: Marcel Dekker, 2005.
[5]
[6]	Foote B. Design guidelines for advanced air-to-air helmet- mounted display systems [C]//SPIE, Helmet-and Head- Mounted Displays III, 1998, 3362: 94-102.
[7]
[8]	Ferrin F J. Update on optical systems for military head- mounted displays [C]//SPIE, Helmet-and Head-Mounted Displays IV, 1999, 3689: 178-185.
[9]
[10]	Ferrin F J. Current issues in helmet-mounted display systems for military applications [C]//SPIE, Helmet-and Head- Mounted Displays III, 1998, 3362: 71-79.
[11]	De Wit G C. Retinal scanning display for virtual reality [D]. Delft: Delft University of Technology, 1997.
[12]
[13]
[14]	Tidwell M, Johnston R, Melville D, et al. The virtual retinal display-a retinal scanning imaging system[C]//Proceedings of Virtual Reality World'95, 1995, 325-333.
[15]	Urey H. Optical advantages of retinal scanning displays[C]// SPIE, Helmet-and Head-Mounted Displays V, 2000, 4021: 20-26.
[16]
[17]
[18]	Johnston R, Willey S. Development of a commercial retinal scanning display [C]//SPIE, Helmet-and Head-Mounted Displays and Symbology Design Requirements II, 1995, 2465: 2-13.
[19]	Webb R H, Hughes G W, Pomerantzeff O. Flying spot TV ophthalmoscope[J]. Appl Opt, 1980, 19(17): 2991-2997.
[20]
[21]	Webb R H, Hughes G W, Delori F C. Confocal scanning laser ophthalmoscope[J]. Appl Opt, 1987, 26(8): 1492-1499.
[22]
[23]
[24]	Yoshinaka K. Display Device, Japanese Patent: 61198892[P]. 1986-09-03.
[25]	Ashizaki K, Yamamoto M, Miyaoka S, et al. Direct Viewing Picture Image Display Apparatus, European Patent: 0473343[P]. 1991-03-14.
[26]
[27]
[28]	Kollin J S, Tidwell M R. Op tical engineering challenges of the Virtual Retinal Display[C]//SPIE, Novel Optical Systems Design and Optimization, 1995, 2537: 48-60.
[29]	Jacobs R J, Bailey I L, Bullimore M A. Artificial pupils and Maxwellian view[J]. Appl Opt, 1992, 31(19): 3668-3677.
[30]
[31]	Kollin J S. A retinal display for virtual-environment applications [C]//Proceedings of Society for Information Display, 1993, 24: 827-830.
[32]
[33]	Tauscher J, Davis W O, Brown D, et al. Evolution of MEMS scanning mirrors for laser projection in compact consumer electronics [C]//SPIE, MOEMS and Miniaturized Systems IX, 2010, 7594: 75940A-1-75940A-12.
[34]
[35]	Urey H, Nestorovic N, Ng B, et al. Optical designs and system MTF for laser scanning displays [C]//SPIE, Helmetand Head-Mounted Displays IV, 1999, 3689: 238-248.
[36]
[37]	Cakmakci O, Rolland J. Head-worn displays: a review [J]. Journal of Display Technology, 2006, 2(3): 199-216.
[38]
[39]
[40]	Belt R A, Knowles G R, Lange E H, et al. Miniature flat panels in rotary wing head mounted displays [C]//SPIE, Head-Mounted Displays II, 1997, 3058: 125-136.
[41]	Niesten M, Masood T, Miller J, et al. Scanning laser beam displays based on 2-D MEMS [C]//SPIE, Optics, Photonics, and Digital Technologies for Multimedia Applications, 2010, 7723: 77230U-1-77230U-10.
[42]
[43]
[44]	Holmgren D, Robinett W. Scanned laser displays for head mounted displays [R]. University of North Carolina, Department of Computer Science, Technical Report TR92- 029, 1992, WWW. home page.
[45]	Niesten M, Sprague R, Miller J. Scanning laser beam displays [C]//SPIE, Photonics in Multimedia II, 2008, 7001: 70010E-1-70010E-10.
[46]
[47]	Holmgren D, Robinett W. Scanned laser displays for virtual reality: a feasibility study [J]. Presence: Teleoperators and Virtual Environments, 1993, 2: 171-184.
[48]
[49]
[50]	Yalcinkaya A, Urey H, Brown D, et al. Two-axis electromagnetic microscanner for high resolution displays [J]. Journal of Microelectromechanical Systems, 2006, 15 (4): 786-794.
[51]	Davis W, Sprague R, Miller J. MEMS-based pico projector display[C]//IEEE, 2008, 4244: 31-32.
[52]
[53]
[54]	Sprague R, Montague T, Brown D. Bi-axial magnetic drive for scanned beam display mirrors [C]//SPIE, MOEMS Display and Imaging Systems III, 2005, 5701: 1-13.
[55]
[56]	Miao Yongping, Liu Yongzhi. Investigation on laws of 2-D laser scanning [J]. Journal of Applied Optics, 2005, 26 (2): 27-30. (in Chinese)
[57]
[58]	Urey H, Dewitt F, Lopez P, et al. MEMS raster correction scanner for SXGA resolution retinal scanning display [C]// SPIE, MOEMS Display and Imaging Systems, 2003, 4985: 106-114.
[59]
[60]	Urey H, Wine D W, Osborne T D. Optical performance requirements for MEMS-scanner based microdisplays [C]// SPIE, MOEMS and Miniaturized Systems X, 2000, 4178: 176-185.
[61]
[62]	Urey H. Spot size, depth of focus, and diffraction ring intensity formulas for truncated Gaussian beams [J]. Appl Opt, 2004, 43(3): 620-625.
[63]	Beiser L, Johnson R B. Handbook of Optics [M]. 2nd ed. New York: McGraw-Hill, 1995.
[64]
[65]
[66]	Urey H. Torsional MEMS scanner design for high-resolution display systems [C]//SPIE, Optical Scanning II, 2002, 4773: 27-37.
[67]	Urey H, Wine D W, Lewis J R. Scanner design and resolution trade-offs for miniature scanning displays [C]// SPIE, Flat Panel Display Technology and Display Metrology, 1999, 3636: 60-68.
[68]
[69]	Patterson P, Hah D, Fujino M, et al. Scanning micromirrors: an overview [C]//SPIE, Optomechatronic Micro/Nano Components, Devices, and Systems, 2004, 5604: 195-207.
[70]
[71]	Urey H. Diffraction limited resolution and maximum contrast for scanning displays [Z]. Society for Information Display Digest of Technical Papers, 2000, 31(1): 866-869.
[72]
[73]
[74]	Stoll D. Retinal scanning leads HMD race [Z]. Photonics online, 1998.
[75]
[76]	Bayer M. Retinal scanning display: a novel HMD approach for army aviation [C]//SPIE, Helmet-and Head-Mounted Displays VII, 2002, 4711: 202-213.
[77]
[78]	Tidwell M. A virtual retinal display for augmenting ambient visual environments [D]. Seattle, Washington: University of Washington, 1995.
[79]
[80]	Bai Yu, Xing Tingwen, Jiang Yadong, et al. Design of head- mounted display optical system with DOE [J]. Infrared and Laser Engineering, 2012, 41(10): 2753-2757. (in Chinese)
[81]
[82]	Jones R J M. Direct retinal imaging and virtual displays[C]//RTO HFM Specialists'Meeting on Human Factors in the 21st Century, Paris, France, 2001, 077: 6-1-6-8.
[83]
[84]	Rash C E, Mclean W E, Mora J C, et al. Helmet-Mounted Displays: Design Issues for Rotary-Wing Aircraft [M]. Bellingham, Washington: SPIE Press, 2001.
[85]
[86]	Urey H. Diffractive exit-pupil expander for display applications[J]. Appl Opt, 2001, 40(32): 5840-5851.
[87]	Urey H, Powell K. Microlens array-based exit pupil expander for full color display applications [C]//SPIE, Photon Management, 2004, 5456: 227-236.
[88]
[89]	Kollin J S, Johnston R S, Melville C D. Virtual retinal display with expanded exit pupil, United States patent: 5701132[P]. 1997-12-23.
[90]
[91]
[92]	Powell K, Urey H. A novel approach to exit pupil expansion for wearable displays [C]//SPIE, Helmet-and Head-Mounted Displays VII, 2002, 4711: 235-248.
[93]	Powell K, Lopez P, Malik A. Exit pupil expander: image quality performance enhancements and environmental testing results [C]//SPIE, Helmet-and Head-Mounted Displays VIII, 2003, 5079: 308-320.
[94]
[95]	Urey H, Powell K. Microlens-array-based exit-pupil expander for full-color displays[J]. Appl Opt, 2005, 44(23): 4930-4936.
[96]
[97]	JrvenpT, Aaltonen V. Compact near to eye display with integrated gaze tracker[C]//SPIE, Photonics in Multimedia II, 2008, 7001: 700106-1-700106-8.
[98]
[99]
[100]	Hua Hong, Gao Chunyu. A compact eyetracked optical see- through head mounted display [C]//SPIE, Stereoscopic Displays and Applications XXIII, 2012, 8288: 82881F-1- 82881F-9.
[101]	Delori F C, Webb R H, Sliney D H. Maximum permissible exposures for ocular safety (ANSI 2000), with emphasis on ophthalmic devices [J]. Journal of the Optical Society of America A, 2007, 24(5): 1250-1265.
[102]
[103]	Wallhead I, Ocana R, Quinza P. Designing a laser scanning picoprojector. Part2: laser safety related issues [J]. Appl Opt, 2012, 51(23): 5619-5626.
[104]
[105]	Chellappan K V, Erden E, Urey H. Laser-based displays: a review[J]. Appl Opt, 2010, 49(25): F79-F98.
[106]
[107]	Buckley E. Detailed eye-safety analysis of laser-based scanned-beam projection systems [J]. Journal of Display Technology, 2012, 8(3): 166-173.
[108]
[109]	Buckley E. Eye-safety analysis of current laser-based LCOS projection systems [J]. Journal of the Society for Information Display, 2010: 1021-1057.
[110]
[111]
[112]	Klingbeil U. Safety aspects of laser scanning ophthalmoscopes[J]. Health Physics, 1986, 51(1): 81-93.
[113]	Viirre E, Johnston R, Pryor H, et al. Laser safety analysis of a retinal scanning display system [J]. Journal of Laser Applications, 1997, 9(4): 253-260.

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Get Citation

PDF

XML

Article Metrics

Article views(423) PDF downloads(774) Cited by()

Proportional views

Current progress in head-mounted display based on retinal scanning

1. Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,Changchun 130033,China;

2. University of Chinese Academy of Sciences,Beijing 100049,China

Received Date: 2013-07-04

Rev Recd Date: 2013-08-03

Publish Date: 2014-03-25

Key words:

Abstract: Recent years, along with the development of head mounted display (HMD) in lightweight and miniaturization, a new style of HMD which is based on retinal scanning is gradually becoming a research hotspot in both fields of virtual reality and helmet mounted display. With a unique scanning device to control the coherent beam generated by the laser diode (LD) and scan the beam in two dimensions to produce an image, retinal scanning display (RSD) can directly scan an image on the observer's retina, which has the advantages of large field of view, high brightness and compact structure. Based on the RSD's research reports and results of foreign countries, the basic principle and technological developments of RSD were briefly summarized. Meanwhile, the current progress and key technology in this field were emphasized. At last, a brief outlook about the future development trends and application prospect of RSD was discussed.

HTML

Reference (113)

[1]	Sutherland I E. A head-mounted three dimensional display[C]//Fall Joint Computer Conference, 1968, 33: 757-764.
[2]
[3]
[4]	Johnson R B, Driggers R G. Encyclopedia of Optical Engineering[M]. New York: Marcel Dekker, 2005.
[5]
[6]	Foote B. Design guidelines for advanced air-to-air helmet- mounted display systems [C]//SPIE, Helmet-and Head- Mounted Displays III, 1998, 3362: 94-102.
[7]
[8]	Ferrin F J. Update on optical systems for military head- mounted displays [C]//SPIE, Helmet-and Head-Mounted Displays IV, 1999, 3689: 178-185.
[9]
[10]	Ferrin F J. Current issues in helmet-mounted display systems for military applications [C]//SPIE, Helmet-and Head- Mounted Displays III, 1998, 3362: 71-79.
[11]	De Wit G C. Retinal scanning display for virtual reality [D]. Delft: Delft University of Technology, 1997.
[12]
[13]
[14]	Tidwell M, Johnston R, Melville D, et al. The virtual retinal display-a retinal scanning imaging system[C]//Proceedings of Virtual Reality World'95, 1995, 325-333.
[15]	Urey H. Optical advantages of retinal scanning displays[C]// SPIE, Helmet-and Head-Mounted Displays V, 2000, 4021: 20-26.
[16]
[17]
[18]	Johnston R, Willey S. Development of a commercial retinal scanning display [C]//SPIE, Helmet-and Head-Mounted Displays and Symbology Design Requirements II, 1995, 2465: 2-13.
[19]	Webb R H, Hughes G W, Pomerantzeff O. Flying spot TV ophthalmoscope[J]. Appl Opt, 1980, 19(17): 2991-2997.
[20]
[21]	Webb R H, Hughes G W, Delori F C. Confocal scanning laser ophthalmoscope[J]. Appl Opt, 1987, 26(8): 1492-1499.
[22]
[23]
[24]	Yoshinaka K. Display Device, Japanese Patent: 61198892[P]. 1986-09-03.
[25]	Ashizaki K, Yamamoto M, Miyaoka S, et al. Direct Viewing Picture Image Display Apparatus, European Patent: 0473343[P]. 1991-03-14.
[26]
[27]
[28]	Kollin J S, Tidwell M R. Op tical engineering challenges of the Virtual Retinal Display[C]//SPIE, Novel Optical Systems Design and Optimization, 1995, 2537: 48-60.
[29]	Jacobs R J, Bailey I L, Bullimore M A. Artificial pupils and Maxwellian view[J]. Appl Opt, 1992, 31(19): 3668-3677.
[30]
[31]	Kollin J S. A retinal display for virtual-environment applications [C]//Proceedings of Society for Information Display, 1993, 24: 827-830.
[32]
[33]	Tauscher J, Davis W O, Brown D, et al. Evolution of MEMS scanning mirrors for laser projection in compact consumer electronics [C]//SPIE, MOEMS and Miniaturized Systems IX, 2010, 7594: 75940A-1-75940A-12.
[34]
[35]	Urey H, Nestorovic N, Ng B, et al. Optical designs and system MTF for laser scanning displays [C]//SPIE, Helmetand Head-Mounted Displays IV, 1999, 3689: 238-248.
[36]
[37]	Cakmakci O, Rolland J. Head-worn displays: a review [J]. Journal of Display Technology, 2006, 2(3): 199-216.
[38]
[39]
[40]	Belt R A, Knowles G R, Lange E H, et al. Miniature flat panels in rotary wing head mounted displays [C]//SPIE, Head-Mounted Displays II, 1997, 3058: 125-136.
[41]	Niesten M, Masood T, Miller J, et al. Scanning laser beam displays based on 2-D MEMS [C]//SPIE, Optics, Photonics, and Digital Technologies for Multimedia Applications, 2010, 7723: 77230U-1-77230U-10.
[42]
[43]
[44]	Holmgren D, Robinett W. Scanned laser displays for head mounted displays [R]. University of North Carolina, Department of Computer Science, Technical Report TR92- 029, 1992, WWW. home page.
[45]	Niesten M, Sprague R, Miller J. Scanning laser beam displays [C]//SPIE, Photonics in Multimedia II, 2008, 7001: 70010E-1-70010E-10.
[46]
[47]	Holmgren D, Robinett W. Scanned laser displays for virtual reality: a feasibility study [J]. Presence: Teleoperators and Virtual Environments, 1993, 2: 171-184.
[48]
[49]
[50]	Yalcinkaya A, Urey H, Brown D, et al. Two-axis electromagnetic microscanner for high resolution displays [J]. Journal of Microelectromechanical Systems, 2006, 15 (4): 786-794.
[51]	Davis W, Sprague R, Miller J. MEMS-based pico projector display[C]//IEEE, 2008, 4244: 31-32.
[52]
[53]
[54]	Sprague R, Montague T, Brown D. Bi-axial magnetic drive for scanned beam display mirrors [C]//SPIE, MOEMS Display and Imaging Systems III, 2005, 5701: 1-13.
[55]
[56]	Miao Yongping, Liu Yongzhi. Investigation on laws of 2-D laser scanning [J]. Journal of Applied Optics, 2005, 26 (2): 27-30. (in Chinese)
[57]
[58]	Urey H, Dewitt F, Lopez P, et al. MEMS raster correction scanner for SXGA resolution retinal scanning display [C]// SPIE, MOEMS Display and Imaging Systems, 2003, 4985: 106-114.
[59]
[60]	Urey H, Wine D W, Osborne T D. Optical performance requirements for MEMS-scanner based microdisplays [C]// SPIE, MOEMS and Miniaturized Systems X, 2000, 4178: 176-185.
[61]
[62]	Urey H. Spot size, depth of focus, and diffraction ring intensity formulas for truncated Gaussian beams [J]. Appl Opt, 2004, 43(3): 620-625.
[63]	Beiser L, Johnson R B. Handbook of Optics [M]. 2nd ed. New York: McGraw-Hill, 1995.
[64]
[65]
[66]	Urey H. Torsional MEMS scanner design for high-resolution display systems [C]//SPIE, Optical Scanning II, 2002, 4773: 27-37.
[67]	Urey H, Wine D W, Lewis J R. Scanner design and resolution trade-offs for miniature scanning displays [C]// SPIE, Flat Panel Display Technology and Display Metrology, 1999, 3636: 60-68.
[68]
[69]	Patterson P, Hah D, Fujino M, et al. Scanning micromirrors: an overview [C]//SPIE, Optomechatronic Micro/Nano Components, Devices, and Systems, 2004, 5604: 195-207.
[70]
[71]	Urey H. Diffraction limited resolution and maximum contrast for scanning displays [Z]. Society for Information Display Digest of Technical Papers, 2000, 31(1): 866-869.
[72]
[73]
[74]	Stoll D. Retinal scanning leads HMD race [Z]. Photonics online, 1998.
[75]
[76]	Bayer M. Retinal scanning display: a novel HMD approach for army aviation [C]//SPIE, Helmet-and Head-Mounted Displays VII, 2002, 4711: 202-213.
[77]
[78]	Tidwell M. A virtual retinal display for augmenting ambient visual environments [D]. Seattle, Washington: University of Washington, 1995.
[79]
[80]	Bai Yu, Xing Tingwen, Jiang Yadong, et al. Design of head- mounted display optical system with DOE [J]. Infrared and Laser Engineering, 2012, 41(10): 2753-2757. (in Chinese)
[81]
[82]	Jones R J M. Direct retinal imaging and virtual displays[C]//RTO HFM Specialists'Meeting on Human Factors in the 21st Century, Paris, France, 2001, 077: 6-1-6-8.
[83]
[84]	Rash C E, Mclean W E, Mora J C, et al. Helmet-Mounted Displays: Design Issues for Rotary-Wing Aircraft [M]. Bellingham, Washington: SPIE Press, 2001.
[85]
[86]	Urey H. Diffractive exit-pupil expander for display applications[J]. Appl Opt, 2001, 40(32): 5840-5851.
[87]	Urey H, Powell K. Microlens array-based exit pupil expander for full color display applications [C]//SPIE, Photon Management, 2004, 5456: 227-236.
[88]
[89]	Kollin J S, Johnston R S, Melville C D. Virtual retinal display with expanded exit pupil, United States patent: 5701132[P]. 1997-12-23.
[90]
[91]
[92]	Powell K, Urey H. A novel approach to exit pupil expansion for wearable displays [C]//SPIE, Helmet-and Head-Mounted Displays VII, 2002, 4711: 235-248.
[93]	Powell K, Lopez P, Malik A. Exit pupil expander: image quality performance enhancements and environmental testing results [C]//SPIE, Helmet-and Head-Mounted Displays VIII, 2003, 5079: 308-320.
[94]
[95]	Urey H, Powell K. Microlens-array-based exit-pupil expander for full-color displays[J]. Appl Opt, 2005, 44(23): 4930-4936.
[96]
[97]	JrvenpT, Aaltonen V. Compact near to eye display with integrated gaze tracker[C]//SPIE, Photonics in Multimedia II, 2008, 7001: 700106-1-700106-8.
[98]
[99]
[100]	Hua Hong, Gao Chunyu. A compact eyetracked optical see- through head mounted display [C]//SPIE, Stereoscopic Displays and Applications XXIII, 2012, 8288: 82881F-1- 82881F-9.
[101]	Delori F C, Webb R H, Sliney D H. Maximum permissible exposures for ocular safety (ANSI 2000), with emphasis on ophthalmic devices [J]. Journal of the Optical Society of America A, 2007, 24(5): 1250-1265.
[102]
[103]	Wallhead I, Ocana R, Quinza P. Designing a laser scanning picoprojector. Part2: laser safety related issues [J]. Appl Opt, 2012, 51(23): 5619-5626.
[104]
[105]	Chellappan K V, Erden E, Urey H. Laser-based displays: a review[J]. Appl Opt, 2010, 49(25): F79-F98.
[106]
[107]	Buckley E. Detailed eye-safety analysis of laser-based scanned-beam projection systems [J]. Journal of Display Technology, 2012, 8(3): 166-173.
[108]
[109]	Buckley E. Eye-safety analysis of current laser-based LCOS projection systems [J]. Journal of the Society for Information Display, 2010: 1021-1057.
[110]
[111]
[112]	Klingbeil U. Safety aspects of laser scanning ophthalmoscopes[J]. Health Physics, 1986, 51(1): 81-93.
[113]	Viirre E, Johnston R, Pryor H, et al. Laser safety analysis of a retinal scanning display system [J]. Journal of Laser Applications, 1997, 9(4): 253-260.

Current progress in head-mounted display based on retinal scanning

Abstract

References

Proportional views

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Related

Proportional views