SUPER HI-VISIONON THE HORIZON

PRESENTED BY

NIDHEESH VP CS-7

2

INDEX1. INTRODUCTION

2. OUTLINE OF SHV

3. VIDEO SYSTEM FOR SHV

4. SOUND SYSTEM FOR SHV

5. DEVELOPMENT OF SHV EQUIPMENTS

6. PROGRESS IN DEVELOPMENT

7. FULL-RESOLUTION SYSTEMS

8. TRANSMISSION TRIALS WITH SHV SIGNALS

9. CONCLUTION

10. REFERENCES

3

INTRODUCTION

Super hi-vision (SHV) can provide an increased sense of reality and presence to viewers.

The Japan Broadcasting Corporation (Nippon Hōsō Kyōkai, NHK) has been developing an extremely high-resolution video system called

super hi-vision (SHV)

SHV is an ultra high-definition television (UHDTV)

• It has 33 megapixels along with 22.2-multichannel sound

• It pixel count is 16 times larger than thatof HDTV

4

INTRODUCTION (CONTINUE)

• The 22.2-multichannel sound is achieved througha three-dimensional (3-D) sound system that provides a moreimmersive experience than the conventional 5.1-channelsurround.

• The SHV system was designed on the basis of our human sciences research on audiovisual perception characteristics

• SHV is outlined and recent research anddevelopment on this future TV system is described

5

OUTLINE OF SHV

SHV was designed to provide an enhanced sense of reality and presence and a new audiovisual experience

This enhanced sense provides viewers with a sensation of reality as if a real object was in front of them.

SHV will provide a sense of being there and a sense of realness that distinguishes itself from existing TV systems

6

The basic parameters of the SHV system were decided on the basis of studies human visual and auditory senses.

OUTLINE OF SHV(contd)

7

compared with HDTV For SHV a total of 33 megapixels per frame Because of the greater pixel density

the individual pixels are far less noticeable even in close proximity to the screen

securing a wider viewing angle.

the Society of Motion Picture & Television Engineers (SMPTE), has published the essential standards for basic SHV system parameters

• image formats, • audio channel mapping• signal interface

OUTLINE OF SHV (contd…)

8

VIDEO SYSTEM FOR SHV

VIDEO SYSTEM FOR SHV

1. STUDIES ON THE SENSE OF REALITY AND PRESENCE

2. VIEWING STYLES WITH SHV

9

1. STUDIES ON THE SENSE OF REALITY AND PRESENCE

A wider viewing angle leads to a stronger sense of being there.

The sense of being there increases with angle of around 80%–100%.

The wide visual angle includes the induced visual field of the human visual system.

Viewing distance that is 0.75–1.00 times the picture height.

A distance at which people with normal visual acuity cannot discern the pixel structure.

VIDEO SYSTEM FOR SHV (contd..)

10

Both images with various resolutions and real objects were viewed through an experimental setup

Such as cular disparity, image size, perspective, luminance, and color

Observers were asked to choose the image that appeared closer to the real object.

The results show that the sense of realness increases with the angular resolution about 60 cycles per degree (cpd)

An image resolution of 30 cpd, corresponds to the minimum separable angle of normal vision .

This angleis often used as the criterion for viewing conditions

VIDEO SYSTEM FOR SHV (contd…)

11

VIDEO SYSTEM FOR SHV (contd…)

2.VIEWING STYLES WITH SHV

the image format of SHV was decided to be 7,680×4,320 pixels, which is four times the resolution of HDTV

SHV can provide both the sense of being there and the sense of realness for a wide range of viewing angles or viewing distances.

This feature of SHV is expected to be used effectively in various viewing environments and for large, medium, and small displays

12

FIGURE 1. Viewing styles for enjoying SHV at home.

(a) A large screen conveys a sense of being there. An SHV system has a highenough resolution on large screens. We can enjoy life-size images to create a high sense of presence.

(b) A midsize screen conveys asense of realness. We can view the extremely high-resolutionimages over a wide range of viewing distances.

FIGURE 1.

13

(c) An SHV display can be used as an information display for a variety of content. When we realize an ultra-thin and flexible personal screen, we can enjoy photogravure-quality moving pictures on a portable display.

14

SOUND SYSTEM FOR SHV Sound is also essential for conveying an enhanced sense of

Reality

Sound localization and envelopment are related to spatial characteristics of natural sound

The spatial characteristics of sound become important particularly in 3-D sound systems that can reproduce an enhanced spatial sound experience.

The sound system for SHV requires stable sound localization over a TV screen and reproduction of a 3-D spatial impression that augments a sense of reality.

The system has 22.2 multichannel The system has three layers of loudspeakers

consists of nine channels at the top layer ten channels at the middle layer three channels at the bottom layer two Low Frequency Effect (LFE) channels.

15

The middle layer has eight loudspeakers at a 45% arrangement and an additional two loudspeakers to match sound localization with the video images on the screen.

It also has two LFE channels to create an enhanced sound experience.

the 22.2-multichannel system has the following features:

stable localization of frontal sounds over the entire screen area

reproduction of sound images in all 3-D directions around a viewer/listener

creation of a wide listening area with exceptional sound quality

compatibility with existing multichannel sound systems.

SOUND SYSTEM FOR SHV (contd..)

16FIGURE 2. A loudspeaker layout of a 22.2-multichannel sound system.

17

DEVELOPMENT OF SHV EQUIPMENTS

THE FIRST EXPERIMENTAL SYSTEMS

• Started to developing SHV equipment around 2000

• First developed a camera, a projector, and recording Equipment • started R&D on SHV, only 8-megapixel imaging devices were

available

• first experimental systems used a dual-green format with four 8-megapixel devices, two for green (G),one for red (R), and one for blue (B)

18

DEVELOPMENT OF SHV EQUIPMENTS(contd..)

• a green signal contributes the most to the resolution of an image

• the number of sampling points for a green signal is equivalently double in both the horizontal and vertical directions.

• developed the first experimental SHV camera (Figure 3),

• whose camera head weighs 80 kg and uses four 8 megapixel charge-coupled devices

19

DEVELOPMENT OF SHV EQUIPMENTS(contd..)

• The first prototype SHV projector (Figure 4) consisted of two stacked projectors

• it is used four 8-megapixel liquid crystal on silicon (LCOS) panels

• The use of separate projectors for the G image and R and B images requires convergence correction,

20FIGURE 3. The first prototype SHV camera using four 8-megapixel2.5-in CCD image sensors (2002).

21

PROGRESS IN DEVELOPMENT• improving performance and reducing the size of the

equipment

• The camera head has since been dramatically reduced in size and weight, and the latest camera head (Figure 5) is only 20kg

• Developed a compact SHV projector ,uses three 8-megapixel LCOS panels, one each for R, G, and B.

• a new optical device that performs half-pixel shifting of each

of the three primary colors every second frame

• developed mobile and recording capacity of 2 h

• developed a compressed flash memory recorder whose total recording time is about 2 h with 34 cards.

22

• developing systems that can be used for efficient program production

• video editing system, alive switcher, and slow playback recorders.

• a compact 22.2-multichannel microphone array (Figure 7) that enables us to easily capture 3-D sound outdoors.

• A new audio mixing console (Figure 8) has a 3-D panning function

• that can localize sound images at arbitrary positions in 3-D sound fields

23FIGURE 4. The first prototype SHV projector consisted of twostacked projectors (2002).

FIGURE 5. A practical SHV camera using four 8-megapixel 1.25-in CMOS image sensors (2010)

24

FIGURE 6. A compact projector capable of displaying SHV byusing 4,000 x 2,000 pixel display devices (2010).

FIGURE 7. A one-point 22.2-channel soundmicrophone (2009).

25FIGURE 8. A 22.2-multichannel audio mixing system that cansimultaneously combine more than 1,000 sound elements (2010).

26

FULL-RESOLUTION SYSTEMS• developed a full resolution SHV video system with three 33-megapixel devices for R, G, and B

• developed an SHV camera (Figure 9) with three33-megapixel CMOS

image sensors in 2010

• SHV projector (Figure 10) with three 33-megapixel LCOS panels in 2009.

• An 85-in liquid crystal display (LCD) with full-resolution SHV in 2011 (Figure 11). • With this flat panel display, it is possible to enjoy immersive high-

quality SHV at your preferred viewing distance in a room.

• also developed loudspeakers integrated into the display for reproducing 22.2-multichannel sound

• This system makes it possible to reproduce sounds from all directions

27FIGURE 9. A full-resolution SHV prototype camera using three 33-megapixel CMOS image sensors (2010).

• provide a feeling of spaciousness that contributes to the strong sense of presence and reality.

FULL-RESOLUTION SYSTEMS(contd..)

28FIGURE 10. A full-resolution SHV projector with three 33-megapixel LCOS panels (2009).

29FIGURE 11. An 85-in full-resolution SHV direct-view LCD with a pixel pitch of 0.25 mm (2011).

30

TRANSMISSION TRIALS WITH SHV SIGNALS

• carried out a first transmission trial of an uncompressed SHV signal by using an optical fiber network in 2005

• The data rate of SHV is very large, highly efficient video coding and wide band transmission are essential technologies for broadcasting

• developed an MPEG-2 codec in 2005 and automatic volume control (AVC)/H.264 codecs in 2007 and 2010 (Figure 12),respectively

• Using these codecs, we carried out SHV transmission tests via both

satellite links and IP networks • The world’s first international transmission experiment was jointly

conducted by NHK, BBC (United Kingdom), RAI(Italy), and the European Broadcasting Union (EBU) at the International Broadcasting Convention (IBC) 2008 in Amsterdam (Figure 13).

31

• A compressed SHV signal (600 Mb/s) was transmitted from London to Amsterdam over an optical fiber network ,.

• Another one at 140 Mb/s was transmitted from Turin to Amsterdam via the satellite link

• NHK and the National Institute of Communications Technologies conducted a multichannel SHV transmission experiment by using the Wideband Internet working Engineering Test and Demonstration Satellite(WINDS) in 2009

• developed a 300-MHz wideband modulator for 370–500 Mb/s transmission

• A live program from Sapporo was transmitted through an IP network to Kashima, and three SHV programs were transmitted via WINDS from Kashima to NHK Science& Technology Research Laboratories (STRL) in Tokyo.

• SHV programs were compressed to 100 Mb/s by using the AVC/H.264 codec

32FIGURE 12. An AVC/H.264-based codec using eight 1,080-60Pencoding units (2010).

33

FIGURE 13. Public viewing at IBC 2008: SHV programs were transmitted live from London to Amsterdam.

34

SHV was designed to provide an enhanced sense of reality and presence and a new audiovisual experience.

The technologies of SHV will contribute to various applications besides broadcasting

The transmission systems can be used for various events such as live relays of sports or music events on a

global scale. cooperative museum exhibitions. telemedicine.

we believe that rich media will bring us rich life in the future. We hope that SHV will enrich our lifestyles in many new ways

CONCLUSION

35

REFERENCES [1] M. Sugawara, M. Kanazawa, K. Mitani, H. Shimamoto, T.

Yamashita, and F. Okano, “Ultrahigh-definition video system with 4000 scanning lines,” SMPTE Motion Imaging, vol. 112, no. 10/11, pp. 339–346,2003.

[2] M. Sugawara, K. Masaoka, M. Emoto, Y. Matsuo, and Y. Nojiri, “Research on human factors in ultra-high-definition television to determine its specifications,” SMPTE Motion Imaging, vol. 117, no. 3, pp.23–29, 2008.

[3] Y. Nishida, K. Masaoka, M. Sugawara, K. Ohmura, M. Emoto, and E. Nakasu, “Super hi-vision system offering enhanced sense of presence and new visual experience,” in Proc. IBC 2011.

[4] Ultra High Definition Television—Image Parameter Values for Program Production, SMPTE 2036-1-2009.

[5] Ultra High Definition Television—Audio Characteristics and Audio Channel Mapping for Program Production, SMPTE 2036-2-2008

36

[6] Ultra High Definition Television—Mapping into Single-Link or Multilink 10 Gb/s Serial Signal/Data Interface, SMPTE 2036-3-2010.

[7] K. Masaoka, M. Emoto, M. Sugawara, and Y. Nojiri, “Contrast effect in evaluating the sense of presence for wide displays,” J. SID, vol. 14, no. 9, pp. 785–791, 2006.

[8] K. Masaoka, M. Emoto, M. Sugawara, and Y. Nojiri, “Comparing realness between real objects and images at various resolutions,” in Proc. SPIE-IS&T Electronic Imaging, 2007, vol. 6492,pp. 1–9.

[9] K. Hamasaki, K. Hiyama, and R. Okumura, “The 22.2 multichannel

sound system and its application,” presented at the AES 118th Convention , Barcelona, Spain, May 2005, Paper #6406.

[10] H. Shimamoto, T. Yamashita, N. Koga, K. Mitani, M. Sugawara, F.

Okano, M. Matsuoka, J. Shimura, I. Yamamoto, T. Tsukamoto, and S. Yahagi, “An 8k # 4k ultrahigh-definition color video camera with 8M-pixel CMOS imager,” SMPTE Motion Imaging, vol. 114, no. 7–8, pp. 260–268, 2005