hdtv/dtv: technical overview and roadmap dr. nikhil balram vice president of advanced technology...
TRANSCRIPT
HDTV/DTV: Technical Overview and Roadmap HDTV/DTV: Technical Overview and Roadmap Dr. Nikhil BalramDr. Nikhil Balram
Vice President of Advanced TechnologyVice President of Advanced TechnologyFaroudja Laboratories, Sunnyvale, CAFaroudja Laboratories, Sunnyvale, CA
IEEE Communications Society Seminar, 10th November 1999IEEE Communications Society Seminar, 10th November 1999
OverviewOverview HDTV/DTV OverviewHDTV/DTV Overview
• History & current statusHistory & current status• Technical overviewTechnical overview• Major playersMajor players• Barriers to rapid penetration/deploymentBarriers to rapid penetration/deployment
SourceSource
ChannelChannel
Receiver/DisplayReceiver/Display
ForecastsForecasts
SummarySummary
AcknowledgementsAcknowledgements
ReferencesReferences
Disclaimer:Disclaimer: All opinions/material presented in this seminar are solely the responsibility of the author All opinions/material presented in this seminar are solely the responsibility of the author and do not necessarily represent the views of current or past employers. Any trademarks or brand and do not necessarily represent the views of current or past employers. Any trademarks or brand names mentioned here are the properties of their respective holders and are hereby acknowledged. names mentioned here are the properties of their respective holders and are hereby acknowledged.
HDTV/DTV OverviewHDTV/DTV Overview HistoryHistory
Technical overviewTechnical overview
Major playersMajor players
Barriers to rapid penetration/deploymentBarriers to rapid penetration/deployment
HistoryHistoryHDTV/DTV OverviewHDTV/DTV Overview
19871987• Broadcasters petition FCC to institute rules for terrestrial HDTV broadcastBroadcasters petition FCC to institute rules for terrestrial HDTV broadcast• FCC creates Advisory Committee on Advanced Television Services (ACATS) FCC creates Advisory Committee on Advanced Television Services (ACATS)
to gather information and recommend a standardto gather information and recommend a standard
19881988• US Broadcasters create Advanced Television Test Center (ATTC) to conduct US Broadcasters create Advanced Television Test Center (ATTC) to conduct
tests of the proposed systemstests of the proposed systems
1989/901989/90• Cable industry through Cable Television Labs (CableLabs) prepares to test Cable industry through Cable Television Labs (CableLabs) prepares to test
proposed Advanced Television (ATV) systems over cable networksproposed Advanced Television (ATV) systems over cable networks• 9 systems offered to ATTC for testing: all analog except Zenith hybrid9 systems offered to ATTC for testing: all analog except Zenith hybrid
– Faroudja Labs, MIT, North American Phillips (NAP), Production Services Inc., Faroudja Labs, MIT, North American Phillips (NAP), Production Services Inc., Zenith Electronics, 2 from David Sarnoff Research Center (DSRC), 2 from Japan Zenith Electronics, 2 from David Sarnoff Research Center (DSRC), 2 from Japan Broadcasting Corporation (NHK)Broadcasting Corporation (NHK)
History (cont.)History (cont.)HDTV/DTV OverviewHDTV/DTV Overview
1990/91 1990/91 • FCC favors simulcast (full HDTV with eventual shutdown of NTSC) versus FCC favors simulcast (full HDTV with eventual shutdown of NTSC) versus
augmentationaugmentation• Shift to digital started by General Instruments (GI) DigiCipherShift to digital started by General Instruments (GI) DigiCipher• 6 systems (4 digital) from different coalitions tested by ATTC 6 systems (4 digital) from different coalitions tested by ATTC
1992 1992 • Advanced Television Systems Committee (ATSC) agrees to coordinate task of Advanced Television Systems Committee (ATSC) agrees to coordinate task of
documenting standard chosen by FCCdocumenting standard chosen by FCC
19931993• Analog options eliminatedAnalog options eliminated• Proponents of the 4 digital systems form Grand Alliance (GA)Proponents of the 4 digital systems form Grand Alliance (GA)
– AT&T, DSRC, GI, MIT, NAP, Thomson Consumer Electronics, Zenith ElectronicsAT&T, DSRC, GI, MIT, NAP, Thomson Consumer Electronics, Zenith Electronics
19941994• ACATS approves GA systemACATS approves GA system
1995/961995/96• ATSC documents and approves standard based on GA systemATSC documents and approves standard based on GA system
History (cont.)History (cont.)HDTV/DTV OverviewHDTV/DTV Overview
19961996• FCC proposes to adopt GA system as documented by ATSCFCC proposes to adopt GA system as documented by ATSC• Computer Industry Coalition on Advanced Television Services (CICATS) files Computer Industry Coalition on Advanced Television Services (CICATS) files
strong objection and proposes progressive SDTV with future path to HDTV strong objection and proposes progressive SDTV with future path to HDTV through an augmentation signalthrough an augmentation signal
Dec 24 1996Dec 24 1996• FCC adopts ATSC DTV standard except for table 3 with 18 formats (6 HD, 12 FCC adopts ATSC DTV standard except for table 3 with 18 formats (6 HD, 12
SD)SD)
19971997• HDTV rollout schedule agreed toHDTV rollout schedule agreed to
– Some stations in top 10 markets to offer some programming by November 1, 1998Some stations in top 10 markets to offer some programming by November 1, 1998– Top 10 markets (covering 30% of US households) to be on air by May 1, 1999Top 10 markets (covering 30% of US households) to be on air by May 1, 1999– Top 30 markets (covering 50% of US households) to be on air by November 1, 1999Top 30 markets (covering 50% of US households) to be on air by November 1, 1999– All commercial stations on air by May 1, 2002, (public stations get 1 more year)All commercial stations on air by May 1, 2002, (public stations get 1 more year)– NTSC broadcasting to cease on May 1, 2006, (later changed to whenever 85% of NTSC broadcasting to cease on May 1, 2006, (later changed to whenever 85% of
market is using HDTV sets) market is using HDTV sets)
Nov 1998Nov 1998• HDTV broadcasts beginHDTV broadcasts begin
Current Status Current Status HDTV/DTV OverviewHDTV/DTV Overview
November 1999November 1999• OverallOverall
– 474 TV stations have filed construction permit applications474 TV stations have filed construction permit applications– 220 have been granted DTV construction permits220 have been granted DTV construction permits– 66 are on air with full facilities66 are on air with full facilities– 25 are on air with special or experimental DTV authority25 are on air with special or experimental DTV authority
• Top 10 market network affiliates - 40 stationsTop 10 market network affiliates - 40 stations– 32 are on air with full facilities32 are on air with full facilities– 8 have requested second extensions8 have requested second extensions
• Markets 11-30 network affiliates - 79 stationsMarkets 11-30 network affiliates - 79 stations– 20 are on air with full facilities20 are on air with full facilities
See www.fcc.gov/mmb/vsd/files for more informationSee www.fcc.gov/mmb/vsd/files for more information
Technical OverviewTechnical OverviewHDTV/DTV OverviewHDTV/DTV Overview
Video: Video: • MPEG2 Main Profile @ High Level (MP@HL)MPEG2 Main Profile @ High Level (MP@HL)• 18 formats: 6 HD, 12 SD18 formats: 6 HD, 12 SD
Audio: Audio: • Dolby AC-3Dolby AC-3
Transport: Transport: • Subset of MPEG2Subset of MPEG2• Fixed length 188-byte packetsFixed length 188-byte packets
RF/Transmission:RF/Transmission:• Terrestrial: Terrestrial:
– 8-VSB (Vestigial Side Band) with Trellis coding8-VSB (Vestigial Side Band) with Trellis coding– effective payload of ~19.3 Mb/s (18.9 Mb/s used for video)effective payload of ~19.3 Mb/s (18.9 Mb/s used for video)
• Cable: Cable: – 16-VSB16-VSB– effective payload of ~38.6 Mb/seffective payload of ~38.6 Mb/s
HDTV/DTV System LayersHDTV/DTV System Layers
PictureLayer
CompressionLayer
TransportLayer
TransmissionLayer
MPEG-2 packets
MPEG-2 videoand Dolby AC-3
compressionsyntax
Multiple Picture Formatsand Frame Rates
Multiple Picture Formatsand Frame Rates
8-VSB
Video packet Video packetAudio packet Aux data
DataHeaders
MotionVectors
Chroma and LumaDCT Coefficients
Variable Length Codes
layered system with header/descriptors
Flexible delivery of dataand future extensability
Flexible delivery of dataand future extensability
19.3 Mb/s
Packet Headers
996 Mb/s1920 x 1080
@60I
Source:Sarnoff CorporationSource:Sarnoff Corporation
HDTV/DTV OverviewHDTV/DTV Overview
6 MHz
HDTV/DTV MPEG2 TransportHDTV/DTV MPEG2 Transport
audio 1
...packets with header/descriptors enable flexiblility and features...
video video TEXT video audio 2 PGM GD video video
Many services can be dynamically multiplexed and delivered to the viewer
video video
184 Byte Payload (incl. optional Adaptation Header)
188 Byte Packet
4 BytePacket Header
Video Adaptation Header(variable length)
Source:Sarnoff CorporationSource:Sarnoff Corporation
Packet syncType of data the packet carriesPacket loss/misordering protectionEncryption controlPriority (optional)
Time synchronizationMedia synchronizationRandom access flagBit stream splice point flag
HDTV/DTV OverviewHDTV/DTV Overview
MPEG2 Video Basics: MPEG2 Video Basics: Sequence
(Display Order)
GOP(Display Order,
N=12, M=3)
Picture
Slice
MacroBlock
YCr
Cb
4 50 1
2 3Y Blocks Cr Block Cb Block
B B B B B B B BI P P P
Note:
Y = Luma
Cr = Red-Y
Cb = Blue-Y
Source:Sarnoff CorporationSource:Sarnoff Corporation
HDTV/DTV OverviewHDTV/DTV Overview
MPEG2 Video BasicsMPEG2 Video BasicsHDTV/DTV OverviewHDTV/DTV Overview
MPEG2 Profiles/Levels MPEG2 Profiles/Levels • MPEG specification is generic - intended to cover wide range of applicationsMPEG specification is generic - intended to cover wide range of applications• ““Profiles” and “Levels” used to put bounds around parameters for applicationsProfiles” and “Levels” used to put bounds around parameters for applications
– ““Profile” is subset of bitstream syntaxProfile” is subset of bitstream syntax– ““Level” constrains parameters within allowed syntaxLevel” constrains parameters within allowed syntax
• Main Profile @ Main Level (MP@ML) - DVDMain Profile @ Main Level (MP@ML) - DVD– 4:2:0 I,P,B, bit rates up to 15 Mb/s4:2:0 I,P,B, bit rates up to 15 Mb/s
• Main Profile @ High Level (MP@HL) - HDTVMain Profile @ High Level (MP@HL) - HDTV– 4:2:0 I,P,B, bit rates up to 80 Mb/s 4:2:0 I,P,B, bit rates up to 80 Mb/s
Block Diagram of MPEG2 EncoderBlock Diagram of MPEG2 Encoder
Motion Compensation
DCT
“Previous” & “Future” Frames
Present frame +
+Q VLC
MotionEstimation
IDCT
Q-1
-
DCT Coefficients
Motion Vectors
MPEG2 Video Basics: Discrete Cosine Transform (DCT)MPEG2 Video Basics: Discrete Cosine Transform (DCT)
Image Transform domain
8x8 coefficients
Spatialdomain
8x8 pixels
8 x 8DCT
8 x 8DCT-1
Spatialdomain
8x8 pixels
ReconstructedImage
DCT is an orthogonal transformationDCT is an orthogonal transformation 2-D DCT is separable in x and y dimensions2-D DCT is separable in x and y dimensions Has good energy compaction propertiesHas good energy compaction properties Close to Karhunen-Loeve Transform (KLT), which is Close to Karhunen-Loeve Transform (KLT), which is
optimal but depends on image statistics.optimal but depends on image statistics. Efficient hardware realizationEfficient hardware realization Theoretically Theoretically losslesslossless, but slightly lossy in practice due , but slightly lossy in practice due
to round off errorsto round off errors
Source:Sarnoff CorporationSource:Sarnoff Corporation
HDTV/DTV OverviewHDTV/DTV Overview
MPEG2 Video Basics: Discrete Cosine Transform (DCT)MPEG2 Video Basics: Discrete Cosine Transform (DCT)
pixels frequency coefficients
8x8DCT
low high
255 255 255 255 255 255 255 255 255 187 204 255 255 255 255 255 255 122 20 102 230 255 255 255 255 153 0 0 35 136 213 255 255 196 0 0 0 0 17 94 255 247 43 0 0 0 0 0 255 255 82 0 0 0 0 0 255 255 128 0 0 0 0 0
300137
51-12
-82
-1-6
59-942540
314-32
89-35-42
-81714-2-6
394
-20-16-13
512
6
717
-14-4-4-708
-1316
1-400
-4 0
-1275
-52
-1 0 0
-727
-5-1010
“DC” horizontal
vertical
Note: Transform values in this example are for illustration only.
low
high
8x8 pixel blocks transformed to 8x8 frequency coefficient blocks8x8 pixel blocks transformed to 8x8 frequency coefficient blocks Applied to intra-field blocks and motion-compensated (prediction Applied to intra-field blocks and motion-compensated (prediction
error) blocks error) blocks
HDTV/DTV OverviewHDTV/DTV Overview
Source:Sarnoff CorporationSource:Sarnoff Corporation
MPEG2 Video Basics: Motion-compensated PredictionMPEG2 Video Basics: Motion-compensated Prediction
Current P or B PicturePrevious I or P Picture
XF
MVF
Instead of sending quantized DCT coefficients of X, send:
1. quantized DCT coefficients of X-F (prediction error). If prediction is good, error will be near zero and will need few bits.
2. MVF, the motion vector. This will be differentially coded with respect to its neighboring vector, and will code efficiently.
This will typically result in 50% - 80% savings in bits.
CurrentMacroblock
HDTV/DTV OverviewHDTV/DTV Overview
ATSC FormatsATSC FormatsHDTV/DTV OverviewHDTV/DTV Overview
Vertical Horizontal Aspect Ratio Picture Rate1080 1920 16:9 60I, 30P, 24P720 1280 16:9 60P, 30P, 24P480 704 16:9 & 4:3 60P, 60I, 30P, 24P480 640 4:3 60P, 60I, 30P, 24P
HDTV
SDTV““HD0”HD0”
18 formats: 6 HD, 12 SD 18 formats: 6 HD, 12 SD • 720 vertical lines and above considered High Definition720 vertical lines and above considered High Definition• Choice of supported formats left voluntary due to disagreement between Choice of supported formats left voluntary due to disagreement between
broadcasters and computer industrybroadcasters and computer industry– Computer industry led by Microsoft wants exclusion of interlace and initially use of Computer industry led by Microsoft wants exclusion of interlace and initially use of
only those formats which leave bandwidth for data services - “HD0” subsetonly those formats which leave bandwidth for data services - “HD0” subset
• Different picture rates depending on motion content of applicationDifferent picture rates depending on motion content of application– 24 frames/sec for film24 frames/sec for film– 30 frames/sec for news and live coverage30 frames/sec for news and live coverage– 60 fields/sec, 60 frames/sec for sports and other fast action content60 fields/sec, 60 frames/sec for sports and other fast action content
1920 x 1080 @ 60 frames/sec not included because it requires 1920 x 1080 @ 60 frames/sec not included because it requires ~100:1 compression to fit in 19.3 Mb/s terrestrial channel, ~100:1 compression to fit in 19.3 Mb/s terrestrial channel, which cannot be done at high quality with MPEG2 which cannot be done at high quality with MPEG2
Aspect RatiosAspect Ratios
800800
600600 450450
16:9 aspect ratio16:9 aspect ratio
800800
600600
4:3 aspect ratio4:3 aspect ratio
HDTV/DTV OverviewHDTV/DTV Overview
Two options: 16:9 and 4:3Two options: 16:9 and 4:3
4:3 standard aspect ratio for US TV and computer monitors4:3 standard aspect ratio for US TV and computer monitors
HD formats are 16:9HD formats are 16:9• better match with cinema aspect ratiobetter match with cinema aspect ratio• better match for aspect ratio of human visual systembetter match for aspect ratio of human visual system• better for some text/graphics tasks better for some text/graphics tasks
– allows side-by-side viewing of 2 pagesallows side-by-side viewing of 2 pages
Aspect RatiosAspect RatiosHDTV/DTV OverviewHDTV/DTV Overview
Full Zoom Full Zoom Squeeze
16 x 9 Display Modes 4 x 3 Display Modes
SqueezeVariableExpand
VariableShrink
(j)(d)(b)(a)
4
3
(e) (f) (g) (i) (h)
16
9
(c)
VideoTransmission
Format
Aspect ratio conversion will be requiredAspect ratio conversion will be required• 4:3 material on 16:9 monitor4:3 material on 16:9 monitor• 16:9 material on 4:3 monitor16:9 material on 4:3 monitor
Several options (shown below)Several options (shown below)
Viewing Distance Versus ResolutionViewing Distance Versus Resolution
Minimum Vertical Lines
0
200
400
600
800
1000
1200
0 10 20 30 40 50 60
4:3 Display Diagonal (inch)
2 3
36.724.5 44.1 61.216:9 Display Diagonal (Inch)
Viewing Distance (meters)
Source: McLaughlin Consulting GroupSource: McLaughlin Consulting Group
HDTV/DTV OverviewHDTV/DTV Overview
VERTICAL
LINES
PER
PICTURE
HT.
MINIMUM VERTICAL LINES
Display Size Display Size SDTV vs. HDTVSDTV vs. HDTV
• SDTV is adequate for small size TVs (<30 inches) at normal (>2 SDTV is adequate for small size TVs (<30 inches) at normal (>2 meters) viewing distancesmeters) viewing distances
• Current PC monitor definition offers excellent HDTV imaging at close Current PC monitor definition offers excellent HDTV imaging at close viewing distances (<1 meter)viewing distances (<1 meter)
– However, it may not feel the same as a large screen display even though it However, it may not feel the same as a large screen display even though it subtends the same angle ?subtends the same angle ?
• Major opportunity for HDTV is for big screens (>>30 inches) viewed Major opportunity for HDTV is for big screens (>>30 inches) viewed at > 2 metersat > 2 meters
PC vs. TVPC vs. TV• Both SDTV and HDTV can be displayed on 19”/21” PC monitorsBoth SDTV and HDTV can be displayed on 19”/21” PC monitors• Big screens TVs for family entertainmentBig screens TVs for family entertainment
The widescreen requirementThe widescreen requirement• Major new requirement of DTV is widescreen formatMajor new requirement of DTV is widescreen format• Requires widescreen home PC monitors and SDTVsRequires widescreen home PC monitors and SDTVs
HDTV/DTV OverviewHDTV/DTV Overview
Interlace vs ProgressiveInterlace vs ProgressiveHDTV/DTV OverviewHDTV/DTV Overview
Direct-view and projection CRT TVs typically use interlaced scanning, alternating between all odd lines and all even lines
CRT monitors and Flat Panel Displays put lines up in consecutive order
Odd Even
Reasons for interlacing in NTSC/PALReasons for interlacing in NTSC/PAL• Conserves bandwidth & storageConserves bandwidth & storage• Maintains frame rate & vertical resolutionMaintains frame rate & vertical resolution• Minimizes line structureMinimizes line structure
Odd & Even
Interlaced Vertical-Temporal Spectrum: 525 Lines @ 60IInterlaced Vertical-Temporal Spectrum: 525 Lines @ 60IHDTV/DTV OverviewHDTV/DTV Overview
30
262.5
60 TemporalFreq. (Hz)
Spatial Freq. (cycles/picture height)
525
0
I
II
III
V
A
B
C
D
E
F
Spectrum of (NTSC) interlaced video: I is original content, II, III, IV, V Spectrum of (NTSC) interlaced video: I is original content, II, III, IV, V are replicas caused by V-T samplingare replicas caused by V-T sampling
Interlacing artifacts: line twitter/flicker, line crawl, featheringInterlacing artifacts: line twitter/flicker, line crawl, feathering
IV
Progressive Vertical-Temporal Spectrum: 525 Lines at 60PProgressive Vertical-Temporal Spectrum: 525 Lines at 60PHDTV/DTV OverviewHDTV/DTV Overview
30
262.5
60 Temporal Freq. (Hz)
Spatial Freq. (cycles/picture height)
525
0
I
II
III
Spectrum of (NTSC-like) progressive video: I is original content, II, III, Spectrum of (NTSC-like) progressive video: I is original content, II, III, IV are replicas caused by V-T samplingIV are replicas caused by V-T sampling
Absence of replica V avoids artifacts created by interlacingAbsence of replica V avoids artifacts created by interlacing
Uses 2X as much bandwidth as 525 @ 60IUses 2X as much bandwidth as 525 @ 60I
IV
Addressability vs ResolutionAddressability vs ResolutionHDTV/DTV OverviewHDTV/DTV Overview
Addressability refers to number of pixels/lines that can be addressedAddressability refers to number of pixels/lines that can be addressed
Resolution is number of pixels (lines) that can be resolvedResolution is number of pixels (lines) that can be resolved• Measured as line pairs or TV-linesMeasured as line pairs or TV-lines
Resolution is usually less than addressability due toResolution is usually less than addressability due to• Bandwidth of channel and electronics Bandwidth of channel and electronics
– cables, video amplifiers, etccables, video amplifiers, etc
• Characteristics of reconstruction filter (display system)Characteristics of reconstruction filter (display system)– CRTs (horizontally): Gaussian spotCRTs (horizontally): Gaussian spot
– described by Modulation Transfer Function (MTF)described by Modulation Transfer Function (MTF)
– FPDs (and CRTs in vertical direction): spatially varyingFPDs (and CRTs in vertical direction): spatially varying– this is why NTSC is considered to have ~330 lines of resolution even though there are this is why NTSC is considered to have ~330 lines of resolution even though there are
480 active lines. # active lines is derated by Kell factor of 0.7480 active lines. # active lines is derated by Kell factor of 0.7– described by Multi-valued Modulation Transfer Function (MMTF)described by Multi-valued Modulation Transfer Function (MMTF)
Major implications for design of optimal video display systemMajor implications for design of optimal video display system
Interactivity & Data ServicesInteractivity & Data ServicesHDTV/DTV OverviewHDTV/DTV Overview
DTV bandwidth can be used for digital dataDTV bandwidth can be used for digital data• Allows new data enhanced viewing modesAllows new data enhanced viewing modes
– instant access to information such as player statistics, profiles of actors, etc.instant access to information such as player statistics, profiles of actors, etc.
• Simulated and actual interactivitySimulated and actual interactivity– real interactivity possible if platform has backchannelreal interactivity possible if platform has backchannel
Sophisticated electronic programming guide needed to manage much Sophisticated electronic programming guide needed to manage much greater choice created by multicast of SDTV streams greater choice created by multicast of SDTV streams • HDTV channel can be used to send multiple audio/video streamHDTV channel can be used to send multiple audio/video stream
– exact number depends on format and content. exact number depends on format and content.
Infrastructure for data services and interactivity laggingInfrastructure for data services and interactivity lagging
Major PlayersMajor PlayersHDTV/DTV OverviewHDTV/DTV Overview
Content providersContent providers• StudiosStudios• BroadcastersBroadcasters
Highway providersHighway providers• CableCable• Direct Broadcast SatelliteDirect Broadcast Satellite• BroadcastersBroadcasters
Receiver/Platform providers Receiver/Platform providers • Consumer electronics Consumer electronics • ComputerComputer
Technology providersTechnology providers• EquipmentEquipment• Semiconductor Semiconductor
Supervisors/regulatorsSupervisors/regulators• FCCFCC• CongressCongress
ConsumersConsumers
Distribution of US TV ViewersDistribution of US TV ViewersHDTV/DTV OverviewHDTV/DTV Overview
1998 2002
Total households ~ 100M ~ 105-110M
Total TV households ~ 99M ~ 104-107M
Total Cable subscribers ~ 65M ~ 65-70M
Total DBS subscribers ~ 8M ~ 13-20M
Total Terrestrial only ~ 25M ~ 20-22M
Cable dominates and will continue to do soCable dominates and will continue to do so• ~ 2/3 of US viewers ~ 2/3 of US viewers
Barriers to Rapid DeploymentBarriers to Rapid DeploymentHDTV/DTV OverviewHDTV/DTV Overview
SourceSource• Infrastructure costs Infrastructure costs
– New towers, transmitters, antennaeNew towers, transmitters, antennae
• Equipment costsEquipment costs– Large amount of NTSC equipmentLarge amount of NTSC equipment
• Operating costsOperating costs– Higher electricity billsHigher electricity bills– Greater programming costs - chicken & egg problem with viewers vs advertising Greater programming costs - chicken & egg problem with viewers vs advertising
revenuesrevenues
• Existing archivesExisting archives– Huge existing archives of material will still need to be usedHuge existing archives of material will still need to be used
Barriers to Rapid DeploymentBarriers to Rapid DeploymentHDTV/DTV OverviewHDTV/DTV Overview
ChannelChannel• Approx 2/3 of US TV households get programming via cableApprox 2/3 of US TV households get programming via cable• Cable BW is NOT freeCable BW is NOT free
– Huge investments made by cable companies to increase bandwidthHuge investments made by cable companies to increase bandwidth– More choice (of SD or 480i channels) and data services may offer better ROI than More choice (of SD or 480i channels) and data services may offer better ROI than
HD programmingHD programming– No “must carry” rules yetNo “must carry” rules yet
Receiver/DisplayReceiver/Display• Large high resolution displays are very expensiveLarge high resolution displays are very expensive• New electronics is expensive and still evolvingNew electronics is expensive and still evolving• Chicken & egg problemChicken & egg problem
– volumes vs costvolumes vs cost
Crossing the Barriers: Crossing the Barriers: SourceSource Upconversion of 480i to ATSCUpconversion of 480i to ATSC
• Huge NTSC archive and installed base of NTSC equipment can continue to be Huge NTSC archive and installed base of NTSC equipment can continue to be used by addition of Digital Format Translator (DFT) which upconverts 480i used by addition of Digital Format Translator (DFT) which upconverts 480i (NTSC, S-Video, D1, D2) to any ATSC HDTV format in real-time(NTSC, S-Video, D1, D2) to any ATSC HDTV format in real-time
• Allows gradual introduction of HD equipment as volumes increase and costs Allows gradual introduction of HD equipment as volumes increase and costs dropdrop
Digital Format Translator
ATSC formats480i
UpconversionUpconversion
AffiliateReceiver &
Decompressor
HD MPEG2Compressor
Broadcast Affiliate
Cable System
TV Affiliate or Cable Operator
Transmission
DigitalFormat
TranslatorTape Archive
or Disk Source
Video SourceFiber
Satellite Downlink
Cable
FromNetwork
Television Tower
NetworkSwitchingAnalog orCCIR601
HD MPEG2CompressorTape Archive
or Disk Source
Fiber
Network Broadcast:Cable:Satellite
TransmissionDigitalFormat
Translator
Satellite Uplink
To Affiliates
Video Source
480i (NTSC, S-Video, D1, D2) to any ATSC HDTV format in real-time480i (NTSC, S-Video, D1, D2) to any ATSC HDTV format in real-time
Crossing the Barriers:Crossing the Barriers: Source Source
Crossing the Barriers: Crossing the Barriers: ChannelChannel Cable adding significant capacity by upgrading to hybrid fiber/coaxCable adding significant capacity by upgrading to hybrid fiber/coax
• fiber from headend to nodefiber from headend to node• coax from node to homescoax from node to homes
Premium channels/content might use full HDPremium channels/content might use full HD
Channel bandwidth can be conserved by combination of good down/up Channel bandwidth can be conserved by combination of good down/up conversionconversion• Cable (and DBS/DSS) control both sides of channel that delivers content to Cable (and DBS/DSS) control both sides of channel that delivers content to
the homethe home
Downconvert480i or 480p
Upconvert
ATSC formats
HDTV/DTVATSC formats
Headend or node
Set-Top box inside home
channel
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display Receiver and display currently separated in most offeringsReceiver and display currently separated in most offerings
• Enhanced DTVEnhanced DTV– addressability < 720 lines verticallyaddressability < 720 lines vertically– cost < $5000cost < $5000– direct-view and rear projectiondirect-view and rear projection– usually include line doubler (de-interlacer)usually include line doubler (de-interlacer)– Hitachi, Samsung, Panasonic, and many othersHitachi, Samsung, Panasonic, and many others
• HDTV-capableHDTV-capable– full HD addressabilityfull HD addressability– cost typically > $5000cost typically > $5000– no HD receiverno HD receiver– HD input from external receiver, often via proprietary interface HD input from external receiver, often via proprietary interface – mainly rear-projection, but some direct-viewmainly rear-projection, but some direct-view– Mitsubishi HD1080 Diamond Series with 4:3 and 16:9 options, Panasonic, Mitsubishi HD1080 Diamond Series with 4:3 and 16:9 options, Panasonic,
Faroudja, Hitachi, Samsung, and many othersFaroudja, Hitachi, Samsung, and many others
• HDTV-readyHDTV-ready– full HD addressabilityfull HD addressability– includes HD receiver and possibly others (e.g., DirecTV)includes HD receiver and possibly others (e.g., DirecTV)– mainly rear-projection but some direct viewmainly rear-projection but some direct view– Thomson, Sony, Toshiba, Hitachi, Samsung, and othersThomson, Sony, Toshiba, Hitachi, Samsung, and others
Receiver/Display OptionsReceiver/Display OptionsCrossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
Display optionsDisplay options• Direct-view CRT TVDirect-view CRT TV• Rear-projection CRT TVRear-projection CRT TV• Rear-projection LCDs & DMDsRear-projection LCDs & DMDs
– Liquid-Crystal-On-Silicon (LCOS) devices could offer cheap high-def solutionLiquid-Crystal-On-Silicon (LCOS) devices could offer cheap high-def solution
• Front-projection LCDs & DMDsFront-projection LCDs & DMDs• LCOS HeadsetsLCOS Headsets• PlasmaPlasma• Direct-view LCDDirect-view LCD• 17”-21” CRT computer monitors17”-21” CRT computer monitors
– rapid decline in price + rapid increase in volumesrapid decline in price + rapid increase in volumes
Receiver optionsReceiver options• Set-Top Box (STB)Set-Top Box (STB)
– simplest option is simple decoding device similar to DSS/Cable STBsimplest option is simple decoding device similar to DSS/Cable STB– most popular option under development is low-cost multi-functional computer that can most popular option under development is low-cost multi-functional computer that can
be used for gaming, DVD, digital VCR, interactivity, Internet surfing, etcbe used for gaming, DVD, digital VCR, interactivity, Internet surfing, etc
• PC-DTVPC-DTV– PC with low cost DTV receiverPC with low cost DTV receiver
Set-Top BoxSet-Top BoxCrossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
Basically a PC-like deviceBasically a PC-like device• Low cost: < 500$Low cost: < 500$• Multi-functionalMulti-functional
– HDTV/DTV tuner, demux, decode, conversionsHDTV/DTV tuner, demux, decode, conversions– NTSC tuner, decode, upconversionNTSC tuner, decode, upconversion– 3D Games3D Games– DVD playerDVD player– Interactivity & data servicesInteractivity & data services– Internet surfingInternet surfing– Digital VCRDigital VCR
• Open architectureOpen architecture– Not necessarily using Windows or x86Not necessarily using Windows or x86
• Leveraging PC components and approachLeveraging PC components and approach– PCI busPCI bus– Graphics and video components leveraged from PCGraphics and video components leveraged from PC– Software APIs to allow ISVs to offer enhanced servicesSoftware APIs to allow ISVs to offer enhanced services
DBS/DSS and Cable STBs pursuing similar directionDBS/DSS and Cable STBs pursuing similar direction
Set-Top Box: System ViewSet-Top Box: System View
USB Peripherals(Scanners, Keyboards,Joysticks, Printers )
HD HD DigitalDigitalDiskDisk
RecorderRecorder
HD HD DigitalDigitalDiskDisk
RecorderRecorder
AmplifierAmplifier
MTS 100MTS 100StreamStreamPlayerPlayer
MTS 100MTS 100StreamStreamPlayerPlayer
Software Development ToolsApplication Control Program
Telco Remote Control(or IRDA Peripherals)
Composite OutSvideo Out
R (R-Y)G (Y)
B (B_Y)S
AudioDTVNIM
TVTunerS/PDIF InS/PDIF In
S/PDIF OutS/PDIF Out
SDI InSDI In
SDI OutSDI Out
RS232RS232
JTAG TapJTAG Tap
EvaluationEvaluation
Modem USB/P1394 Smartcard IR/IRDA
Reference
TL850TL850
CPUCPU
Source:TeraLogic, Inc.Source:TeraLogic, Inc.
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
Set-Top Box: Structure and I/FsSet-Top Box: Structure and I/Fs
Source: TeraLogic Inc. Cougar DTV Reference Platform HWSource: TeraLogic Inc. Cougar DTV Reference Platform HW
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
Set-Top Box: SW ArchitectureSet-Top Box: SW Architecture
Source: TeraLogic Inc. Cougar DTV Reference Platform SWSource: TeraLogic Inc. Cougar DTV Reference Platform SW
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
DTV-STB Receiver ArchitectureDTV-STB Receiver Architecture
DTV DecoderDTV Tuner Demodulator
NTSC/PAL
Decoder
TransportStream
CCIR601
SDRAM
HD Video Out
Audio Out
Aux. Video OutCCIR601 Digital
EPROM
1394 Link
1394 PHY
Super I/O
STB I/O
PCI Bridge
CPU
FLASH SDRAM
PCI Bus
RS-232Parallel
USBIDE
IR
NTSC/PAL Encoder
Descrambler/CA sub system
IICSC
PWMGPIO
NTSC
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
PC-DTV PlatformPC-DTV PlatformCrossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
Near-term solutionNear-term solution• add-in card with HDTV/NTSC tuner and demux/decoderadd-in card with HDTV/NTSC tuner and demux/decoder
– offers HDTV/DTV viewing on conventional CRT computer monitor or HD monitoroffers HDTV/DTV viewing on conventional CRT computer monitor or HD monitor– enhanced services and interactivity possible through other PC HW/SWenhanced services and interactivity possible through other PC HW/SW– low cost: likely < 300$ in 2H99low cost: likely < 300$ in 2H99
• add-in card with HDTV/NTSC tuneradd-in card with HDTV/NTSC tuner– HW NTSC decodeHW NTSC decode– SW HD demux and decode (with IDCT+Motion Compensation assistance from SW HD demux and decode (with IDCT+Motion Compensation assistance from
graphics accelerator - MP@HL likely by 1H00).graphics accelerator - MP@HL likely by 1H00).– very low cost possible: could be < $100 in 1H00 very low cost possible: could be < $100 in 1H00
Long-term solutionLong-term solution• PC-based Integrated Digital Media PlatformPC-based Integrated Digital Media Platform
– Modular secure architecture based on compact enclosed receiver modules (Device Modular secure architecture based on compact enclosed receiver modules (Device Bay) with SW acting as bridge between receiver and renderer.Bay) with SW acting as bridge between receiver and renderer.
– Big push by Microsoft in this directionBig push by Microsoft in this direction
PC-DTV Add-in Card PC-DTV Add-in Card
AnalogSwitch
ATSC/NTSCTuner
VSB Demod.
PCI or AGP Graphics Card
NTSC Decoder
Xport
CCIR656
RGB
RGB
VIP Port,
PCI Bus
PC Monitor
HDTV
HD DigitalVideo
8/16/24
32
64
Memory -4/8/16 MB
HD
Antenna
CATV
JanusDTVPC
Decoder
Loop-back Cable
CCIR656
Video
Source: TeraLogic Inc. Source: TeraLogic Inc.
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
Add-in card option based on dual-input tuner and HW DTV decoderAdd-in card option based on dual-input tuner and HW DTV decoder
Could be < $300 in 2H99Could be < $300 in 2H99
DTV Decoder ICDTV Decoder IC
PCI Controller
Memory Controller
TransportDemultiplexer
TransportDemultiplexer
•ATSC•DVB•DSS
Digital Video Decoder•MP@HL MPEG2 •Decodes all 18
ATSC formats •1HD or 4 SD streams•Decodes DVD video•ATSC, ARIB, DVB
compliant
Video Scaler• 19 tap H/V filters
•Line Doubler•High Quality
up/downconversion
Display Processor•Multiple formats - 1080i, 720P,480P, 480i .
•PC Formats - VGA, SVGA, XVGA
•Letterbox mode
Memory
4/8/16 MB
PCI Bus
VIP PortHD TransportStream
Audio IN
Digital HD Video
Digital Video
CCIR656
SD Video
Audio OutCCIR656
RGB/YPbPr
(9)
(32)
(6)
(8)
(8)
(64)
(3)
(6)
Janus
AudioProcessor/
Mixer
2D Graphics•32 bit engine
•Anti-alias filter•Alpha blending
Source: TeraLogic Inc. Source: TeraLogic Inc.
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
Highly integrated DTV decoder ICHighly integrated DTV decoder IC• Comprehensive set of features: transport demux, MPEG2 MP@HL decode, video Comprehensive set of features: transport demux, MPEG2 MP@HL decode, video
processing, 2D graphics for GUI support, display processor, PCI I/Fprocessing, 2D graphics for GUI support, display processor, PCI I/F
Suitable for STB or PC-DTVSuitable for STB or PC-DTV
Philips Coney PCI ATSC/NTSC Reference DesignPhilips Coney PCI ATSC/NTSC Reference Design
Low cost add-in card optionLow cost add-in card option• NTSC/ATSC reception with single tunerNTSC/ATSC reception with single tuner• ATSC transport stream, scaled 656, and BTSC stereo audio sent out via PCIATSC transport stream, scaled 656, and BTSC stereo audio sent out via PCI• Could be < $100 in high volumeCould be < $100 in high volume
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
PC-DTV: HW/SW PartitioningPC-DTV: HW/SW Partitioning
Analog/digAnalog/digtuner drivertuner driver
VSB demodVSB demoddriverdriver
TS demuxTS demux
AC3 decodeAC3 decode DShowDShowsoundsound
DShow videoDShow videorendererrenderer
Gfx driverGfx driver
Gfx hardwareGfx hardware
NTSC/CCNTSC/CCapp/UIapp/UI
TunerTuner
Analog TVAnalog TVdemoddemod
Digital TVDigital TVdemoddemod
MP@HLMP@HLh/w assisth/w assist
PCIPCIBridgeBridge
SoftwareSoftware
HardwareHardware
DTV DTV app/UIapp/UI
MP@HLMP@HLvideo decodevideo decode
PCI BridgePCI BridgeWDMWDM
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
HW/SW partitioning for low cost Coney card optionHW/SW partitioning for low cost Coney card option
Enhanced Enhanced programmingprogramming
Video Video Audio Audio DataData
Graphics Graphics chip/cardchip/card
On-chip MPEG On-chip MPEG accelerationacceleration
8VSB PCI 8VSB PCI Receiver Receiver ModuleModule
AGPAGPPCIPCI13941394
WDM driverWDM driver
PC motherboard and softwarePC motherboard and software
1394 Device 1394 Device Bay or external Bay or external C.A. Receiver C.A. Receiver ModuleModule
NTSCNTSC
Analog Analog (MPEG (MPEG Encoding) Encoding) Receiver Receiver ModuleModule
TS splitTS split CS createCS create CS store/retrieveCS store/retrieve CS splitCS split
PCIPCI
MPEG MPEG decode decode support support
WDM driverWDM driver WDM driverWDM driver DriverDriver
CableCableCableCable
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
PC-DTV: System ViewPC-DTV: System View
PC-DTV: Long-term System ArchitecturePC-DTV: Long-term System Architecture
StorageStorage(Network)(Network)
TerrestrialTerrestrial
CableCable
SatelliteSatellite
ADSLADSL
TelcoTelco
????????
DirectShowDirectShow(value adding filters)(value adding filters)
Video Video display display
subsystemsubsystem
Audio Audio subsystemsubsystem
Data Data subsystemsubsystem
MPEG EncMPEG Enc
DVDDVD
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
Receiver functions separate from rendering functionsReceiver functions separate from rendering functions• All streams go through Microsoft DirectShow SW layerAll streams go through Microsoft DirectShow SW layer
PC-DTV: Long-term ViewPC-DTV: Long-term View
Integrated Digital Media Platform Integrated Digital Media Platform (“PC-Inside”)(“PC-Inside”)
Subsumes Subsumes functionality functionality of some or of some or all of theseall of these
Satellite TVSatellite TVreceiverreceiver
A/V receiverA/V receiver
VCRVCR
DVD playerDVD player
Game consoleGame console
Cable boxCable box
Atsc boxAtsc box
Telco boxTelco box
PC
insi
de
Web browserWeb browser
Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display
ForecastsForecasts Depends on whether PC-based DTV (or PC-like STB-based DTV) can Depends on whether PC-based DTV (or PC-like STB-based DTV) can
provide quick ramp up in volumeprovide quick ramp up in volume• PC-DTV add-in cards for $99-$299 coupled with 17”-21” CRT monitors could PC-DTV add-in cards for $99-$299 coupled with 17”-21” CRT monitors could
provide significant early deployment to create the positive spiral needed for fast provide significant early deployment to create the positive spiral needed for fast growthgrowth
• PC & CE industry will tryPC & CE industry will try– ultimately depends on consumer preferencesultimately depends on consumer preferences
Traditional approach based on HDTV sets and vanilla HD receivers will be Traditional approach based on HDTV sets and vanilla HD receivers will be much slowermuch slower
Low cost Low cost interactive interactive
receiversreceivers
Large installed base of Large installed base of eyeballseyeballs
Effective Effective advertisingadvertising
Better free Better free programsprograms
Large volume Large volume receiver marketreceiver market
Positive spiralPositive spiral
SummarySummary Transition to HDTV/DTV began with November 98 broadcastsTransition to HDTV/DTV began with November 98 broadcasts
• Current status is 66 stations on air with full facilities, 25 with partialCurrent status is 66 stations on air with full facilities, 25 with partial
Many barriers to rapid deployment, but most can be overcomeMany barriers to rapid deployment, but most can be overcome• Upconversion Upconversion • STB and PC DTV low cost receiver platformsSTB and PC DTV low cost receiver platforms
– New functionality such as digital recording, interactive television, data services, at low New functionality such as digital recording, interactive television, data services, at low cost could attract high volumes cost could attract high volumes
– PC/semiconductor industry price pressure could offer price-points as low as $99 (for PC/semiconductor industry price pressure could offer price-points as low as $99 (for lowest functionality option). lowest functionality option).
• Emerging display technologies such as LCOS, low cost large PC CRT monitors, Emerging display technologies such as LCOS, low cost large PC CRT monitors, and enhanced CRT SDTVs could provide high quality viewing options at and enhanced CRT SDTVs could provide high quality viewing options at reasonable cost. reasonable cost.
Could be a significant opportunity for “enhanced TV”Could be a significant opportunity for “enhanced TV”
Ultimately will depend on consumer preferencesUltimately will depend on consumer preferences
AcknowledgementsAcknowledgements Speaker gratefully acknowledges material and/or information provided by Speaker gratefully acknowledges material and/or information provided by
• Chuck McLaughlin, McLaughlin Consulting GroupChuck McLaughlin, McLaughlin Consulting Group• Mark O’Brien, TeraLogic, Inc.Mark O’Brien, TeraLogic, Inc.• Terry Smith, Sarnoff CorporationTerry Smith, Sarnoff Corporation• Dave Marsh, Microsoft CorporationDave Marsh, Microsoft Corporation• Mark Farley, S3 IncorporatedMark Farley, S3 Incorporated• Glen Sakata, Broadcast Group, Faroudja LaboratoriesGlen Sakata, Broadcast Group, Faroudja Laboratories
ReferencesReferences HDTV/DTVHDTV/DTV
• ““HDTV Status and Prospects”, B. Lechner, SID 1997 Seminar M-10.HDTV Status and Prospects”, B. Lechner, SID 1997 Seminar M-10.– detailed history of development of HDTV detailed history of development of HDTV
• ““The Impact of DTV on Television and Computer Displays”, R. Cooke, The Impact of DTV on Television and Computer Displays”, R. Cooke, C. McLaughlin, McLaughlin Consulting Group, December 1998 C. McLaughlin, McLaughlin Consulting Group, December 1998
– provides in depth analysis of US market and a detailed product and technology provides in depth analysis of US market and a detailed product and technology forecastforecast
– www.mcgweb.com/reports/dtv.htm.www.mcgweb.com/reports/dtv.htm.
• ““Opportunities for Displays in the DTV Era”, R. Cooke, C. McLaughlin, Opportunities for Displays in the DTV Era”, R. Cooke, C. McLaughlin, McLaughlin Consulting Group, April 1999 McLaughlin Consulting Group, April 1999
– abridged version, summarizes market trends and forecasts DTV rolloutabridged version, summarizes market trends and forecasts DTV rollout– www.mcgweb.com/reports/dtvopps.htm.www.mcgweb.com/reports/dtvopps.htm.
• www.atsc.org www.atsc.org – web site for Advanced Television Systems Committeeweb site for Advanced Television Systems Committee
• www.teralogic-inc.comwww.teralogic-inc.com– white papers on set-top box and PC implementations of DTVwhite papers on set-top box and PC implementations of DTV
• www.microsoft.com/winhecwww.microsoft.com/winhec– presentations and white papers on PC-centric DTVpresentations and white papers on PC-centric DTV
• www.fcc.gov/mmb/vsdwww.fcc.gov/mmb/vsd– web site for FCC - up-to-date information on TV stations DTV transitionweb site for FCC - up-to-date information on TV stations DTV transition
ReferencesReferences MPEG2MPEG2
• ““An Introduction to MPEG-2” B. Haskell, A. Puri, A. Netravali, Chapman & An Introduction to MPEG-2” B. Haskell, A. Puri, A. Netravali, Chapman & Hall, 1997Hall, 1997
PC multimedia architecturePC multimedia architecture• ““Multimedia Accelerators”, N. Balram, SID 1998 Seminar M-7.Multimedia Accelerators”, N. Balram, SID 1998 Seminar M-7.• Datasheets and data books from various multimedia accelerator companiesDatasheets and data books from various multimedia accelerator companies
Image/Video/TelevisionImage/Video/Television• ““Video Demystified: A Handbook for the Digital Engineer”, K. Jack, HighText Video Demystified: A Handbook for the Digital Engineer”, K. Jack, HighText
Publications, 1993. Publications, 1993. • ““Digital Television”, C. P. Sandbank (editor), John Wiley & Sons, 1990.Digital Television”, C. P. Sandbank (editor), John Wiley & Sons, 1990.• ““High Quality Video De-interlacing”, N. Balram, B. Herz, Windows Hardware High Quality Video De-interlacing”, N. Balram, B. Herz, Windows Hardware
Engineering Conference (WinHEC98), 1998.Engineering Conference (WinHEC98), 1998.• ““Video Processing for Pixellized Displays”, Y. Faroudja, N. Balram, Video Processing for Pixellized Displays”, Y. Faroudja, N. Balram,
Proceedings of SID International Symposium, May, 1999.Proceedings of SID International Symposium, May, 1999.• ““Principles of Digital Image Synthesis”, Vols 1 & 2, A. Glassner, Morgan Principles of Digital Image Synthesis”, Vols 1 & 2, A. Glassner, Morgan
Kaufmann Publishers, 1995.Kaufmann Publishers, 1995.