multimedia systems: video ralf steinmetz lars …...multimedia 2-3-vide.frm 1 multimedia systems:...
TRANSCRIPT
Multimedia
2-3-
vid
e.fr
m1
Mu
ltim
edia
Sys
tem
s:V
ideo
Ral
f S
tein
met
zL
ars
Wo
lf
Dar
mst
adt
Un
iver
sity
of
Tech
no
log
yIn
du
stri
al P
roce
ss a
nd
Sys
tem
Co
mm
un
icat
ion
s
Mer
ckst
raß
e 25
– 6
4283
Dar
mst
adt
– G
erm
any
Multimedia
2-3-
vid
e.fr
m2
Co
mp
ress
ion
Use
r In
terf
ace
Pro
gra
mm
ing
Ab
stra
ctio
ns
Ap
plic
atio
ns
Net
wo
rkS
tora
ge
Co
mp
ute
r Te
chn
olo
gy
Do
cum
ents
Au
dio
Vid
eo
Dat
abas
eS
yste
m
Qu
alit
y-o
f-S
ervi
ce
Co
mm
un
-ic
atio
nS
yste
m
File
Sys
tem
Sch
ed-
ulin
gS
ynch
ron
-iz
atio
n
Op
erat
ing
Sys
tem
Multimedia
2-3-
vid
e.fr
m3
Co
nte
nts
1. H
um
an V
isu
al P
erce
pti
on
2. C
od
ing
an
d I/
O
3. B
lack
an
d W
hit
e Te
levi
sio
n
4. C
olo
r Te
levi
sio
n
5. T
elev
isio
n S
tan
dar
ds
6. H
igh
Defi
nit
ion
Tel
evis
ion
(H
DT
V)
7. D
igit
al T
elev
isio
n &
Dig
ital
Vid
eo B
road
cast
ing
8. V
ideo
Tec
hn
iqu
es fo
r C
om
pu
ter
Sys
tem
s
Multimedia
2-3-
vid
e.fr
m4
1.H
um
an V
isu
al P
erce
pti
on
Sp
ecifi
cati
on
of
vid
eo s
yste
ms
det
erm
ined
by:
•C
hara
cter
istic
s an
d lim
itatio
ns o
f hum
an v
isua
l per
cept
ion
•H
uman
info
rmat
ion
proc
essi
ng
Eac
h c
olo
r d
efin
ed b
y m
ix o
f p
rim
ary
colo
rs:
•R
ed
•G
reen
•B
lue
E.g
. wh
ite
is r
epre
sen
ted
by:
•R
ed :
gree
n : b
lue
= 1
00%
: 10
0% :
100%
Col
or C
ube:
blac
k
gree
n
red
blue
whi
t e
grey
Multimedia
2-3-
vid
e.fr
m5
Bri
gh
tnes
s an
d R
eso
luti
on
Per
cep
tio
n o
f b
rig
htn
ess:
•H
ighe
r th
an p
erce
ptio
n of
col
or:
•E
spec
ially
hig
h pe
rcep
tion
of b
right
edg
es
•P
erce
ptio
n de
crea
ses
with
brig
htne
ss o
f sur
roun
ding
s
•D
iffer
ent p
erce
ptio
n of
the
prim
ary
colo
rs•
Rel
ativ
e br
ight
ness
:gr
een
: red
: bl
ue =
59%
: 30
% :
11%
Sp
atia
l res
olu
tio
n (
of
sin
gle
po
ints
) d
epen
ds
on
:
•P
ictu
re s
ize
•V
iew
ing
dist
ance
Tem
po
ral R
eso
luti
on
:
•In
ertia
of h
uman
eye
•S
eque
nce
of im
ages
(=
„fr
ames
“):
•N
o id
entifi
catio
n of
sin
gle
fram
es if
ref
resh
freq
uenc
y hi
gh e
noug
h
•P
erce
ptio
n of
16
fram
es/s
as
cont
inuo
us s
eque
nce
Multimedia
2-3-
vid
e.fr
m6
Flic
ker
Eff
ect
Flic
ker
effe
ct:
•F
licke
r pe
rcei
ved
if re
fres
h ra
te o
f scr
een
too
low
•E
spec
ially
in la
rge
brig
ht a
reas
•N
o fli
cker
if r
efre
sh r
ate
> 5
0/s
refr
esh
rat
e 25
Hz
50 H
z
t1
/ fv
= 1/
50 s
= 2
0 m
s
1 / f
v =
1/25
s =
40
ms
Bp
Op
tica
lS
tim
ulu
s
fv =
ref
resh
rat
e
Multimedia
2-3-
vid
e.fr
m7
2.C
od
ing
an
d I/
O
Rep
rese
nta
tio
n o
f Im
ages
Imag
e is
rast
ered
for
furt
her
pro
cess
ing
•R
aste
r po
int =
„pi
ctur
e el
emen
t“ =
pixe
l
•R
aste
r:•
Dis
cret
izat
ion
of im
age
into
a n
umbe
r of
pix
els
•F
ixed
num
ber
of r
ows
and
colu
mns
->
fixe
d nu
mbe
r of
pix
els
Sto
rag
e / m
anip
ula
tio
n /
tran
smis
sio
n /
dis
pla
y o
f an
imag
ear
e b
ased
on
•gr
ey-s
cale
or
colo
r va
lues
of i
ts p
ixel
s
pixe
l
Multimedia
2-3-
vid
e.fr
m8
Imag
e Q
ual
ity
Qu
alit
y o
f re
pre
sen
tati
on
dep
end
s o
n:
•„R
esol
utio
n“ =
num
ber
of r
aste
r po
ints
•„C
olor
dep
th“
= n
umbe
r of
bits
per
pix
el
•1
bit
= b
lack
/ w
hite
info
rmat
ion
only
•15
bits
= „
high
col
or“
•24
bits
= „
true
col
or“
fine:
coar
se:
>2
bits
:1
bit:
Multimedia
2-3-
vid
e.fr
m9
Co
lor
Co
din
g:
RG
B
RG
B c
olo
r co
din
g:
•C
olor
cod
e =
coo
rdin
ates
of a
poi
nt w
ithin
the
colo
r cu
be
•T
hree
inde
pend
ent c
ompo
nent
s fo
r re
d (R
c), g
reen
(G
c), a
nd b
lue
(Bc)
•I.e
. cod
e is
a tr
ipel
(R
c,G
c,B
c),
Rc,
Gc,
Bc
bein
g th
e co
ntrib
utio
ns o
f the
prim
ary
colo
rs
•N
umbe
r of
bits
per
com
pone
nt d
eter
min
es c
olor
dep
th
gree
n
redblue
z
y
x
(Rc,
Gc,
Bc)
Multimedia
2-3-
vid
e.fr
m10
Co
lor
Co
din
g:
Lu
min
ance
/Ch
rom
inan
ce P
rin
cip
le
Co
de
con
sist
s o
flu
min
ance
an
dch
rom
inan
ce c
om
po
nen
ts:
•Lu
min
ance
com
pone
nt: b
right
ness
of p
ixel
•C
hrom
inan
ce d
iffer
ence
com
pone
nts:
col
or o
f pix
el•
Hue
: whi
ch c
olor
•S
atur
atio
n: d
epth
of c
olor
Exa
mp
les:
•Y
UV
cod
ing:
•Y
= 0
.30R
+ 0
.59G
+ 0
.11B
(lum
inan
ce)
•U
= (
B -
Y)
x 0.
493
(chr
omin
ance
1)
•V
= (
R-Y
) x
0.87
7(c
hrom
inan
ce 2
)
•Y
IQ c
odin
g:•
Y =
0.3
0R +
0.5
9G +
0.1
1B(lu
min
ance
)
•I =
0.6
0R -
0.2
8G -
0.3
2B(c
hrom
inan
ce 1
)
•Q
= 0
.21R
- 0
52G
+ 0
.31B
(chr
omin
ance
2)
Multimedia
2-3-
vid
e.fr
m11
Co
lor
Co
din
g:
Lu
min
ance
/Ch
rom
inan
ce (
con
t.)
Dif
fere
nt
reso
luti
on
s fo
r lu
min
ance
an
d c
hro
min
ance
po
ssib
le:
•Lu
min
ance
Y:
high
res
olut
ion
•C
hrom
inan
ce U
, V:l
ower
res
olut
ion
Exa
mp
les:
•4:
2:2:
dou
ble
reso
lutio
n fo
r lu
min
ance
•4:
1:1:
qua
drup
el r
esol
utio
n fo
r lu
min
ance
Y11
Y22
Y21
Y12
U1
U2
V1
V2
++
Cod
ing
of fo
urpi
xels
:
Y11
Y22
Y21
Y12
UV
++
Cod
ing
of fo
urpi
xels
:
Multimedia
2-3-
vid
e.fr
m12
Vid
eo I/
O D
evic
es:
Cam
era
Tran
sfo
rmat
ion
of
a tw
o-d
imen
sio
nal
pic
ture
into
a o
ne-
dim
ensi
on
al e
lect
rica
l sig
nal
Pri
nci
ple
of
op
erat
ion
:
•P
late
of p
hoto
sens
itive
mat
eria
l
•E
volv
ing
of a
cha
rge
in th
e m
ater
ial
depe
ndin
g on
am
ount
of l
ight
at e
ach
spot
•C
harg
e re
ad o
ut:
•E
mitt
ing
an e
lect
ron
beam
ont
o th
e pl
ate
•C
olle
ctin
g ge
nera
ted
sign
als
Multimedia
2-3-
vid
e.fr
m13
Vid
eo I/
O D
evic
es:
Mo
nit
or
Cat
ho
de
Ray
Tu
be
(CR
T):
•Tr
ansf
orm
atio
n of
one
-dim
ensi
onal
ele
ctric
al s
igna
lin
to tw
o-di
men
sion
al v
isua
l im
age
•P
rinci
ple
of o
pera
tion:
•Tr
ansf
orm
atio
n of
sig
nal i
nto
elec
tron
em
issi
on o
f a c
atho
de
•Li
ght e
mis
sion
in a
laye
r of
fluo
resc
ent m
ater
ial c
ause
d by
ele
ctro
ns
Var
ian
ts:
•B
lack
-and
-whi
te:
•S
igna
l am
plitu
de p
ropo
rtio
nal t
o im
age
brig
htne
ss
•C
olor
:•
Sig
nal i
nclu
des
brig
htne
ss a
nd c
olor
info
rmat
ion
(lum
inan
ce a
nd c
hrom
inan
ce)
Multimedia
2-3-
vid
e.fr
m14
Sca
nn
ing
Pri
nci
ple
s
Sca
nn
ing
dir
ecti
on
:
•S
tart
at t
op le
ft co
rner
of i
mag
e
•H
oriz
onta
l and
slo
wly
ver
tical
sca
nnin
g
Multimedia
2-3-
vid
e.fr
m15
3.B
lack
an
d W
hit
e Te
levi
sio
n
Fu
nd
amen
tals
Asp
ect
rati
o:
•W
idth
-to-
Hei
ght r
atio
•Te
levi
sion
:4
: 3
•M
ovie
s:2
: 1
Ver
tica
l res
olu
tio
n:
•E
urop
e: 6
25 li
nes/
fram
e
•Ja
pan,
US
A: 5
25 li
nes/
fram
e
Ho
rizo
nta
l res
olu
tio
n:
•S
ampl
ing
freq
uenc
y: 1
3.5
MH
z
•S
cann
ing
time
/ lin
e: 6
4µs
•he
nce:
864
pix
els/
line
(in E
urop
e)
Multimedia
2-3-
vid
e.fr
m16
Vid
eo B
and
wid
th
Max
. nu
mb
er o
f b
lack
/wh
ite
chan
ges
: 86
4 o
scill
atio
ns/
line
Th
eore
tica
l vid
eo b
and
wid
th a
t le
ast:
• 8
64/2
osc
./lin
e *
625
lines
/fram
e *
25 fr
ame/
s =
6.7
5 M
Hz
Vid
eo b
and
wid
th fo
r su
ffici
ent
qu
alit
y:
•5.
5 M
Hz
•or
eve
n on
ly 5
MH
z
1per
iod
t
Multimedia
2-3-
vid
e.fr
m17
Co
mp
osi
te S
ign
al
Co
mp
osi
te s
ign
al:
•Im
age
data
•S
ampl
ing
data
•S
ynch
roni
zatio
n da
ta
acti
ve li
ne
line
64µs
t
10%
100%
amplitude of
bla
ck
gre
y wh
ite
composite signal
Multimedia
2-3-
vid
e.fr
m18
Co
mp
osi
te S
ign
al
Sig
nal
mo
du
lati
on
:
•A
mpl
itude
mod
ulat
ion
Sp
ectr
um
of
com
po
site
sig
nal
:
imag
e ca
rrie
rau
dio
car
rier
12
34
56
6.75
0
+ -50
kH
z
f in
MH
z
6.75
MH
z
1.25
Multimedia
2-3-
vid
e.fr
m19
4.C
olo
r Te
levi
sio
n
Co
lor
Fu
nd
amen
tals
Bas
ed o
n:
•Tr
i-stim
ulus
theo
ry o
f col
or r
epro
duct
ion
•C
reat
ion
of c
olor
s by
mix
ing
light
•A
dditi
ve p
rimar
y sy
stem
col
ors:
red
, gre
en, b
lue
Tub
e:
•O
ne b
eam
for
each
col
or
•S
ent t
hrou
gh s
hado
w m
ask
onto
scr
een:
•35
7 00
0 ho
les
in s
hado
w m
ask
diam
eter
: 0.3
5 m
m
•1
071
000
colo
r po
ints
diam
eter
: 0.4
2 m
m
Multimedia
2-3-
vid
e.fr
m20
Co
mp
osi
te C
od
ing
On
e si
gn
al:
•Tr
ansm
issi
on o
f lum
inan
ce a
nd c
hrom
inan
ce o
ver
one
chan
nel
•„C
ompo
site
Col
or S
igna
l“ bla
ck
red
blu
e
yello
ww
hit
eac
tive
lin
elin
e 64
ms
colo
r ca
rrie
r
t
10%
100%
lum
inan
ce
Multimedia
2-3-
vid
e.fr
m21
Fre
qu
ency
Inte
rlea
vin
g
Req
uir
emen
t fo
r co
mp
osi
te s
ign
al:
•R
educ
tion
of in
terf
eren
cebe
twee
n lu
min
ance
and
chr
omin
ance
com
pone
nts
Tech
niq
ue:
„F
req
uen
cy In
terl
eavi
ng
“
•Lu
min
ance
sig
nal:
•U
sing
full
band
wid
th
•C
hrom
inan
ce s
igna
ls:
•R
educ
ed b
y fa
ctor
2 to
4 a
s:•
Hum
an e
ye m
ore
sens
itive
for
brig
htne
ss in
form
atio
n
•E
asie
r re
cogn
ition
of b
right
edg
es
•O
n hi
gh fr
eque
ncy
subc
arrie
r
Multimedia
2-3-
vid
e.fr
m22
5.Te
levi
sio
n S
tan
dar
ds
Ove
rvie
w o
f C
olo
r T
V S
tan
dar
ds
stan
dar
dlin
esp
ixel
s/lin
efr
ames
/se
cco
din
gm
od
ul-
atio
n
NT
SC
525
700
30Y
IQA
M
Sec
am62
586
425
YU
V(s
eq. t
rans
-m
issi
on)
FM
PAL
625
864
25Y
UV
(2-p
hase
sign
al)
AM
Multimedia
2-3-
vid
e.fr
m23
6.H
igh
Defi
nit
ion
Tel
evis
ion
(H
DT
V)
Ove
rvie
w o
f F
irst
Init
iati
ve
Res
olu
tio
n/im
age
size
:
•V
iew
ing
dist
ance
: 2-3
m
•H
oriz
onta
l vie
win
g an
gle:
45°
•A
spec
t rat
io: 1
6:9
•V
ertic
al r
esol
utio
n:11
50 v
isib
le li
nes/
fram
e
•H
oriz
onta
l res
olut
ion:
190
0 pi
xels
/line
Sh
arp
nes
s:
•Tw
ice
the
conv
entio
nal T
V r
esol
utio
n
•B
andw
idth
= 3
0 M
Hz
(Ste
inm
etz/
Nah
rste
dt, p
. 95)
Flic
ker:
•R
ecei
ver
disp
lay
refr
esh
rate
: abo
ut 1
00 H
z
Multimedia
2-3-
vid
e.fr
m24
7.D
igit
al T
elev
isio
n &
Dig
ital
Vid
eoB
road
cast
ing
Sig
nal
Dig
ital
izat
ion
1995
: D
VB
Dig
ital
Vid
eo B
road
cast
ing
1982
: C
CIR
inte
rnat
ion
al d
igit
al t
elev
isio
n s
tan
dar
d
Co
mb
ined
Dig
ital
izat
ion
of
com
po
site
bla
ck/w
hit
e si
gn
al:
•V
ideo
ban
dwid
th: 2
* 5
MH
z *
8 bi
t = 8
0 M
bit/s
•5
MH
z =
ban
dwid
th o
f B/W
TV
sig
nal
Co
mb
ined
Dig
ital
izat
ion
of
com
po
site
co
lor
sig
nal
:
•Lo
wer
inte
rfer
ence
with
col
or c
arrie
r
•R
equi
res
even
-num
bere
d m
ultip
le fr
eque
ncy
of th
e co
lor
carr
ier
•S
ampl
ing
freq
uenc
y: 4
* fr
eque
ncy
of c
olor
car
rier
•D
ata
rate
: 4 *
4.4
3 M
Hz
* 8
bit =
141
.8 M
bit/s
•4.
43 M
Hz
= fr
eque
ncy
of c
olor
car
rier
Multimedia
2-3-
vid
e.fr
m25
Dra
wb
acks
of
Co
mb
ined
Dig
ital
izat
ion
Inte
rfer
ence
bet
wee
n lu
min
ance
an
d c
hro
min
ance
dat
a
Dig
ital
izat
ion
tec
hn
iqu
e d
epen
ds
on
TV
sta
nd
ard
No
ad
apta
tio
n o
f:
•S
ampl
ing
freq
uenc
y to
ban
dwid
th o
f sin
gle
com
pone
nts
•D
ata
redu
ctio
n to
cha
ract
eris
tics
of s
ingl
e co
mpo
nent
s
Multimedia
2-3-
vid
e.fr
m26
Co
mp
on
ent
Co
din
g:
Fu
nd
amen
tals
Sep
arat
e d
igit
aliz
atio
n o
f si
ng
le c
om
po
nen
ts:
•M
ultip
lexi
ng o
f dig
itize
d si
gnal
s
Sam
plin
g f
req
uen
cy:
•Lu
min
ance
: 13.
5 M
Hz
•C
hrom
inan
ce: 6
.75
MH
z
8 b
it u
nifo
rm q
uan
tiza
tio
n:
•D
ata
rate
: (13
.5 M
Hz
+ 2
* 6
.75
MH
z) *
8 b
it =
216
Mbi
t/s
Ver
tica
l res
olu
tio
n:
625
lines
/fra
me
Ho
rizo
nta
l res
olu
tio
n:
•Lu
min
ance
: 864
pix
els/
line
(vis
ible
: 720
pix
els)
•C
hrom
inan
ce: 4
32 p
ixel
s/lin
e (v
isib
le: 3
60 p
ixel
s)
Fra
me
rate
: 25
fra
mes
/s
Multimedia
2-3-
vid
e.fr
m27
Co
mp
on
ent
Co
din
g:
Dra
wb
ack
Hig
h d
ata
rate
Hen
ce:
defi
nit
ion
of
sub
stan
dar
ds
•Lo
wer
dat
a ra
tes
•Lo
wer
sam
plin
g fr
eque
ncie
s sub
stan
dar
d1
sub
stan
dar
d2
sub
stan
dar
d3
sam
plin
g
freq
uenc
y
lum
inan
ce
11.2
5 M
Hz
(5/6
of
stan
dard
)
10.1
25 M
Hz
(3/4
of
stan
dard
)
9 M
Hz
(2/3
of
stan
dard
)
chro
min
ance
5.62
5 M
Hz
(5/6
of
stan
dard
)
3.37
5 M
Hz
(1/2
of
stan
dard
)
2.25
MH
z
(1/3
of
stan
dard
)
data
rat
e18
0*10
6 bi
t/s13
5 *1
06 bi
t/s10
8 *1
06 bi
t/s
Multimedia
2-3-
vid
e.fr
m28
8.V
ideo
Tec
hn
iqu
es fo
r C
om
pu
ter
Sys
tem
s
Fu
nd
amen
tals
Go
als:
•In
tegr
atio
n of
dig
ital v
ideo
into
com
pute
r sy
stem
s
•R
ando
m a
cces
s ed
iting
•In
tera
ctiv
ity
•Im
age
proc
essi
ng
•In
tegr
atio
n in
to c
ompu
ter
docu
men
ts
•S
tora
ge o
n di
ffere
nt m
edia
•Tr
ansm
issi
on o
ver
com
pute
r ne
twor
ks
Co
nver
sio
n o
f an
alo
gu
e vi
deo
sig
nal
to
dig
ital
form
at
Req
uir
es d
isp
lay
refr
esh
rat
e o
f at
leas
t 70
Hz
Multimedia
2-3-
vid
e.fr
m29
Dig
ital
Vid
eo
Pu
ts d
eman
ds
on
:
•S
tora
ge
•Tr
ansm
issi
on
•T
hrou
ghpu
t
•D
ispl
ay
So
lved
by:
•R
estr
ictin
g th
e co
lor
dom
ain:
•C
olor
rep
rese
nted
by
few
er b
its
•U
sing
col
or lo
ok u
p ta
bles
(C
LUT
)•
CLU
T h
olds
256
(e.
g.)
diffe
rent
24-
bit R
GB
val
ues
•P
ixel
cod
e is
8-b
it (e
.g.)
inde
x in
to C
LUT
•C
ompr
essi
on
•S
peci
aliz
ed h
ardw
are