fundamentals
DESCRIPTION
Fundamentals. Rawesak Tanawongsuwan [email protected]. Digital Data. Bits are units of data that can only have one of two values. A byte is eight bits. Groups of bits can be interpreted as numbers to base 2, but can also be treated as characters, colours , etc. Bytes to remember. - PowerPoint PPT PresentationTRANSCRIPT
![Page 2: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/2.jpg)
Digital Data
• Bits are units of data that can only have one of two values.
• A byte is eight bits.• Groups of bits can be interpreted as numbers
to base 2, but can also be treated as characters, colours, etc.
![Page 3: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/3.jpg)
Bytes to remember
• 1 byte = 8 bits• 2 bytes = 16 bits• 3 bytes = 24 bits• 4 bytes = 32 bits• .• .• .
![Page 4: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/4.jpg)
Analogue and Digital Representation
![Page 5: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/5.jpg)
Digitization
• Converting a signal from analogue to digital form– Analogue signal can vary continuously, digital is
restricted to discrete values• Two-stage process– Sampling – measure the value at discrete intervals– Quantization – restrict the value to a fixed set of
quantization levels
![Page 6: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/6.jpg)
Sampling and Quantization
![Page 7: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/7.jpg)
Sampling and Quantization
• The sampling rate is the number of samples in a fixed amount of time or space.
• The quantization levels are the set of values to which a signal is quantized.
![Page 8: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/8.jpg)
Analogue vs Digital
![Page 9: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/9.jpg)
Benefits of digital signals
• High fidelity• Noise tolerance
![Page 10: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/10.jpg)
Frequency Domain
• Any periodic waveform can be decomposed into a collection of frequency components– Each one is a pure sine wave
• The collection of frequencies and their amplitudes represent the waveform in the frequency domain– Compute the frequency domain representation
(frequency spectrum) using the Fourier Transform– Higher frequency components are associated with
abrupt transitions
![Page 11: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/11.jpg)
Spatial and temporal signals
• Spatial and temporal signals are made up of pure sine wave components at different frequencies.
• The Fourier Transform operation can be used to compute a signal’s representation in the frequency domain.
• Higher-frequency components are associated with abrupt transitions.
![Page 12: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/12.jpg)
![Page 13: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/13.jpg)
Sampling Theorem
• If the highest frequency component of a signal is at fh the signal can be properly reconstructed if it has been sampled at a frequency > 2fh– Nyquist rate
• Undersamping leads to aliasing– Sound distortion, image 'jaggies' or Moiré
patterns, jerky or retrograde motion
![Page 14: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/14.jpg)
Aliasing
Anti-aliased
Aliased
![Page 15: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/15.jpg)
Aliasing
![Page 16: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/16.jpg)
Moiré Patterns
![Page 17: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/17.jpg)
Too Few Quantization Levels
• Reducing memory requirements by using fewer bits for each value means fewer quantization levels are available
• Cannot distinguish between values that fall between levels
• Images: banding and posterization• Sound: coarse hiss, loss of quiet passages,
general fuzziness (quantization noise)
![Page 18: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/18.jpg)
Image banding effects
![Page 19: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/19.jpg)
Posterization
![Page 20: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/20.jpg)
Digital Representation of Media
• There are established ways of representing images, video, animation, sound and text in bits.
• Media data may be represented as a textual description in a suitable language, or as binary data with a specific structural form.
![Page 21: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/21.jpg)
Image
• Images are displayed as arrays of pixels and represented using an internal model. Generating the pixels from the model is called rendering.
![Page 22: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/22.jpg)
Bitmaps vs Vector Graphics
• Images may be modelled as bitmaps or vector graphics.
• A bitmap is an array of logical pixels (stored colour values) that can be mapped directly to the physical pixels on the display.
• In vector graphics, the image is stored as a mathematical description of a collection of individual lines, curves and shapes making up the image, which requires computation to render it.
![Page 23: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/23.jpg)
![Page 24: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/24.jpg)
![Page 25: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/25.jpg)
Good Things for Vector Graphics
• Often smaller than bitmaps• Resolution-independent• Scalable without loss of quality – only suitable for certain sorts of synthetic image,
not photographs
![Page 26: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/26.jpg)
![Page 27: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/27.jpg)
![Page 28: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/28.jpg)
![Page 29: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/29.jpg)
Combining Vectors & Bitmaps
• Rasterize vectors– Lose all their vector properties
• Trace bitmaps– Difficult and can only produce an approximation
(parameterized)
![Page 30: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/30.jpg)
Layers• Organizational device used in both sorts of
graphics, especially useful in bitmaps– Permits separation and manipulation of different
parts of a bitmapped image• Digital version of clear sheets of acetate,
stacked on top of each other– Areas without coloured pixels/graphic objects are
transparent so lower layers show through• Compositing – combine layers using different
blending modes (digital collage)
![Page 31: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/31.jpg)
Creatively Blending Layers
http://www.carlvolk.com/photoshop15.htm
![Page 32: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/32.jpg)
Creatively Blending Layers
http://www.carlvolk.com/photoshop15.htm
![Page 33: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/33.jpg)
Graphics/Image Data Types
![Page 34: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/34.jpg)
RGB Components
![Page 35: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/35.jpg)
Moving pictures, Videos, Animation
• Moving pictures can be created as live-action or animation.
• Live-action must be stored as video.• Animation may be represented in other more
flexible or efficient ways.• Video frames require a lot of storage so video
is invariably compressed for delivery.
![Page 36: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/36.jpg)
![Page 37: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/37.jpg)
Sound
• Sound can be represented as a sequence of samples after digitization.
• CD audio is sampled at 44.1 kHz, higher sampling rates are sometimes used.
• Audio delivered over the Internet is compressed, often using the MP3 codec.
![Page 38: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/38.jpg)
Text
• A character set is a mapping from characters to character codes.
• Unicode is a character set capable of representing text in all known languages.
• A font is a set of character shapes, called glyphs.
![Page 39: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/39.jpg)
![Page 40: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/40.jpg)
Layout and Typography
• Many aspects of layout must be controlled when text is displayed.
![Page 41: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/41.jpg)
Interactivity
• Interactivity is produced by executing a program in response to user input.
• In multimedia, programs are often written in a scripting language, such as JavaScript or ActionScript.
![Page 42: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/42.jpg)
Compression
• Compression must often be applied to media data.
• Compression may be lossless or lossy.– Lossless – image can be reconstructed exactly
from compressed version– Lossy – some information discarded, image can
only be reconstructed approximately
![Page 43: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/43.jpg)
![Page 44: Fundamentals](https://reader035.vdocuments.mx/reader035/viewer/2022062810/56815ba9550346895dc9ac35/html5/thumbnails/44.jpg)
Compression
• Different compression algorithms are applicable to different types of media data. Their effectiveness depends on the characteristics of the data itself.