Media Type:Sound
Common File Formats:.WAV, .MID, .AU
Description:Sound complements your titles with music, sound effects and voiceovers that create a mood, add emphasis, communicate ideas, or signal interactivity.
SoundSound
• How to make soundsHow to make sounds
• How to record and edit soundsHow to record and edit sounds
• How to incorporate sounds into your How to incorporate sounds into your workwork
Sound Types in Sound Types in MultimediaMultimedia
1) Narration 1) Narration
2) Sound effect2) Sound effect
3) Music3) Music
1) Narration1) Narration
• Voice recording for specific use at a Voice recording for specific use at a predetermined time or “on demand” in predetermined time or “on demand” in an interactive environment.an interactive environment.
• Says what you want to say and when Says what you want to say and when you want to say ityou want to say it
• Example: demonstrating a process or Example: demonstrating a process or procedure, it can be repeated, on procedure, it can be repeated, on demand, at the user’s discretion.demand, at the user’s discretion.
NarrationNarration
• Developer creates the narrative sound Developer creates the narrative sound track himself/herself or has it done by an track himself/herself or has it done by an outside source.outside source.
• Some of the considerations are:Some of the considerations are:
– Can I do it myself?Can I do it myself?
– Is my voice quality sufficient for the job?Is my voice quality sufficient for the job?
– Do I have the equipment to do the Do I have the equipment to do the recording?recording?
– If I use an outside source, where do I go?If I use an outside source, where do I go?
– Does my project have the funds to pay Does my project have the funds to pay for outside sources?for outside sources?
2) Sound Effects2) Sound Effects
• Most commonly used sound format in the Most commonly used sound format in the development of multimedia productionsdevelopment of multimedia productions
• Very effective at getting a point across and Very effective at getting a point across and grabbing the attention of an audiencegrabbing the attention of an audience
• One of the easiest formats to obtain from One of the easiest formats to obtain from companies specialize in producing sound companies specialize in producing sound effects for distributioneffects for distribution
– e.g CD-ROMe.g CD-ROM
– formats include .aif, .wav, and others, formats include .aif, .wav, and others, and are compatible with Macintosh and and are compatible with Macintosh and Windows applicationsWindows applications
3) Music3) Music
• Obtained through various clip media Obtained through various clip media vendorsvendors
• To support any musical taste and to To support any musical taste and to accompany any style graphic or videoaccompany any style graphic or video
• Two types :Two types :
– Basic Sound(Digital audio)Basic Sound(Digital audio)
– Advance Sound (MIDI)Advance Sound (MIDI)
MIDIMIDI• Musical Instrument Digital InterfaceMusical Instrument Digital Interface
• developed in early 1980s for electronic developed in early 1980s for electronic musical instruments and computers.musical instruments and computers.
• Allows music and sound synthesizers from Allows music and sound synthesizers from different manufacturers to communicate different manufacturers to communicate each other by sending messaged along each other by sending messaged along cables connected to the devicescables connected to the devices
• Protocol for passing detailed descriptions of Protocol for passing detailed descriptions of a musical score, such as notes, sequences a musical score, such as notes, sequences of notes, and what instrument will play of notes, and what instrument will play these notesthese notes
MIDIMIDI
• Not digitized sound; it is a shorthand Not digitized sound; it is a shorthand representation of music stored in representation of music stored in numeric formnumeric form
• A score that depends on the capabilities A score that depends on the capabilities of your sound system, the other on the of your sound system, the other on the quality of your musical instruments and quality of your musical instruments and the capabilities of your sound systemthe capabilities of your sound system
• MIDI files are much more compact than MIDI files are much more compact than digital audio files - independent of digital audio files - independent of playback qualityplayback quality
MIDI MIDI
• MIDI files are small, they don’t take much MIDI files are small, they don’t take much RAM, disk space,and CPU resourcesRAM, disk space,and CPU resources
• May sound better than digital audio files May sound better than digital audio files if MIDI sound source is of high qualityif MIDI sound source is of high quality
• Can change the length of a MIDI file(by Can change the length of a MIDI file(by varying its tempo)without changing the varying its tempo)without changing the pitch of the music or degrading the audio pitch of the music or degrading the audio qualityquality
• Completely editable- right down to the Completely editable- right down to the level of an individual notelevel of an individual note
MIDIMIDI • MIDI files are small, they don’t take much MIDI files are small, they don’t take much
RAM, disk space,and CPU resourcesRAM, disk space,and CPU resources
• May sound better than digital audio files if May sound better than digital audio files if MIDI sound source is of high qualityMIDI sound source is of high quality
• Can change the length of a MIDI file(by Can change the length of a MIDI file(by varying its tempo)without changing the pitch varying its tempo)without changing the pitch of the music or degrading the audio qualityof the music or degrading the audio quality
• Completely editable- right down to the level Completely editable- right down to the level of an individual noteof an individual note
• Require a modicum of familiarity with Require a modicum of familiarity with musical scores, as well as audio productionmusical scores, as well as audio production
Choosing between MIDI and Digital Choosing between MIDI and Digital AudioAudio
In general, use MIDI data in the following:In general, use MIDI data in the following:
• Digital audio won’t work because you Digital audio won’t work because you don’t have enough RAM, hard disk don’t have enough RAM, hard disk space, or CPU processing powerspace, or CPU processing power
• You have a high quality sound sourceYou have a high quality sound source
• You have complete control over the You have complete control over the playback hardwareplayback hardware
• You don’t need spoken dialogYou don’t need spoken dialog
Choosing between MIDI and Digital Choosing between MIDI and Digital AudioAudio
In general, use digital audio in the In general, use digital audio in the following:following:
• You don’t have complete control over You don’t have complete control over the playback hardwarethe playback hardware
• You have the computing resources to You have the computing resources to handle digital fileshandle digital files
• You need spoken dialogYou need spoken dialog
Making MIDI audioMaking MIDI audio
• Midisoft Studio for Windows to Midisoft Studio for Windows to make MIDI scoresmake MIDI scores
• Sound synthesizer(typically built Sound synthesizer(typically built into the sound boards on PCs)into the sound boards on PCs)
• A MIDI Keyboard - useful to A MIDI Keyboard - useful to simplify creation of musical scoressimplify creation of musical scores
• File formats: .midFile formats: .mid
Digital AudioDigital Audio
• Digitize sound from:Digitize sound from:
– microphonemicrophone
– synthesizersynthesizer
– existing tape recordingsexisting tape recordings
– live radio and television broadcastslive radio and television broadcasts
– popular CDspopular CDs
– recordsrecords
Digital AudioDigital Audio
• Digitize sound is sampled soundDigitize sound is sampled sound
• Three sampling frequencies most often Three sampling frequencies most often used in multimedia are:used in multimedia are:
– CD-quality 44.1KHzCD-quality 44.1KHz
– 22.05 KHz22.05 KHz
– 11.025 KHz11.025 KHz
• Sample sizes are either 8 bits or 16 bitsSample sizes are either 8 bits or 16 bits
• The larger the sample size, the better The larger the sample size, the better the data describes the recorded soundthe data describes the recorded sound
Preparing digital audio Preparing digital audio files:files:
• Balancing the need for sound Balancing the need for sound quality with your available RAM and quality with your available RAM and hard disk resourceshard disk resources
• Setting proper recording levels to Setting proper recording levels to get a good, clean recordingget a good, clean recording
File Size versus QualityFile Size versus Quality
• For a monophonic recording:For a monophonic recording:
– sampling rate * duration of recordings sampling rate * duration of recordings in seconds * (bit resolution/8) * 1in seconds * (bit resolution/8) * 1
• For a stereo recording:For a stereo recording:
– sampling rate * duration of recordings sampling rate * duration of recordings in seconds * (bit resolution/8) * 2in seconds * (bit resolution/8) * 2
• Example: For a 10-second recording at Example: For a 10-second recording at 22.05KHz, 8-bit resolution would be:22.05KHz, 8-bit resolution would be:
– 22050 * 10 * 8/8 * 1 = 220,500 bytes22050 * 10 * 8/8 * 1 = 220,500 bytes
Evaluating sound Evaluating sound qualityquality Sampling Frequency Rate
11.025kHz 22.05 kHz 44.1 kHz
8 bits Lowest quality
Good quality
Very good quality
16 bits Acceptable quality
Very good quality
Highest quality
Editing Digital RecordingsEditing Digital Recordings• Trimming Trimming
• Splicing and AssemblySplicing and Assembly
• Volume adjustmentsVolume adjustments
• Format conversionFormat conversion
• Resampling or downsamplingResampling or downsampling
• Fade-ins and Fade-outsFade-ins and Fade-outs
• EqualizationEqualization
• Time StretchingTime Stretching
• Digital Signal Processing (DSP): process signal Digital Signal Processing (DSP): process signal with effects such as reverberation, multitab with effects such as reverberation, multitab delay, chorus, flange, and other special effectsdelay, chorus, flange, and other special effects
Audio File FormatsAudio File Formats
• A sound’s file format is simply a A sound’s file format is simply a recognized methodology for organizing recognized methodology for organizing the digitized sound’s data bits and bytes the digitized sound’s data bits and bytes into a data fileinto a data file
• On the Macintosh, digitized sounds may On the Macintosh, digitized sounds may be stored as data files , .AIF or .SDIIbe stored as data files , .AIF or .SDII
• On the Windows, .WAVOn the Windows, .WAV
• On the Internet, On the Internet,
Adding Sound to your Multimedia Adding Sound to your Multimedia ProjectProject
1. Decide what kind of sound is needed(such as 1. Decide what kind of sound is needed(such as background music, special sound effects, and background music, special sound effects, and spoken dialog). Fit the sound cues into your spoken dialog). Fit the sound cues into your storyboard.storyboard.
2. Decide where and when you want to use 2. Decide where and when you want to use either digital audio or MIDI data.either digital audio or MIDI data.
3. Acquire source material by creating it from 3. Acquire source material by creating it from scratch or purchasing it.scratch or purchasing it.
4. Edit the sounds to fit your project.4. Edit the sounds to fit your project.
5. Test the sounds to be sure they are timed 5. Test the sounds to be sure they are timed properly with the project’s images. This may properly with the project’s images. This may involve repeating steps 1 through 4 until involve repeating steps 1 through 4 until everything is in synch.everything is in synch.
Media Type:Video
Common File Formats:.AVI, .MPG
Description:Full-motion video offers a level of authenticity similar to television or movies. With video, you can show tasks and events that words and graphics are inadequate to explain. And video quickly and effectively reaches a busy audience.
Uses of VIDEOUses of VIDEO
• Common practice to have a video clip or Common practice to have a video clip or two in a presentationtwo in a presentation
• Fastest way to deliver a message across Fastest way to deliver a message across an audiencean audience
• Captivate our attention and it also helps Captivate our attention and it also helps us retain more information in our memory us retain more information in our memory than with just plain text and graphicsthan with just plain text and graphics
• We, are after all, audio-visual creaturesWe, are after all, audio-visual creatures
What is VIDEO?What is VIDEO?
• A series of frames containing pictures A series of frames containing pictures and sound played back at a fast rate.and sound played back at a fast rate.
• Single frame is a picture with a specific Single frame is a picture with a specific action.action.
• Several frames of the same picture but Several frames of the same picture but with slight variation in the action, are with slight variation in the action, are grouped together and played back grouped together and played back within a specific time, the picture will within a specific time, the picture will give an impression of movement.give an impression of movement.
What is VIDEO?What is VIDEO?
• Measured in frames per second or fps.Measured in frames per second or fps.
• US, video is played back at 30 fps which US, video is played back at 30 fps which is set up by their National Television is set up by their National Television Standards Committee , NTSC.Standards Committee , NTSC.
• UK, Australia and most part of Asia uses UK, Australia and most part of Asia uses PAL (Phase Alternation Line) , 25 fps for PAL (Phase Alternation Line) , 25 fps for video and television playback.video and television playback.
• Multi-systems for television sets and Multi-systems for television sets and video cassette recordersvideo cassette recorders
TWO Types of VIDEOTWO Types of VIDEO
• ANALOGUE VIDEO: signal having a ANALOGUE VIDEO: signal having a continuous set of valuescontinuous set of values
• DIGITAL VIDEO: set of discrete DIGITAL VIDEO: set of discrete valuesvalues
Differences between Analogue and Differences between Analogue and DigitalDigital
• Analogue picture can be enlarged to Analogue picture can be enlarged to any size without loss of quality of any size without loss of quality of the image.the image.
• Digital picture which is made of Digital picture which is made of pixels of picture element, loses pixels of picture element, loses quality when it is enlarged - the quality when it is enlarged - the total image to be less sharp.total image to be less sharp.
ANALOGUE TO DIGITALANALOGUE TO DIGITAL• Digitizing means converting the video signal to Digitizing means converting the video signal to
digital informationdigital information
• To digitize video on your desktop PC:To digitize video on your desktop PC:
– ANALOGUE sourceANALOGUE source
•VCR, Laser discs players, CamcorderVCR, Laser discs players, Camcorder
– FAST CPU and a lot of memory(RAM)FAST CPU and a lot of memory(RAM)
• faster the processor, the better the digital faster the processor, the better the digital video will be, minimum 486 66MHzvideo will be, minimum 486 66MHz
•more memory, the easier it is to capture more memory, the easier it is to capture and digitize video, minimum 32MBs to and digitize video, minimum 32MBs to 64MBS or more64MBS or more
ANALOGUE TO DIGITALANALOGUE TO DIGITAL
• HARDDRIVEHARDDRIVE
– Video files consumes a lot of storage spaceVideo files consumes a lot of storage space
– fastfast
• VIDEO CAPTURE BOARDVIDEO CAPTURE BOARD
– connects the analogue source to your connects the analogue source to your computercomputer
– captures the video signals from the source captures the video signals from the source and converts the analogue video to digital and converts the analogue video to digital video which uses CODEC to digitize the video which uses CODEC to digitize the videovideo
– E.g. CREATIVE Lab’s Video BlasterE.g. CREATIVE Lab’s Video Blaster
VIDEO FILE FORMATVIDEO FILE FORMAT
• WINDOWSWINDOWS
– .AVI (Audio Video Interleave).AVI (Audio Video Interleave)
– combines both audio and video datacombines both audio and video data
Digital Video SizeDigital Video Size
• Video files are huge because it contain Video files are huge because it contain both video and audio databoth video and audio data
• To calculate the size of a video, several To calculate the size of a video, several factors need to be considered:factors need to be considered:
– SCREEN SIZE: Larger the screen size, SCREEN SIZE: Larger the screen size, the larger the video file will be. Full the larger the video file will be. Full screen video is 640 x 480 in size- screen video is 640 x 480 in size- number of pixels on screen. number of pixels on screen. •Use one quarter screen which is 320 Use one quarter screen which is 320
x 240 or one sixteenth of a screen, x 240 or one sixteenth of a screen, 160 x 120 pixels160 x 120 pixels
Digital Video SizeDigital Video Size
• COLOUR: Primary Colors, RGBCOLOUR: Primary Colors, RGB
– Computer, each color take up 8-bits of Computer, each color take up 8-bits of space per pixel.space per pixel.
– Realistic Color digital video, each pixel Realistic Color digital video, each pixel in a computer will comprise of 24-bit in a computer will comprise of 24-bit color(true color)color(true color)
• FRAME RATE: Real time video is played at FRAME RATE: Real time video is played at 25fps using PAL and 30fps using NTSC25fps using PAL and 30fps using NTSC
– Digital video clips are played at 15fpsDigital video clips are played at 15fps
– more frame rates used per second, more frame rates used per second, larger the video file will be.larger the video file will be.
Digital Video SizeDigital Video Size
• SOUND AND TIME:SOUND AND TIME:
– sound adds storage space to the file; sound adds storage space to the file; higher quality , the more space it higher quality , the more space it takes uptakes up
– longer the video clip, the larger file longer the video clip, the larger file sizesize
CODECCODEC
• Compressor/decompressorCompressor/decompressor
• a software device to compress and a software device to compress and decompress data(video)decompress data(video)
• PC, most widely used CODECS:PC, most widely used CODECS:
– Cinepack and Indeo => .aviCinepack and Indeo => .avi
– Apple Quicktime => .movApple Quicktime => .mov
– MPEG => .mpgMPEG => .mpg
VIDEO EDITING SOFTWAREVIDEO EDITING SOFTWARE
• Allows you to edit and add effects and Allows you to edit and add effects and enhancement to your digital video clipenhancement to your digital video clip
• ADOBE PREMIEREADOBE PREMIERE
• ASSYMETRIX DVPASSYMETRIX DVP
• ADOBE AFTER EFFCETSADOBE AFTER EFFCETS
Media Type:Graphics
Common File Formats:.DIB, .BMP, .WMF, .TIF
Description:Graphics shape the design of your title, adding visual appeal and expressing concepts that text alone cannot easily communicate. You can scan graphics or create them on a computer, then save them in the file format you need
Form of ImagesForm of Images
• PhotographPhotograph
• interactive buttoninteractive button
• computer illustration orcomputer illustration or
• video footage from your camcodervideo footage from your camcoder
Uses of Visual GraphicsUses of Visual Graphics
• To create dazzling background To create dazzling background texturestextures
• Visualization of information and Visualization of information and data, such as spreadsheet datadata, such as spreadsheet data
• Enhance a textual point on the Enhance a textual point on the screen, or making a button visually screen, or making a button visually simulating through picture iconssimulating through picture icons
Types of Graphics or Digital Types of Graphics or Digital ImageImage
• Vector graphicsVector graphics
• Bitmapped graphicsBitmapped graphics
Vector graphicsVector graphics
• Describes a shape or image using lines Describes a shape or image using lines and curves and the image is stored as a and curves and the image is stored as a series of co-ordinatesseries of co-ordinates
• consists of line drawings such as lines, consists of line drawings such as lines, rectangles, ellipses, arcs, spline curvesrectangles, ellipses, arcs, spline curves
• Do not look like photographsDo not look like photographs
• CorelDraw!, Macromedia Freehand and CorelDraw!, Macromedia Freehand and Adobe IllustartorAdobe Illustartor
Examples of Vector Graphics:
Bitmapped graphicsBitmapped graphics
• Images made up of pixels, tiny dots Images made up of pixels, tiny dots on your screen or printer, each of on your screen or printer, each of which you can paint a particular which you can paint a particular colorcolor
• Images that come from a scanner, a Images that come from a scanner, a photograph or images captured from photograph or images captured from a video camcorder or TVa video camcorder or TV
• Picture + ElementPicture + Element
Bitmapped graphicsBitmapped graphics
• Pixels can be either on or off (the 1-bit Pixels can be either on or off (the 1-bit bitmap, monochrome black and white) orbitmap, monochrome black and white) or
• Can represent varying shades of colorCan represent varying shades of color
• 4-bit => 16 colors4-bit => 16 colors
• 8-bit => 256 colors8-bit => 256 colors
• 16-bit => 65,356 colors16-bit => 65,356 colors
• 24-bit => millions of colors24-bit => millions of colors
Examples of Bitmapped GraphicsExamples of Bitmapped Graphics
Different ways to make a Different ways to make a bitmapbitmap
• Make a bitmap from scratch with a Make a bitmap from scratch with a paint programpaint program
• Grab a bitmap from an active Grab a bitmap from an active computer screen with a screen computer screen with a screen capture program, and then paste it capture program, and then paste it into a paint program or your into a paint program or your applicationapplication
• Capture a bitmap from a photo, Capture a bitmap from a photo, artwork using a scannerartwork using a scanner
Bitmapped graphics softwareBitmapped graphics software
• Adobe PhotoshopAdobe Photoshop
• Windows PaintbrushWindows Paintbrush
• Fractal Design PainterFractal Design Painter
• PaintShop ProPaintShop Pro
Digital Image File FormatsDigital Image File Formats
• *.BMP => Windows Bitmap*.BMP => Windows Bitmap
• *.GIF => Graphics Interchange Format. A *.GIF => Graphics Interchange Format. A CompuServe Information Service Format CompuServe Information Service Format used to compressed bitmapped imagesused to compressed bitmapped images
• *.JPG =>Joint Photographic Experts *.JPG =>Joint Photographic Experts Group(JPEG). Used by various drawing Group(JPEG). Used by various drawing program and the Internet because it program and the Internet because it compresses bitmapped images into a compresses bitmapped images into a smaller sizesmaller size
Digital Image File FormatsDigital Image File Formats
• *.TIF => Tagged Image File *.TIF => Tagged Image File Format. Introduced by Aldus and Format. Introduced by Aldus and has many file versions. File sizes has many file versions. File sizes also tend to be rather largealso tend to be rather large
Acquiring GraphicsAcquiring Graphics
• Creating digital images in-house through Creating digital images in-house through the use of special graphics packagethe use of special graphics package
• hiring graphic houses/designershiring graphic houses/designers
• purchasing digital clipartpurchasing digital clipart
• scanning photographsscanning photographs
• taking digital photos with a digital taking digital photos with a digital cameracamera
Calculating File Size for an ImageCalculating File Size for an Image
• Height of the graphics (the number Height of the graphics (the number of pixels displayed horizontally)of pixels displayed horizontally)
• Width of the graphics (the number Width of the graphics (the number of pixels displayed vertically)of pixels displayed vertically)
• Color depth or bit depth (the Color depth or bit depth (the number of bits of color information number of bits of color information in each pixel)in each pixel)
Calculating File Size for an ImageCalculating File Size for an Image
• Image size(in bytes) = Image size(in bytes) =
(Height x Width x Color Depth) /8(Height x Width x Color Depth) /8
Features of Image Editing Features of Image Editing ToolsTools
• Multiple windows, which provide views of Multiple windows, which provide views of more than one image at a timemore than one image at a time
• Conversion of major image data types and Conversion of major image data types and industry standard file formatsindustry standard file formats
• Direct inputs of images from scanner and Direct inputs of images from scanner and video sourcesvideo sources
• Employment of a virtual memory scheme Employment of a virtual memory scheme that uses hard disk space as RAM for that uses hard disk space as RAM for images that require large amounts of images that require large amounts of memorymemory
Features of Image Editing Features of Image Editing ToolsTools
• Capable selection tools, such as rectangles, lassos, and Capable selection tools, such as rectangles, lassos, and magic wands, to select portions of a bitmapmagic wands, to select portions of a bitmap
• Image and balance controls for brightness, contrast, Image and balance controls for brightness, contrast, and control balanceand control balance
• Good masking featuresGood masking features
• Multiple undo and restore featuresMultiple undo and restore features
• Anti-aliasing capability, and sharpening and smoothing Anti-aliasing capability, and sharpening and smoothing controlscontrols
• Color-mapping controls for precise adjustment of color Color-mapping controls for precise adjustment of color balancebalance
Features of Image Editing Features of Image Editing ToolsTools
• Tools for retouching, blurring, sharpening, Tools for retouching, blurring, sharpening, lightening, darkening, smudging, and tintinglightening, darkening, smudging, and tinting
• Geometric transformations such as flip, skew, Geometric transformations such as flip, skew, rotate, and distort, and perspective changesrotate, and distort, and perspective changes
• Ability to resample and resize an imageAbility to resample and resize an image
• 24-bit color, 8- or 4-bit indexed color, 8-bit 24-bit color, 8- or 4-bit indexed color, 8-bit gray scale, black and white,and customizable gray scale, black and white,and customizable color palettescolor palettes
• Ability to create images from scratch, using Ability to create images from scratch, using line, rectangle, square, circle, ellipse, polygon, line, rectangle, square, circle, ellipse, polygon, airbrush etcairbrush etc
Features of Image Editing Features of Image Editing ToolsTools
• Multiple typefaces, styles, and sizes, Multiple typefaces, styles, and sizes, and type manipulation and masking and type manipulation and masking routinesroutines
• Filters for special effects, such as Filters for special effects, such as crystallize, dry brush, emboss, facet crystallize, dry brush, emboss, facet etcetc
• Ability to design in layers that can be Ability to design in layers that can be combined, hidden, and reordered.combined, hidden, and reordered.
Media Type:Text
Common File Formats:.TXT, .RTF, .DOC
Description:Text often shapes the content of a multimedia title, delivering key information and helping people navigate among topics. As a rule, keep text brief and select a font that is easy to read onscreen.
Media Type:Animation
Common File Formats:.FLC, .FLI
Description:Animation enhances a project by activating graphics - charts that grow, mechanical objects that function - to illustrate your point. You can also use animated effects, such as text or logos flying onto the screen.
