History of Sound Cards & History of Sound Cards & Digital Audio on PCs from Digital Audio on PCs from

1980-891980-89

March 26March 26thth 2004 2004Updated 5Updated 5thth April 2004 April 2004

Update 31/8/08Update 31/8/08

Lyndsay WilliamsLyndsay WilliamsMicrosoft Research Cambridge, UK Microsoft Research Cambridge, UK

Introduction Introduction

• Chronological history of some of Lyndsay Williams Chronological history of some of Lyndsay Williams contributions to digital audio for Personal Computers from contributions to digital audio for Personal Computers from 19801980

• The first soundcard design for a PC discussedThe first soundcard design for a PC discussed

• How the lack of patents and Intellectual Property protection How the lack of patents and Intellectual Property protection enabled widespread acceptance of digital audio on PCsenabled widespread acceptance of digital audio on PCs

• Mention of possibly the most replicated computer bug in a Mention of possibly the most replicated computer bug in a pc?pc?

Wilmslow 1974, homeWilmslow 1974, home Lyn’s first designs of music synthesiser - TTL logicLyn’s first designs of music synthesiser - TTL logic

PE Sequencer 1977 PE Sequencer 1977 Lyndsay RobinsonLyndsay Robinson

3 year interlude – no sound 3 year interlude – no sound designs designs

• BSc, Hons Biomedical Electronics, University of Salford, UK, 1978- 1980BSc, Hons Biomedical Electronics, University of Salford, UK, 1978- 1980

Research 1980-82Research 1980-82

• British Aerospace Woodford, Cheshire – Avionics Engineer, Patented research - noise reduction British Aerospace Woodford, Cheshire – Avionics Engineer, Patented research - noise reduction for Queen’s Flight (accelerometers measure out of phase propeller balance for 748 Aircraft ) for Queen’s Flight (accelerometers measure out of phase propeller balance for 748 Aircraft ) (Lyndsay Robinson co-inventor) (Lyndsay Robinson co-inventor)

  The Queen's dogs leave an aircraft of The Queen's dogs leave an aircraft of The Queen's Flight from Aberdeen at The Queen's Flight from Aberdeen at Heathrow Airport. Queen Elizabeth is Heathrow Airport. Queen Elizabeth is a keen dog lover, particularly of Corgis,a keen dog lover, particularly of Corgis, and travels with them, whenever she can.and travels with them, whenever she can.(Associated Press) (Associated Press)

Inspiration from Fairlight CMI Inspiration from Fairlight CMI (1980)(1980)

• $50,000…$50,000…

Challenges for digitising audio Challenges for digitising audio - 1980- 1980

• Research – no prior art published on digital audio capture – none found at Xerox Parc Research – no prior art published on digital audio capture – none found at Xerox Parc (2004 search )(2004 search )

• How to record audio into a pc?How to record audio into a pc?• No private, industrial or university funding support No private, industrial or university funding support • ““what use is recording just 2 seconds of sound with no disc storage?”what use is recording just 2 seconds of sound with no disc storage?”

• Self financed (day job, Avionics Engineer)Self financed (day job, Avionics Engineer)• Help from UK pioneer Alan Boothman, Clef Products – music designs using Apple Help from UK pioneer Alan Boothman, Clef Products – music designs using Apple

computerscomputers

• Engineering challenges - Engineering challenges - • Noise in an 8 bit system (analog/digital proximity ) Noise in an 8 bit system (analog/digital proximity ) • New algorithms to develop, record sound, play back on a keyboard, real time pitch New algorithms to develop, record sound, play back on a keyboard, real time pitch

shifting shifting • Z80 – not powerful, need to signal process every audio sample in 30us (30 instructions) Z80 – not powerful, need to signal process every audio sample in 30us (30 instructions)

– Z80 assembler– Z80 assembler• Must be low cost add on for games market (retail £49) Must be low cost add on for games market (retail £49) • So build a prototype to demoSo build a prototype to demo

Fastest 8 bit analog to digital Fastest 8 bit analog to digital converter – 1979 converter – 1979 • Ferranti ZN 427 – 8 bit analog to digital converter Ferranti ZN 427 – 8 bit analog to digital converter

• ADC originally used for earthquake and vibration ADC originally used for earthquake and vibration measurement measurement

• 10us conversion time 10us conversion time

• Nearest competitor was 100usNearest competitor was 100us

• Successive approximation “A method for estimating the Successive approximation “A method for estimating the value of an unknown quantity by repeated comparison to a value of an unknown quantity by repeated comparison to a sequence of known quantities. “sequence of known quantities. “

• Much faster conversion than slope counterMuch faster conversion than slope counter

• Audio sampling should be > 30us (33khz)Audio sampling should be > 30us (33khz)

Digital Audio Recording Digital Audio Recording

Digital Audio Digitiser Digital Audio Digitiser (1982 Lyndsay Robinson)(1982 Lyndsay Robinson)

Pitch Shifting – non real Pitch Shifting – non real time time • Musical interval 1 octave = 1:2Musical interval 1 octave = 1:2

• 1 semitone 1:1.059 (121 semitone 1:1.059 (12thth root of 2) root of 2)

• Replay sound by incrementing sample pointer by chosen ratioReplay sound by incrementing sample pointer by chosen ratio

• E.g. to be octave higher , every 2E.g. to be octave higher , every 2ndnd sample played sample played

• Octave lower – every sample repeated twiceOctave lower – every sample repeated twice

• Chromatic keyboard playback Chromatic keyboard playback

• Z80 AssemblerZ80 Assembler

Pitch Shifting - real time Pitch Shifting - real time (1982)(1982)• Effects – real time voice pitch changing = fun!Effects – real time voice pitch changing = fun!

• Also useful – helium - divers voices , Dictaphone speed upAlso useful – helium - divers voices , Dictaphone speed up

• All processing to be done real time in 30us (30 instructions)All processing to be done real time in 30us (30 instructions)

• Z80 had no multiplyZ80 had no multiply

• Compression/decompression Compression/decompression

• Reverse sound, echoReverse sound, echo

• real time pitch shift real time pitch shift andand echo simultaneously ! echo simultaneously !

• Similar to Xbox voice changer (different algorithm)Similar to Xbox voice changer (different algorithm)

TRS-80/Spectrum SoundCard – TRS-80/Spectrum SoundCard – Published in Practical Computing 1982Published in Practical Computing 1982 (Lyndsay (Lyndsay

Robinson)Robinson)

• Z80 based Z80 based

Datel – Action ReplayDatel – Action Replay (Lyndsay Robinson)(Lyndsay Robinson) • Spectrum Computer add onSpectrum Computer add on• New Ferranti ZN427/ 449 analog to digital converter, 8 bit, New Ferranti ZN427/ 449 analog to digital converter, 8 bit,

low cost low cost • Recorded sampled sound with playback, pitch shifting, Recorded sampled sound with playback, pitch shifting,

echo, sound effects, games echo, sound effects, games • Lyn licensed Action Replay Sound Sampler to Datel, Stoke Lyn licensed Action Replay Sound Sampler to Datel, Stoke

on Trent, UK - 1984 on Trent, UK - 1984 • Sold thousand’s of SamplersSold thousand’s of Samplers• Pre dates .WAV file typePre dates .WAV file type• This was first real product for Datel 1984This was first real product for Datel 1984• Datel now have turnover of $150M/year (2003) – mainly in Datel now have turnover of $150M/year (2003) – mainly in

Xbox peripheralsXbox peripherals

Commodore Sound Sampler Commodore Sound Sampler

• 1984, gave up the day job (Software Engineer, Ferranti Oil 1984, gave up the day job (Software Engineer, Ferranti Oil & Gas Platform “C” software) and joined the music & Gas Platform “C” software) and joined the music business (Commodore Computers (UK) Music Sales/Watts) business (Commodore Computers (UK) Music Sales/Watts)

• Lyn sold design to Music Sales/Commodore Computers Lyn sold design to Music Sales/Commodore Computers (UK) (1984) (UK) (1984)

• Converted Datel design (Z80) to 6502 + MIDIConverted Datel design (Z80) to 6502 + MIDI• Added Windows GUI Interface 1984 to Commodore 64 Added Windows GUI Interface 1984 to Commodore 64

Sampler Sampler (Apple Lisa 1983, Microsoft Windows 1985)(Apple Lisa 1983, Microsoft Windows 1985)

Next stage after sampled Next stage after sampled sound? sound? • Samples fine for games but need more memory for musical Samples fine for games but need more memory for musical

instrument samples instrument samples • Limited sample memory 32kbytes/ 2 seconds = expensiveLimited sample memory 32kbytes/ 2 seconds = expensive

• Monophonic playback due to limited MIPS of Z80, 1Mhz – Monophonic playback due to limited MIPS of Z80, 1Mhz – musicians wanted polyphonic sounds musicians wanted polyphonic sounds

• Yamaha Polyphonic FM chip OPL-1 used in games consoles Yamaha Polyphonic FM chip OPL-1 used in games consoles – 9 channels of sound– 9 channels of sound

• Commodore 64 SID chip , only 3 channels of sound Commodore 64 SID chip , only 3 channels of sound • Music Sales (Europe’s largest music publisher ) were first Music Sales (Europe’s largest music publisher ) were first

customer to use Yamaha chip for sound card for customer to use Yamaha chip for sound card for Commodore 64 Commodore 64

Yamaha OPLYamaha OPL

• FM Synthesis invented by Chowning 1967(Stanford) – FM Synthesis invented by Chowning 1967(Stanford) – commercialised by Yamaha 1983 DX7 Keyboard commercialised by Yamaha 1983 DX7 Keyboard

• Modulated sinewavesModulated sinewaves• YM3526 first used in Arcade gamesYM3526 first used in Arcade games• YM3526 used in Commodore FM SFX Sound Expander 1985 YM3526 used in Commodore FM SFX Sound Expander 1985 • 9 channels of 2-operator voices 9 channels of 2-operator voices

• YM3812 OPL2 (used later by Soundblaster) was an YM3812 OPL2 (used later by Soundblaster) was an incremental upgrade to the YM3526 incremental upgrade to the YM3526

Commodore Computers UK, Commodore Computers UK, 1986 1986 (Williams, Watts, Music Sales)(Williams, Watts, Music Sales) • Commodore SFX - Music Maker, Sound Studio, Sound Commodore SFX - Music Maker, Sound Studio, Sound

Expander – now based on FM SynthesisExpander – now based on FM Synthesis

Most replicated computer Most replicated computer bug??bug??• Yamaha FM registers in apparently random order (like Japanese House Yamaha FM registers in apparently random order (like Japanese House

numbers) numbers) • Bug found by Williams/Watts in 1985 in YM3526Bug found by Williams/Watts in 1985 in YM3526• Did a workaround so quick time to market for Commodore computersDid a workaround so quick time to market for Commodore computers• Bug found again by Linux programmers when trying to emulate Soundblaster Bug found again by Linux programmers when trying to emulate Soundblaster

registersregisters• 2004 - OPL2 core now integrated into the South Bridge of the motherboard's 2004 - OPL2 core now integrated into the South Bridge of the motherboard's

chipsetchipset• Bug now in every PC? (>1 Billion?)Bug now in every PC? (>1 Billion?)

• The twenty-two registers (20-35, 40-55, etc.) have an The twenty-two registers (20-35, 40-55, etc.) have an unusual unusual    order   order due to the use of two operators for each FM voice. due to the use of two operators for each FM voice.          Channel        1 2   3   4   5  6  7   8   9   Channel        1 2   3   4   5  6  7   8   9   Operator 1    00  01  02  08  09  0A  10  11  12   Operator 1    00  01  02  08  09  0A  10  11  12   Operator 2    03  04  05  0B  0C  0D  13  14  15   Operator 2    03  04  05  0B  0C  0D  13  14  15

Philips MSX Sound Card 1986 Philips MSX Sound Card 1986 (Williams, Watts/ Music Sales)(Williams, Watts/ Music Sales) • NMS-1205NMS-1205

• Added 8 bit sampled record and playback , 32Kb Added 8 bit sampled record and playback , 32Kb

• 9 channels FM – Yamaha Y89509 channels FM – Yamaha Y8950

• MIDI, mic in, keybMIDI, mic in, keyb

Philips MSX FM/Sampler Sound Philips MSX FM/Sampler Sound Card Card

Philips Portable Music Philips Portable Music Composer – PMC 100 1986 Composer – PMC 100 1986 Williams, Watts et alWilliams, Watts et al

• Wearable ComputerWearable Computer

• Music Composer Music Composer

• 9 Channels FM Sounds9 Channels FM Sounds

• Drum machine, sequencer, multitrackDrum machine, sequencer, multitrack

• 6803 Processor, 8kbyte RAM6803 Processor, 8kbyte RAM

• MIDIMIDI

• Cassette for data/voice storageCassette for data/voice storage

• Can be used like WalkmanCan be used like Walkman

First Soundcard for PC?First Soundcard for PC?

• Sound cards designed for Commodore (64 & Amiga) , Sound cards designed for Commodore (64 & Amiga) , Philips, Atari, Spectrum – time to settle on a Philips, Atari, Spectrum – time to settle on a standardstandard

• PC appeared to be a standard for business computers so PC appeared to be a standard for business computers so decided to design soundcard for PCdecided to design soundcard for PC

• Design by Williams/Watts/Baker for Olivetti Computers, Italy Design by Williams/Watts/Baker for Olivetti Computers, Italy PC1 –XT clone – 1987 PC1 –XT clone – 1987

• PC1 - 8088 4.77Mhz, color, mouse, Sound Card – similar to PC1 - 8088 4.77Mhz, color, mouse, Sound Card – similar to Commodore SFX - FM 8 channelsCommodore SFX - FM 8 channels

• DOS 3.2 DOS 3.2

1987 - Adlib, Sound Blaster & 1987 - Adlib, Sound Blaster & Microsoft Microsoft

• Adlib 1987- just FM Synthesis – first high volume Soundcard Adlib 1987- just FM Synthesis – first high volume Soundcard

• Soundblaster 1988 –YM3812 FM Soundblaster 1988 –YM3812 FM andand Sampled Sound Sampled Sound

• Microsoft Microsoft asked Yamaha to makes their FM chips available on the open asked Yamaha to makes their FM chips available on the open market in 1989 (first customer was Music Sales) so a standard could be market in 1989 (first customer was Music Sales) so a standard could be enabled enabled

• PCB shows Commodore FM board (1986) next to Adlib (1987/90)PCB shows Commodore FM board (1986) next to Adlib (1987/90)

Psion Series 5Psion Series 5

• Williams responsible for some audio design on Psion Series 5 Williams responsible for some audio design on Psion Series 5

• Originally mono recording, Williams produced design for Originally mono recording, Williams produced design for stereo stereo Philips stereo DAC (TDA1543?) – for Psion in 1996 Philips stereo DAC (TDA1543?) – for Psion in 1996

• Psion had no compression software – 16Mbyte memoryPsion had no compression software – 16Mbyte memory

• Williams’ Goal- To allow stereo music playback via headphones – Williams’ Goal- To allow stereo music playback via headphones – or as minimum or as minimum hardware platform for future audiohardware platform for future audio

• Psion Management had no interest in Williams’ music playbackPsion Management had no interest in Williams’ music playback

• Fraunhofer released MP3 compression,Fraunhofer released MP3 compression,

• Rio Diamond Oct 1998 – first MP3 playerRio Diamond Oct 1998 – first MP3 player

• Apple Iphone invented 2001 with staff from PhilipsApple Iphone invented 2001 with staff from Philips

• Psion quits handheld computers market 2001Psion quits handheld computers market 2001

• Some Psion staff work for AppleSome Psion staff work for Apple

• Corrections Aug 2008, WilliamsCorrections Aug 2008, Williams

Where are they now?Where are they now?

• Commodore SFX , Philips, Datel cards –buy on Ebay 2004 Commodore SFX , Philips, Datel cards –buy on Ebay 2004

• Datel $150M/yr sales – Xbox peripherals Datel $150M/yr sales – Xbox peripherals

• Soundcards – all based on Yamaha FM Sound ChipSoundcards – all based on Yamaha FM Sound Chip

• No patents or IP protection on the original sound sampling No patents or IP protection on the original sound sampling algorithms or FM soundcard implementationsalgorithms or FM soundcard implementations

The End - Any Questions ?The End - Any Questions ?

More on http://research.microsoft.com/users/lyn/soundcard.aspxMore on http://research.microsoft.com/users/lyn/soundcard.aspx

Thanks toThanks to

• Richard Atkinson Richard Atkinson • Alan BoothmanAlan Boothman• Colin Robinson (1926-1998)Colin Robinson (1926-1998)• Trevor TaylorTrevor Taylor• Chuck Thacker Chuck Thacker • Richard WattsRichard Watts• Electronic Organ Constructors SocietyElectronic Organ Constructors Society

• More info on http://research.microsoft.com/users/lyn/More info on http://research.microsoft.com/users/lyn/

• Or email Lyndsay Williams lyn@microsoft.comOr email Lyndsay Williams lyn@microsoft.com