www.ateme.com

Hardware&

Software

Imaging on TI DSPsDSPs fes t 2000 - Marc GUILLAUM ET

www.ateme.com

� ATE ME presentat ion

� Imaging

� Algor ithms

� Roadmap

� Conclus ion

Agenda

Constructor and engineer ing servicesin elec tronics field

� Products

� Specif ic developments

� Times & materials

� Consult ing

¾ Imaging

¾ Signal process ing

¾ Telecom m unicat ion

¾ Analog

Activi ties Core business

Hardware & software

Successs tory

¾ 1991 : ATEM E’s s tar t (hardware speci fic des igns)

¾ 1992 : fi rst JPEG design (por table image acquis ition sys tem)

¾ 1993 : fi rst design wi th T.I . DSP (wi th embedded sof tware)

¾ 1994 : fi rst mult i -DSP archi tec ture

¾ 1995 : fi rstsys tem sof twareimplementat ion

¾ 1996 :f i rst completesys tem real iza tion

¾ 1997 : fi rst ATE ME’s product : 500 M Hz digi tizer

¾ 1998 : ATE ME becomes T.I.Third Party¾ 1999 : in ternat ional iza tion (web trade)

¾ 2000 : fi rst sof tware product : JPEG on ‘C6000

¾ 2001 : MPEG4 on ‘C6000 – C64x & C55x –JPEG 2000 - ...

ATEM E in figures

1992 1993 1994 1995 1996 19971998

1999

0

10

20

30

40

50

60

turnover (MF) funds (x 100 kF) staff ATE ME in 2000

� 60 enginners

� 6 M$ turnover

Know how

AudioGS M

AlgorithmPattern recogni tion

Analog

Modulat ion

HF

Condi tioningOptical interface

Amplif icat ion

Signal process ing

Image process ing

Tracking

Vision

ImageM PEG2

JPEG

Infra red

H261

MJPEGPAL

NTSC

SECA M

Restorat ion

M PLPCUT MS

CELP

GPRS

Product solut ion

Betterthan products of f theshel f … productssolut ions

= complete customized solut ion and productcommercial terms

+ Services

+ Customizat ion

Product

Hardware processAlgor ithmSoftware

Consul tingTechnicalsuppor tMaintenance agreement

BoardSoftwareComplete sys tem

System realiza tionFrom a product … to a complete system

Hardware platform

eXpressDSP compliant IP

ATEME’s products Customization

Mezzanine board

Software application

End-user interface

3P Network algorithmsAudioVideoRadar

TelecomAnalog

www.ateme.com

� ATEME presenta tion

� Imaging

� Algor ithms

� Roadmap

� Conclus ion

Agenda

Image compressionThe standards

Still images :� JPEG (DCT)� Fractale� Ondelette

Motion images :� Motion JPEG : independent frames encoding� H261 : video conference� H263 : video conférence (wireless), video phone� MPEG1 : CD video � MPEG2 : digital TV, DVD, Set-Top Box� MPEG4 : multi-media� MPEG7 : in 2001

Still image compression

� Transformation :¾ Discrete Cosinus Transform : Fourrier analyses (JPEG)¾ Fractale : structure that represent similar caracteristics in different scales¾ Wavelets (JPEG 2000 : in 2001) : periodic fonctions with nul average.

� Quantification :¾ information loss¾ define the compression ratio¾ Non existing for “lossless” standards

� Encoder : lossless encoding of the quantification step output data

Transformation Quantification Encoder

Motion image compression

H261 and H263 standards

� DCT transform

� Motion estimation between images

� Low rate and very low rate applications

� Variables rates

� Layer structure of the compressed data stream

� Main applications :¾ Video conférence¾ Video phone

� Standard use : low quality et very low data rate (RNIS, RTC)

MPEG 1 and MPEG 2 standards

� DCT transform - Motion estimation between images

� MPEG 1 : fixed resolution : CIF¾ 352 x 240, 30 i/s in NTSC¾ 352 x 288, 25i/s in PAL¾ rate : 1.5 Mb/s

� MPEG 1 main applications :¾ video CD¾ Multimedia (PC)

� MPEG 2 = MPEG 1 successor (variable resolution)¾ variable resolution¾ standard use : broadcast format – good quality - 2 to 12 Mb/s

� MPEG 2 main applications :¾ Digital television (satellite, cable, microwave channel to come)¾ DVD

Motion image compression

MPEG 4 standard

� Latest MPEG group standard (publication in Q1/2000)

� Object description (audio, video, 3D scenes, …)

� Hierarchical objects organization and scene descriptions

� Low profile version

� Multi compression algorithms : H263, MPEG2, CELP, MP3, AAC, …

� Main applications :¾ Wireless¾ Internet

� Standard use : ¾ good quality with limited rate (800 Kb/s for a movie)¾ average quality with a very low rate

Motion image compression

Motion JPEG applications

Drones

Trains

Bâtiments

JPEG Keys :

� Indenpendent frame encoding :9 Multi-sources

9 Image processing9 Evidence

� Lossless Applications :

� Video security

� Image transmission

� Identification� Medical

� Photography

www.ateme.com

� ATEME presenta tion

� Imaging

� Algorithms

� Roadmap

� Conclus ion

Agenda

Software por tfo l io

eXpressDSPSoftware Technology

compliant

� ‘C6000 JPEG encoder

� ‘C6000 JPEG decoder

Sti l l images

� ‘C6000 MJPEG encoder

� ‘C6000 MJPEG decoder

Motion images

Imaging algorithms on TI DSPs

Librairies

Algorithms

6 Librairies :� Encoder, Decoder and CODEC � JPEG and Motion JPEG� MJPEG uses headers

eXpressDSP compliance (xDAIS) :� First world wide imaging algorithm to pass the T.I. compliance

tests

Parameters :� YUV 4:2:2, 4:1:1, 4:2:0, 4:0:0 � RST markers, Headers (SOI/DQT/DHT/SOF/EOI)� Pixels organization in line or matrix� 0 insertion can be disabled� Quantification tables configurables (rate adaptation)

Librairies

Algorithms

eXpressDSP (xDAIS) :� Development environnement� Real time tools� DSP algorithm standard� Third Party network

DSP algorithm standard (xDAIS) :� Design rules � Standardized interface� Texas Instruments compliance tests

For end-user :� Different algorithms evaluation in a minimum of time� Easy built application using different algorithms� Easy change of algorithm (or vendor)

� Data organizat ion :¾ YCrCb 4:2:2 Best quality

¾ YCrCb 4:2:0 The most common

¾ YCrCb 4:0:0 Black & White

� JPEG Performance encoder :¾ 720x288 pixels – YCrCb 4:2:0 :

18 ms/field on ’C6203-300

� JPEG Performance decoder:¾ 720x288 pixels – YCrCb 4:2:0 :

20 ms/field on ’C6201-200

JPEG implementation on ‘C6000

� Parameters:¾ Quantification tables

¾ Frame size

¾ Input & output format

� Com mercial terms :¾ Executable

¾ NRE cost & run-time

¾ Support included

¾ Discount if running on ATEME’s design

� Data organizat ion :¾ YCrCb 4:2:2 Best quality

¾ YCrCb 4:2:0 The most common

¾ YCrCb 4:0:0 Black & White

� MJPEG Performance encoder :¾ Colour broadcast format (720x576) : real time (25 f/s) on ‘C6203-300

¾ Black & White broadcast format (720x576) : real time (25 f/s) on ‘C6201-167

¾ Colour CIF format (352x288) : real time (>50 f/s)on ‘C6211-150

� MJPEG Performance decoder:¾ Colour broadcast format (720x576) : real time (25 f/s) on ‘C6202-250

¾ Black & White broadcast format (720x576) : real time (>25 f/s) on ‘C6201-167

¾ Colour CIF format (352x288) : real time (>50 f/s)on ‘C6211-150

MJPEG implementat ion on ‘C6000

� Parameters:¾ Quantification tables

¾ Frame size

¾ Input & output format

Librairies

JPEG algorithms

Ressources management:� High level functions : algCreate() and algDelete()� Memory allocation : algAlloc() and algFree()� Initialisation : algInitObj()

JPEG functions :� quantification tables preparation (for compression) : JPG_ATE_createQuantif() - non real time function (Division).� Compression : JPG_ATE_ateComp()� Décompression : JPG_ATE_ateDcomp()

Librairies

JPEG algorithms

Function JPG_ATE_ateComp() parameters :� handle� in[ ] : input pixels table (16 bits)� out[ ] : output data table (32 bits)� lenOut : size available in the output table� qFactor : reserved

Paramètres de la fonction JPG_ATE_ateDcomp() :� handle� in[ ] : input pixels table (32 bits)� out[ ] : output data table (8 bits)� qFactor : reserved

Librairies

JPEG algorithms

/* Quantization table preprocessing */JPG_ATE_createQuantif(Luminance)JPG_ATE_createQuantif(Chrominance)/* Algo. instance creation and initialization */alg = JPG_create()

/* Encode one picture */char status = 1while ((status != IALG_EOK)

&& (status != IALG_EFAIL)) {

/* Load numMCURx256 pixels in bufferIn */bufferIn[] = … /* Format YUV 422 *//* Encode each block */status = JPG_ATE_ateComp(alg,bufferIn[],

bufferOut[],lenOut,0)

Application exemple :/* Transfer result bufferOut[] */if (status != IALG_EFAIL) {}else {/* lenOut is too small */}

} /* while */

/* Algorithm instance deletion */JPG_delete()

www.ateme.com

� ATEME presenta tion

� Imaging

� Algor ithms

� Roadmap

� Conclus ion

Agenda

Hardware por tfo l io

Stand aloneMeasureterminal

‘C54x

� Battery operated

� Analog & TTL IOs

� Com municat ion l inks

� FPGAs

Applications :

� Evaluat ion module

� Analog acquis i tion

� Low-end video

VXIMeasure and test

‘C44 & ‘C62x

� ‘C44 and ‘C6x

� Up to 1 GHz

� 256 Ms memory

Applications :

� Digit izer

� Analyser

� A.T.E.

PCISignal processing

‘C62x

� Up to 5 ‘C62x or ‘C67x

� 256 MB memory

� FPGAs

� Modular architecture

Applications :

� Imaging

� Radar data process ing

� Analog or video recording

� Simulator

� Evaluat ion module

Acquis i tion and s ignal process ing

Hardware road map

Q3/00 Q4/00 Q1/01

MJPEG

M PE G4JPEG 2000

ATEC54x‘C54x

Stand alone

M PE G2

Imaging‘C64x

module

ADR128‘C6201

PCI board

Aeronautic appl icat ionsRadar data process ing

ModularPCI

systems Industrial v is ion

MJPEG

M PE G4

Imaging‘C6211module

’C64ximaging kit

Software road map

JPEG

Q4/00 Q1/01 Q2/01 Q3/01 Q4/01

eXpressDSPSoftware Technology

compliant

C54x C55x C64x

Motion JPEG

Q3/00

Bêta C62x C64x C55x

M PE G4 decodeSimple prof i le

C64x

M PE G2decode

C64x C55x

JPEG 2000

M PE G4 evolut ions

C62x

evolut ions

TI TDK demo plat form

’C6211imaging ki t

C64x

H263decode

Tools

& demo platform

ADC vidéo

ADC vidéo

ADC vidéo

ADC vidéo

Codecaudio

FPGADPRA M

C6211C6401

C6x ser ia l links

Lienssér ie

JTA

G

DAC vidéo

Flash SDRA M

RS422

RS422

32

8

8

MUX

Config & données

Vidéo

Audio (PCM or ADPC M)

Imaging kit : hardware

Alimentat ion

5 V

3.3V 2.5V 1.8V

RS232

SDRA M

8 MB Video RAM

4 channels videoinputs

1 channel video output

1 channel audio input

1 channel audio output

Paral le lbus(mezzanine applica tion)

Seria l link(host control )

Single power supply

Multi-purposes imaging kit for DSPs

Evaluat ion module

For developpers� Stand-alone hardware

� CCS free evaluat ion

� Development software kit

� xDAIS algorithms (evaluat ion version : ATE ME and other 3Ps)

� CCS option

� Algorithms mono- licence

Applicat ion systems

For OEMs� Mezzanine hardware

� CCS free evaluat ion

� Development software ki t

� xDAIS algorithms(evaluat ion version)

� CCS option

� Algorithms l icences

� On requestsoftware

� On request mother board

End-user products

For end-user� In-box product

� Video security

� Web

� Vision

� Video transmiss ion

� ...

� Hardware : audio/video module as s tand-alone product or mezzanine board

� Software : s tandards audio and video a lgor ithms & development tools

An imaging platform for every customer

Complete HW & SW kit

www.ateme.com

� ATEME presenta tion

� Imaging

� Algor ithms

� Roadmap

� Conclusion

Agenda

Imaging on ‘C64x & ‘C55x

MPEG4 on ‘C64x

JPEG & MJPEG on ‘C55x

MPEG2 on ‘C64x

JPEG 2000 on ‘C64x

. . .Hardware

Software

eXpressDSPSoftwareTechnology

Our ambi tion is to develop imaging on DSP market

Imaging is for now. But where isthe solut ion ?

Hello , I am from ATE ME. I can propose you :� Hardware and Software

� Specif ic des igns

� JPEG, H263, MPEG4, …