ECE 477 Final Presentation ECE 477 Final Presentation Group 11 Group 11 Fall 2005 Fall 2005

Chad Jeff MelMaruf

OutlineOutline

• Project overviewProject overview• Block diagramBlock diagram• Professional componentsProfessional components• Design componentsDesign components• Success criteria demonstrationsSuccess criteria demonstrations• Individual contributionsIndividual contributions• Project summaryProject summary• Questions / discussionQuestions / discussion

Project OverviewProject Overview

• Objective: Design and prototype a device to Objective: Design and prototype a device to improve the safety and alertness of a driver.improve the safety and alertness of a driver.

• This device should:This device should:– Determine if the driver is leaving the lane.Determine if the driver is leaving the lane.– Detect obstacles in the road ahead.Detect obstacles in the road ahead.– Watch for patterns indicating unsafe Watch for patterns indicating unsafe

driving.driving.– Appropriately warn the driver if Appropriately warn the driver if

any of the above occur.any of the above occur.

Block DiagramBlock Diagram

Professional ComponentsProfessional Components

• Constraint analysis and component selection Constraint analysis and component selection rationalerationale

• Patent liability analysisPatent liability analysis• Reliability and safety analysisReliability and safety analysis• Ethical and environmental impact analysisEthical and environmental impact analysis

Design ConstraintsDesign Constraints

Microcontroller

Video Support, DSP chip, Packaging, Development Tools

Camera

Sensor Type (CCD), Output Type (NTSC), Resolution (240+ lines), Input Voltage (<12 V), Size (Small)

Clover CM720

Analog BF532

Patent Liability AnalysisPatent Liability Analysis

Commercial products:Commercial products:• Iteris Iteris

– AutoVue™ system AutoVue™ system – Infinity FX (2005) and Infinity M45(2006)Infinity FX (2005) and Infinity M45(2006)

• Valeo Valeo – LaneVue™LaneVue™

• Citroen Citroen – Uses 9 infrared sensorsUses 9 infrared sensors

• Mitsubishi electricMitsubishi electric

Patent Liability AnalysisPatent Liability Analysis

USPTO patents:USPTO patents:Patent No Title Date Filed

6,553,130 Motor vehicle warning and control system and method

June 28, 1996

6,678,394 Obstacle detection system January 13, 2004

6,930,593 Lane tracking system employing redundant image sensing devices

August 16, 2005

6,819,779 Lane detection system and apparatus November 16, 2004

6,813,370 Lane marker recognizing apparatus November 2, 2004

6,748,302 Lane tracking control system for vehicle June 8, 2004

Our device infringes on these patentsunder the doctrine of equivalents.

Reliability/Safety AnalysisReliability/Safety Analysis

• Analysis for 10^6 operational hoursAnalysis for 10^6 operational hours

Parts MTTF

Microprocessor – ADSP-BF532

151,149 hours

Voltage Regulator – FDS9431A

86,374 hours

ADC – TVP5146 135,501 hours

PLD – ATF22V10C2 3.039 X 10^6 hours

SDRAM – MT48LC4M16/SO 9.85 X 10^5 hours

• Criticality LevelsCriticality Levels High - A system failure that is undetectable High - A system failure that is undetectable

by the userby the user Unstable voltage supplyUnstable voltage supply Image corruptionImage corruption False outputFalse output

Low - A system failure that could be readily Low - A system failure that could be readily identified.identified.

EEPROMEEPROM 3.3V supply3.3V supply

Reliability/Safety AnalysisReliability/Safety Analysis

Ethical/Environmental AnalysisEthical/Environmental Analysis• Ethical ChallengesEthical Challenges

• Develop a safe testing strategy.Develop a safe testing strategy.• User over-reliance on the device.User over-reliance on the device.• Tamper-resistant packaging.Tamper-resistant packaging.

• SolutionSolution• Control the test environment.Control the test environment.• Use a three-person-test method.Use a three-person-test method.• Clearly mark the package with warning Clearly mark the package with warning

labelslabels• Warn about over-reliance.Warn about over-reliance.• Warn about tampering with Warn about tampering with

the package.the package.

Ethical/Environmental AnalysisEthical/Environmental Analysis

• Environmental ImpactEnvironmental Impact - Manufacture - Manufacture - Normal usage- Normal usage - Disposal/Recycling- Disposal/Recycling• Solution Solution - Unavoidable impacts due to PCB manufacturing- Unavoidable impacts due to PCB manufacturing - Use minimal layers and more copper planes over - Use minimal layers and more copper planes over lone traceslone traces - Recycling/Disposal- Recycling/Disposal - Provide a list of certified e-waste - Provide a list of certified e-waste recyclers recyclers

Design ComponentsDesign Components

• Packaging design considerationsPackaging design considerations• Schematic design considerationsSchematic design considerations• PCB layout design considerationsPCB layout design considerations• Software design considerationsSoftware design considerations

Packaging DesignPackaging Design

Power onIndicator

LED Array

Buzzer

Front View – LEDs

PWR

Side View – External Connectors Power Cord

Camera Power Supply

Camera Video Input

Packaging DesignPackaging Design

Power Jack

Camera Mounting Mechanism

Camera

Clamp for Camera

Red level line

Packaging DesignPackaging Design

Front View

LED Array

Power LED

Rear View

Camera Video input

Camera Power SupplyBuzzer

Top View

Schematic DesignSchematic Design

Schematic DesignSchematic Design

Fix:

Changed from power to ground

Schematic DesignSchematic Design

Fix:

Changed from C channel to Y channel

Fix:

Used oscillator instead of crystal

Schematic DesignSchematic Design

Added a new LDO to drop from 12 Volt to 5 Volt

PCB Layout DesignPCB Layout Design

Software DesignSoftware Design

Initialization

•I2C (Video In signal to ADC)

•PLL, PPI, GPIO, SDRAM, DMA

Find Obstacle

Preprocess image

Perform Cross Correlation

Set Output

Find Vehicle Position

Interrupt Service Routine

Success Criteria DemonstrationsSuccess Criteria Demonstrations

1.1. Ability to capture a series of real image Ability to capture a series of real image video - video - demodemo

2.2. Ability to determine lateral position of car Ability to determine lateral position of car within lane - within lane - demodemo

3.3. Ability to detect drift from lane - Ability to detect drift from lane - demodemo

4.4. Ability to detect intrusion of other Ability to detect intrusion of other vehicle/hazard/obstacle in lane - vehicle/hazard/obstacle in lane - demodemo

5.5. Ability to detect an impaired driving Ability to detect an impaired driving behavior- behavior- demodemo

Individual ContributionsIndividual Contributions

• Team Leader – Chad AeschlimanTeam Leader – Chad Aeschliman• Team Member 2 – Jeffery LeeTeam Member 2 – Jeffery Lee• Team Member 3 – Golam MarufTeam Member 3 – Golam Maruf• Team Member 4 – Ying Mei Tan Team Member 4 – Ying Mei Tan

Team Leader – Chad AeschlimanTeam Leader – Chad Aeschliman

• HardwareHardware– Tested components Tested components

• SoftwareSoftware– InitializationInitialization– I2C driverI2C driver– Main interrupt routineMain interrupt routine– Algorithms for vehicle position and obstacle Algorithms for vehicle position and obstacle

detectiondetection– DebuggingDebugging

• DocumentationDocumentation– Design constraintsDesign constraints– Software narrativeSoftware narrative

Member 2 – Jeffery LeeMember 2 – Jeffery Lee

• Hardware Hardware

Schematic and Circuit DesignSchematic and Circuit Design

PCB Layout Preliminary and Final PCB Layout Preliminary and Final DesignDesign

Most of the hands-on hardware work.Most of the hands-on hardware work.

100% of all soldering and fly-wiring.100% of all soldering and fly-wiring.• Documentation Documentation

– Ethical and Environmental AnalysisEthical and Environmental Analysis– OrCad and Schematic DocumentationOrCad and Schematic Documentation

Member 3 – Golam MarufMember 3 – Golam Maruf

• HardwareHardware

- LED and Audio output- LED and Audio output

- Packaging- Packaging• SoftwareSoftware

- Interrupt service routines- Interrupt service routines

- Software testing- Software testing• DocumentationDocumentation

- Schematic- Schematic

- Reliability & Safety Analysis- Reliability & Safety Analysis

- User Manual- User Manual

Member 4 – Ying Mei TanMember 4 – Ying Mei Tan

• HardwareHardware– Packaging Packaging

• SoftwareSoftware– I2C driverI2C driver– Output generatorOutput generator– WebmasterWebmaster

• DocumentationDocumentation– Packaging homeworkPackaging homework– Patent homeworkPatent homework– User ManualUser Manual

Project SummaryProject Summary

• Important lessons learnedImportant lessons learned– TechnicalTechnical

• Image processingImage processing• Embedded system design techniquesEmbedded system design techniques• Soldering techniques Soldering techniques

– Non-TechnicalNon-Technical• Team organizationTeam organization• Professional writingProfessional writing

Project SummaryProject Summary

• Second iteration enhancementsSecond iteration enhancements– Use a Microprocessor with internal FLASH Use a Microprocessor with internal FLASH

and video output capabilities to speed and video output capabilities to speed software developmentsoftware development

– Use Analog video chipUse Analog video chip– Utilize parallel processingUtilize parallel processing– Leave room for heat sinks on LDOsLeave room for heat sinks on LDOs– Add mounting holes to the PCBAdd mounting holes to the PCB

Project SummaryProject Summary

• Additional enhancementsAdditional enhancements– Use extra headers for prototyping.Use extra headers for prototyping.

• Thoughts/ConclusionsThoughts/Conclusions– The serial port is a vital tool for debugging.The serial port is a vital tool for debugging.

Questions / DiscussionQuestions / Discussion