State of the art pixel technology Superior circuit design ... ?· •State of the art pixel technology…

Download State of the art pixel technology Superior circuit design ... ?· •State of the art pixel technology…

Post on 19-Jan-2019

212 views

Category:

Documents

0 download

TRANSCRIPT

State of the art pixel technology

Superior circuit design

Flagship stacked sensing

Unmatched qualitySource: TSR report 2016

This stunning 4K snap was taken by a Sony a7S II mounted to the side of the International Space Station (Copyright: Sony)

Revenue Share

49.5

#1 Market Share

3 Copyright 2017 Sony Semiconductor Solutions Corporation

Death Tolls Up

US Traffic Deaths rose 7.2% in 2015 Approximately 35K people died in traffic crashes

Distracted ~3.5k

No Seat Belts ~17.5k

Drunk or Speeding ~12k

Mortality Rate US: 1 for every ~90M miles driven

ROW: 1 for every ~70M miles driven

Tesla: 1 fatality ~200 Million Miles driven

Source: US Traffic deaths rose 7.2 percent in 2015: Transportation Dept. Reuters, August 29, 2016 Tesla Motors, Inc. Autopilot miles are soaring, hitting roughly 200 Million. Fox Business, Daniel Sparks Sept. 14 2016

Technology has and will continue to save lives!

4 Copyright 2017 Sony Semiconductor Solutions Corporation

Challenges to Exceed Human

Visionfor Automotive

Sensing

Limits of sensitivity

Limits of dynamic range

Limits of speed

Limits of distance

Limits of viewing field

Limits of temperature

5 Copyright 2017 Sony Semiconductor Solutions Corporation

Human Vision vs Emergency Breaking

ItemHuman

Visibility

Inch Size (35mm)

Pixel Size (Center2.4um)

Pixel Number/ H-FOV/F#

f17mm/F#2(123~150)

Autobahn / Lane Marker

430mat 10Klx

Highway /Lane Marker

205mat 15lx

Suburbs /Lane Marker

145mat 4lx

City / Pedestrian

37mat 4lx

Car Speed(Dry condition)

Senso

rSpec

Day

Nig

ht

NCAP

Human Visibility

Reflectivity / Contrast Sensitivity / ResolutionLane Marker 90[%] / 40[%] / 75 [mm/pixel]Pedestrian 6[%] / 90[%] / 30 [mm/pixel]Traffic Sign 90[%] / 90[%] / 15 [mm/pixel]

EmergencyBrakes

510m at180km/h

250m at130km/h

174m at110km/h

49m at60km/h

21m at60km/h

6 Copyright 2017 Sony Semiconductor Solutions Corporation

Pushing the Envelop of Human Vision

Human Visibility Human Visibility*1.2

Reflectivity / Contrast Sensitivity / ResolutionLane Marker 90[%] / 40[%] / 75 [mm/pixel]Pedestrian 6[%] / 90[%] / 30 [mm/pixel]Traffic Sign 90[%] / 90[%] / 15 [mm/pixel] SONY IS = Human Visibility*1.2

7 Copyright 2017 Sony Semiconductor Solutions Corporation

51

6m

24

6m

17

4m

44

m

Au

tobah

n1

80

km

/h

Nig

ht/

Ped

estria

n

Nig

ht/

Lan

e M

ark

er

Nig

ht/

Lan

e M

ark

er

Day/

Lan

e M

ark

er

Su

bu

rbs

11

0km

/h

Hig

hw

ay

13

0km

/h

City

60

km

/h

ItemEmergency

BrakesHuman

Visibility*1.2

Inch Size (35mm)

Pixel Size (Center2.4um

)

Pixel Number/ H-FOV/F#

f17mm/F#2(123~150)

Autobahn /Lane Marker

510m at 180km/h

516mat 10klx

Highway /Lane Marker

250m at 130km/h

246mat 15lx

Suburbs /Lane Marker

174m at 110km/h

174mat 4lx

City /Pedestrian

49m at 60km/h

44mat 4lx

Car Speed(Dry condition)

21m at 60km/h

Senso

rSpec

Day

Nig

ht

NCAP

(NC

AP

)

Car Visibility(AEB) vs Human Visibility*1.2

Car Visibility(AEB) = Human Visibility*1.2

Dis

tan

ce

[m]

Em

erg

en

cy B

rake

[km

/h

]

8 Copyright 2017 Sony Semiconductor Solutions Corporation

Beyond Human Vision

High res automotive sensor

26m/3lux

65m

High res automotive sensor

9 Copyright 2017 Sony Semiconductor Solutions Corporation

High temperature stability

Ultra-low dark current needed for stable image quality across wide temperature range

Sensor temp. : 34.6 Sensor temp. : 106

Room temperature High temperature

Sensor Temp

Sensor Temp

Lower is better

0

1

2

3

4

5

6

20 30 40 50 60 70 80

Illu

min

ance

(lu

x)

Junction Temperature (C)

SNR5Sony Pixel "G" Sony Pixel "C"

Conventional Pixel "G" Conventional Pixel "C"

10 Copyright 2017 Sony Semiconductor Solutions Corporation

Not all pixels created equal

Highest sensitivity delivered at lowest floor noise enables image capture even under starlight condition

11 Copyright 2017 Sony Semiconductor Solutions Corporation

Extreme Low Light Sensitivity

Automotive Business DivisionJune 28, 2018

Video

12 Copyright 2017 Sony Semiconductor Solutions Corporation

Achieving High Dynamic Range in ERS IS

Automotive Business DivisionJune 28, 2018

Multi Exposure

Recombination and linearization

Long Exposure (T1) Medium Exposure (T2) Short Exposure (T3)

Disadvantage: Motion Artifact Requires compensation in the areas of motion Results in lower dynamic range

= (

)

SNR1: Illuminance at which S/N ratio = 1X

13 Copyright 2017 Sony Semiconductor Solutions Corporation

Capturing Pulsed LED light: LED Flicker

Automotive Business DivisionJune 28, 2018

Source:http://internetvideomag.com/en/open-news:390422

14 Copyright 2017 Sony Semiconductor Solutions Corporation

ERS HDR revisited: LFM Mode

Automotive Business DivisionJune 28, 2018

Long Exposure (T1) Medium Exposure (T2) Short Exposure (T3)

= (

)

Disadvantage: HDR suffers in LFM modeLED against a bright background saturated scene

Saturated or missedMissed

Pulsed LED

90Hz, PWM

Super Long Exposure

15 Copyright 2017 Sony Semiconductor Solutions Corporation

LED Flicker video

Automotive Business DivisionJune 28, 2018

https://www.youtube.com/watch?v=Y6pIjUvRAjY

16 Copyright 2017 Sony Semiconductor Solutions Corporation

IMX390 Addresses LED Flicker and HDR

Automotive Business DivisionJune 28, 2018

Simultaneous LED flicker mitigation and HDR video

17 Copyright 2017 Sony Semiconductor Solutions Corporation

Addressing LED Flicker and HDR

New Conventional

IMX390 can capture LED and HDR simultaneously while delivering highest low light sensitivity at lowest noise across all temperatures

18 Copyright 2017 Sony Semiconductor Solutions Corporation

Summary Human vision is not enough to address AEB requirements

Sensors needs to be 20% more sensitive than human eye

Dual 4K camera 32/123 needed to address front sensing requirements

Low light SNR and thermal stability are the key for addressing the corner cases

Key Takeaways

Recommended

View more >