state of the art pixel technology superior circuit design ... · •state of the art pixel...

• State of the art pixel technology

• Superior circuit design

• Flagship stacked sensing

• Unmatched qualitySource: TSR report 2016

This stunning 4K snap was taken by a Sony a7S II mounted to the side of the International Space Station (Copyright: Sony)

Revenue Share

49.5％

#1 Market Share

3 Copyright 2017 Sony Semiconductor Solutions Corporation

Death Tolls Up

• US Traffic Deaths rose 7.2% in 2015– Approximately 35K people died in traffic crashes

• Distracted ~3.5k

• No Seat Belts ~17.5k

• Drunk or Speeding ~12k

• Mortality Rate– US: 1 for every ~90M miles driven

– ROW: 1 for every ~70M miles driven

• Tesla: 1 fatality ~200 Million Miles driven

Source: • US Traffic deaths rose 7.2 percent in 2015: Transportation Dept. Reuters, August 29, 2016• Tesla Motors, Inc. Autopilot miles are soaring, hitting “roughly” 200 Million. Fox Business, Daniel Sparks Sept. 14 2016

Technology has and will continue to save lives!


Challenges to Exceed Human

Visionfor Automotive

Sensing

Limits of sensitivity

Limits of dynamic range

Limits of speed

Limits of distance

Limits of viewing field

Limits of temperature


Human Vision vs Emergency Breaking

ItemHuman

Visibility

Inch Size (35mm)

Pixel Size (Center2.4um)

Pixel Number

/ H-FOV/F#f17mm/F#2(123~150°)

Autobahn / Lane Marker

430mat 10Klx

Highway /Lane Marker

205mat 15lx

Suburbs /Lane Marker

145mat 4lx

City / Pedestrian

37mat 4lx

Car Speed(Dry condition)

－

Senso

rSpec

Day

Nig

ht

NCAP

Human Visibility

Reflectivity / Contrast Sensitivity / ResolutionLane Marker： 90[%] / 40[%] / 75 [mm/pixel]Pedestrian： 6[%] / 90[%] / 30 [mm/pixel]Traffic Sign： 90[%] / 90[%] / 15 [mm/pixel]

EmergencyBrakes

－

－

－

510m at180km/h

250m at130km/h

174m at110km/h

49m at60km/h

21m at60km/h


Pushing the Envelop of Human Vision

Human Visibility Human Visibility*1.2

Reflectivity / Contrast Sensitivity / ResolutionLane Marker： 90[%] / 40[%] / 75 [mm/pixel]Pedestrian： 6[%] / 90[%] / 30 [mm/pixel]Traffic Sign： 90[%] / 90[%] / 15 [mm/pixel] SONY IS = Human Visibility*1.2


51

6m

24

6m

17

4m

44

m

Au

tobah

n1

80

km

/h

Nig

ht/

Ped

estria

n

Nig

ht/

Lan

e M

ark

er

Nig

ht/

Lan

e M

ark

er

Day/

Lan

e M

ark

er

Su

bu

rbs

11

0km

/h

Hig

hw

ay

13

0km

/h

City

60

km

/h

ItemEmergency

BrakesHuman

Visibility*1.2

Inch Size － (35mm)

Pixel Size －(Center2.4um

)

Pixel Number/ H-FOV/F#

－f17mm/F#2(123~150°)

Autobahn /Lane Marker

510m at 180km/h

516mat 10klx

Highway /Lane Marker

250m at 130km/h

246mat 15lx

Suburbs /Lane Marker

174m at 110km/h

174mat 4lx

City /Pedestrian

49m at 60km/h

44mat 4lx

Car Speed(Dry condition)

21m at 60km/h

－

Senso

rSpec

Day

Nig

ht

NCAP

(NC

AP

)

Car Visibility(AEB) vs Human Visibility*1.2

Car Visibility(AEB) = Human Visibility*1.2

Dis

tan

ce

[m]

Em

erg

en

cy B

rake

[km

/h

]


Beyond Human Vision

High res automotive sensor

26m/3lux

65m

High res automotive sensor


High temperature stability

Ultra-low dark current needed for stable image quality across wide temperature range

Sensor temp. : 34.6℃ Sensor temp. : 106℃

Room temperature High temperature

Sensor Temp

Sensor Temp

Lower is better

0

1

2

3

4

5

6

20 30 40 50 60 70 80

Illu

min

ance

(lu

x)

Junction Temperature (⁰C)

SNR5Sony Pixel "G" Sony Pixel "C"

Conventional Pixel "G" Conventional Pixel "C"


Not all pixels created equal

Highest sensitivity delivered at lowest floor noise enables image capture even under starlight condition


Extreme Low Light Sensitivity

Automotive Business DivisionJune 28, 2018

Video


Achieving High Dynamic Range in ERS IS


• Multi Exposure

• Recombination and linearization

Long Exposure (T1) Medium Exposure (T2) Short Exposure (T3)

Disadvantage: Motion Artifact• Requires compensation in the areas of motion• Results in lower dynamic range

𝑫𝒚𝒏𝒂𝒎𝒊𝒄 𝑹𝒂𝒏𝒈𝒆 = 𝟐𝟎 ∗ 𝒍𝒐𝒈𝟏𝟎(𝑻𝟏

𝑻𝟑∗𝑷𝒊𝒙𝒆𝒍 𝑺𝒂𝒕𝒖𝒓𝒂𝒕𝒊𝒐𝒏

𝑺𝑵𝑹𝟏)

SNR1: Illuminance at which S/N ratio = 1X


Capturing Pulsed LED light: LED Flicker


Source:http://internetvideomag.com/en/open-news:390422


ERS HDR revisited: LFM Mode


Long Exposure (T1) Medium Exposure (T2) Short Exposure (T3)

𝑫𝒚𝒏𝒂𝒎𝒊𝒄 𝑹𝒂𝒏𝒈𝒆 = 𝟐𝟎 ∗ 𝒍𝒐𝒈𝟏𝟎(𝑻𝟏

𝑻𝟑∗𝑷𝒊𝒙𝒆𝒍 𝑺𝒂𝒕𝒖𝒓𝒂𝒕𝒊𝒐𝒏

𝑺𝑵𝑹𝟏)

Disadvantage: HDR suffers in LFM modeLED against a bright background saturated scene

Saturated or missedMissed

Pulsed LED

≥90Hz, PWM

Super Long Exposure


LED Flicker video


https://www.youtube.com/watch?v=Y6pIjUvRAjY


IMX390 Addresses LED Flicker and HDR


Simultaneous LED flicker mitigation and HDR video


Addressing LED Flicker and HDR

New Conventional

IMX390 can capture LED and HDR simultaneously while delivering highest low light sensitivity at lowest noise across all temperatures


Summary• Human vision is not enough to address AEB requirements

• Sensors needs to be 20% more sensitive than human eye

• Dual 4K camera 32⁰/123⁰ needed to address front sensing requirements

• Low light SNR and thermal stability are the key for addressing the corner cases

Key Takeaways

state of the art pixel technology superior circuit design ... · •state of the art pixel...

Documents