Slide 1 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]a passion for technology

Date:

Reference:

Author(s):

Distribution:

Attendees marked with *

Template PN: 6001-1246-5509

Prodrive Robotics Solutions

P18051713561 – DMVC Robotics and Vision

Thomas Woudsma

-

2018-05-17

Machine vision for accurate detection and inspection in robotic factory automation

Slide 2 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

https://www.youtube.com/watch?v=fwNtFkFae84

Slide 3 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Slide 4 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Air quality sensorsSmart thermostatAsset management module

Linear actuators Component alignment sensor Automotive ECU

Slide 5 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Slide 6 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

PCB

PCB Assembly

Through-hole components

SMD components

Plastics

Final product

Also testing, inspection, packaging

Inbound Logistics

Component PickingProduct Assembly

AGV

Injection Moulding

Slide 7 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

- Component Detection:- Scattered components

- Ordered components

- Sealant Inspection

Slide 8 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

CONTROL CABINET

2B 1B

Filled trays

Empty trays

Components

1A

3B

ComponentFeeder

FOV

Q

Slide 9 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Automated Assembly Line

Slide 10 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

• Using Template Matching1. Crop template from image

2. Shift template over image

3. Calculate cross correlation

4. Apply threshold on cross correlations

• Speed optimization• Generate candidates

• Obstructions?• Background matching

• Chamfer matching

Slide 12 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Robot cell top view

Component tape reels

Slide 13 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Robustly detect position, size and height of 3D component tapes using a stereo camera.

Component tapes Point cloud from stereo camera Tape position, size and height

Slide 14 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Detect defects in sealant path (discontinuities/ misplacement)

Sealant Contour Sealant Width Sealant Path

Slide 15 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Sealant path from:

- Background subtraction, filtering & thresholding

- Watershed

Result:

- Segmentation + boundaries from CAD

Reference image Sealant image Segmentation

Boundaries (CAD)

Result

Slide 16 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

- Sub-pixel accurate component detection - Model-guided detections

- FOV 600mmx400mm

- Overcome perspectivedistortions

- Anomaly detection with Deep Learning

- Label inspection and verification

- Looking for People with Technology in their Veins!

Slide 18 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Slide 19 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

Generic Automation Solutions with MV for:

• Component detection for assembly and bin picking• Support for many scattered and ordered components

• 3D stereo vision for tape detection

• Sealant inspection• Model-driven, high sensitivity

• First big milestones towards Lights-Out Factory!• Automated assembly (MV detection & inspection)

• Injection Moulding + PCBA

• AGV

Slide 20 of [22]

Reference: [P18051713561 – DMVC Robotics and Vision]

a passion for technology

Prodrive Technologies

T +31 40 2676200

E contact@prodrive-technologies.com

I www.prodrive-technologies.com