baidu cloud industry quality inspection solution · cloud management (iothub) docker...
TRANSCRIPT
![Page 1: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/1.jpg)
Baidu Inc.
Baidu Cloud Industry Quality Inspection Solution
Lei Nie
2019.3.18
![Page 2: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/2.jpg)
Highest Labor Cost in Complex Cosmetic Defect Inspections
Target product(e.g.)
Human inspections
industrydaily output
current cycle time labor amount avg. labor cost Monthly inspection labor cost % of inspection labor #
3C 2.3 million pcs 19 pcs/person/min 261 7800 RMB 2.03 million RMBfrom 20% to 40% in past 3
yrs.
Previous machine vision automation solution still cannot solve this problem
The complexity and variability of cosmetic defect
The complexity and variability of products’ surface
Limitations of traditional rule-based machine-vision algorithms
![Page 3: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/3.jpg)
Unified Terminal-Cloud Quality Inspection Solution
Human inspectionsIntelligent
Quality Inspection Integrated Machine
Quality Inspection
Box (Embedded Terminal)
Model Store
Model Synchronization
AI model training closed loop
Terminal-Cloud
Cooperative Control
Baidu Industry Quality Inspection Platform(Public Cloud)
Multiple Computation Powers
BIE runtime package
Model Downloads Data Uploading
Industrial Personal
Computer
Application
Application
3C
Iron
Terminal Registration & Configuation
Heterogeneous ModelOptimization
Device Admittance
IntelligentAnnotation
Defection Synthesis
New Defection Discovery
Data Uploading
Image Annotation
Model Training
Model Testing
Model Integration
Model Downloading
Data Communication
Etc..
![Page 4: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/4.jpg)
5 Key Features on Baidu Industry Quality Inspection
Human inspectionsFast Product Line Translation
Over 80% DataLabeling Time
Reduced
Best Performance-Cost
Balance
Intelligent DataAnnotation
DefectionSynthesis for New
Product Line
New Defect Discovery
Discovery Unclassified
Defect
Edge-CloudAssociation
Model and DataCycle
HeterogeneousInference Engine
![Page 5: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/5.jpg)
Intelligent Data Annotation
Input Image Predefined Defected AreaInteractive Segmentation
Annotation : Slow( usually > 50s per object) → Potential Defect Suggestion ( > 80% precision ) Coarse ( approximated polygon) → Automatically Segment Foreground (only 4 corners)
![Page 6: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/6.jpg)
Intelligent Data Annotation- Interactive Segmentation
Interactive Segmentation: class-agnostic semantic segmentation with global context heatmap to acquire high accuracy
Deep Segmentation from Extreme Points
![Page 7: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/7.jpg)
Heterogeneous Inference Engine
1、Multiple Deep Learning Framework
3、Address Pre-Mapping
2、Graph Merging and memory re-using
Anakin- Baidu Heterogeneous Inference Engine
4、 Heterogeneous Assembly Optimized
![Page 8: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/8.jpg)
Intelligent Defection Synthesis
New Product Line Cold Start: Transfer time-consuming labeled data collection (> 3 months) to 30 minutes
Mono Defect-Free Sample
Mono Defect Sample
Poly Defect-Free Sample
Poly Defect Synthesised Sample
Encoding Transformation Decoding
Decision [0,1]
Discriminative Network
![Page 9: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/9.jpg)
Intelligent Defection Synthesis
X G(X) F(G(X)) F(Y)G(F(Y)
Y
![Page 10: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/10.jpg)
New Defection Discovery
Maintenance : Discovery un-classified defect for model optimizationNovel Defect discovery: discover un-predefined defect by modeling defect-free image
Apple iWatch Charger Textured Anomaly Dataset
![Page 11: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/11.jpg)
New Defection Discovery
Normal samples
Anomaly samples
DAE
DAE
Network:⚫ Reconstruction Network: Denoising/Variation AutoEncoder⚫ Discrimination Network: Detect Anomaly SamplesLoss Function:⚫ Encoding Loss: latent variable loss⚫ Content Loss: Ensure the reconstructed image ⚫ Adversarial Loss: Ensure the authenticity of samples generated
![Page 12: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/12.jpg)
Edge Cloud Synchronization
Openedge Remote mqtt
master
Agent
Reload
Engine(docker client)
ModuleStart/Stop
Api
container
Openedge Hubcontainer
container
Openedge_Function
instancepool
Routing Rule
CloudManagement
(iothub)
Docker network:openedge
mqtt
mqtt
grpchttp
mqtt
mqtt/https
function runtime instance
container
1、Hardware and Framework Transparency
3、AI on the Edge Device
2、Edge-Cloud Association
4、Seamless Integration with Industrial Inspection
Baidu Intelligent Edge(BIE) Framework
Developed in the cloud, Run on the
edge
Results upload for a further
analysis
Monitor, Config,
Control
![Page 13: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/13.jpg)
Baidu Cloud ABC Integrated Industrial Inspection
Developed in the cloud, Run on the
edge
Results upload for a further
analysis
Monitor, Config,
Control
High-Performance Industry Inspection Device
Feature Strictly Meet AQL and FP for super-star
ScenarioReplace 100% labor + Computer Center +
Quality Tracing Center
Customer
Digital Industrial Inspection for large
company ( > 200+, 1 millon RMB per
Machine)
High Performance-Cost Industry Inspection
Feature Basically Meet the AQL and FP
ScenarioReplace the Entire- workers(Verification
worker reserved) ,rapidly deployment
Customer
Rapid labor-saving for small incorporation
with sailing and renting
(> 2000, renting for 10,000 per month)
![Page 14: Baidu Cloud Industry Quality Inspection Solution · Cloud Management (iothub) Docker network:openedge mqtt mqtt grpc http mqtt mqtt/https function runtime instance container 1、Hardware](https://reader034.vdocuments.mx/reader034/viewer/2022051913/600478482f62e379d31505b2/html5/thumbnails/14.jpg)