how far can you go with agile for embedded software?
TRANSCRIPT
AT10Session6/9/161:30PM
HowFarCanYouGowithAgileforEmbeddedSoftware?
Presentedby:
AndersWallgren
ElectricCloud
Broughttoyouby:
350CorporateWay,Suite400,OrangePark,FL32073888---268---8770··[email protected]://www.techwell.com/
AndersWallgrenElectricCloudThechieftechnicalofficerofElectricCloud,AndersWallgrenbringswithhimmorethantwentyyearsofin-depthexperiencedesigningandbuildingcommercialsoftware.Previously,hewastheVPofengineeringatAcevaTechnologieswherehewasresponsibleforthereleaseofsevendifferentsoftwaresolutionsproducts.AnderswasalsotheVPofengineeringatImpressewherehemanagedateamofmorethansixtyemployees,includingdatabase,middleware,userinterface,QA,documentation,anddatacenteroperationsteams.OthercompanieswhereAndershasheldexecutiveandmanagementpositionsincludeArchistra,Macromedia(MACR),CommonGroundSoftware,andVerity(VRTY).
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 1
© Electric Cloud | electric-cloud.com | @electriccloud
Agile and Beyond: How Far Can You Go in Embedded Software Development
Anders Wallgren
CTO, Electric Cloud
© Electric Cloud | electric-cloud.com | @electriccloud
Every Business is a Software Business
Embedded/IoT Mobile Enterprise, Web/IT
“Software is eating the world” Marc Andreessen, Aug 2011
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 2
© Electric Cloud | electric-cloud.com | @electriccloud
Software is now the primary driver of
innovation & disruption.
© Electric Cloud | electric-cloud.com | @electriccloud
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 3
© Electric Cloud | electric-cloud.com | @electriccloud
IoT is the New Embedded
Systems Driven Product Development
Multi- Domain Continuous Delivery
Cloud
Industry 4.0
Dev Ops
© Electric Cloud | electric-cloud.com | @electriccloud
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 4
© Electric Cloud | electric-cloud.com | @electriccloud
IoT is Everywhere. How does that change our world?
1. Accessible from anywhere
2. Automatically optimizes for cost/comfort
3. Automatically adjusts based on “presence”
4. Provides individual and aggregate reporting
5. Updates delivered continuously OTA
© Electric Cloud | electric-cloud.com | @electriccloud
What are People Working On?
Types of connected devices respondents say will have the largest market opportunity in five years.
HP online survey of 610 developers and IT, 2015
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 5
© Electric Cloud | electric-cloud.com | @electriccloud
What do Developers think?
Respondents who classify the IoT as "transformative", "important”
HP online survey of 610 developers and IT, 2015
© Electric Cloud | electric-cloud.com | @electriccloud
26B by 2020 Gartner Prediction on the Internet of Things (excluding PCs, tablets, phones)
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 6
© Electric Cloud | electric-cloud.com | @electriccloud
Today’s cars have over 300m lines of code
© Electric Cloud | electric-cloud.com | @electriccloud
Challenges
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 7
© Electric Cloud | electric-cloud.com | @electriccloud
Demand for More Frequent, OTA Updates
© Electric Cloud | electric-cloud.com | @electriccloud
Logistics and Coordination of Different Engineering teams (+Minimizing
Friction)
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 8
© Electric Cloud | electric-cloud.com | @electriccloud
Long and Challenging Integration Test Cycle
© Electric Cloud | electric-cloud.com | @electriccloud
Skyrocketing Infrastructure Costs
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 9
© Electric Cloud | electric-cloud.com | @electriccloud
Continued Focus on Reducing Development Costs and Cost
Overruns
© Electric Cloud | electric-cloud.com | @electriccloud
Visibility and Compliance Concerns
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 10
© Electric Cloud | electric-cloud.com | @electriccloud
Quality Issues
© Electric Cloud | electric-cloud.com | @electriccloud
Customers Want Value. Quickly.
In the age of the consumer, empowered buyers demand a new
level of customer obsession
Amy DeMartine, Forrester
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 11
© Electric Cloud | electric-cloud.com | @electriccloud
Are we there yet?
“Are you able to deliver new software to production as fast as the business demands?”
Based on a 2015 survey of 90+ IT Managers, Directors, Sr. Directors and VPs, Electric Cloud and Forrester Research Survey
No
Yes
?
© Electric Cloud | electric-cloud.com | @electriccloud
A Complex Delivery Pipeline
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 12
© Electric Cloud | electric-cloud.com | @electriccloud
Agile Delivery of IoT Services
Data exchange
Embedded Software (OTA)
Mobile App
Cloud based software
Data Exchange
© Electric Cloud | electric-cloud.com | @electriccloud
Three Applications, one user experience
Embedded Software in the Device Big-data backend app Mobile app for end-user controls
• Different Teams • Different Tools • Different Development Practices • Different Deployment Targets / Stacks
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 13
© Electric Cloud | electric-cloud.com | @electriccloud
Connecting it All
© Electric Cloud | electric-cloud.com | @electriccloud
How Do Others Do It?
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 14
© Electric Cloud | electric-cloud.com | @electriccloud
Shared Goals
Measure-ability
Self-Awareness
Expectations
Can-Do-Culture
Technology
© Electric Cloud | electric-cloud.com | @electriccloud
Automate!
Shrink Cycle Times
Done Means Done
It Worked in Dev…
Build Quality In
Keep Improving
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 15
© Electric Cloud | electric-cloud.com | @electriccloud
Best Practices: • End-to-EndVisibilityandTraceability:
• ConnectandorchestratePLM,ALM,CD,OTAworkflows• IntegratedataofallproductcomponentsintosingleEBOM• Globalteamvisibility
• AcceleratedDelivery:• Removeerror-prone,laborintensivemanualtasksandtransi6onsorhandoffamonghardware,soOware,anddeliveryteams
• ReducingDesign-to-DelivercyclesacrosshardwareandsoOwareteams• Parallelizeandacceleratevarioustasksinelas6cprivate/semi-privatecloud
• PredictableQuality:• TestintegratedsystemsearlierandmoreoOen• Consistentbuild,test,releaseenvironmenttopreventenvironmentalbugs• Acceleratedcomplianceverifica6onandon-demandcompliancereport
© Electric Cloud | electric-cloud.com | @electriccloud
The Bottom Line
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 16
© Electric Cloud | electric-cloud.com | @electriccloud
Who Does DevOps? Our Customers
Networking
Other Systems
ISV, Internet & Entertainment
Heavy Industry
Financial Services
Automotive Medical Devices
Semiconductor
Aerospace / Defense
Mobile Devices
© Electric Cloud | electric-cloud.com | @electriccloud
The Value of DevOps and Continuous Delivery
10X faster TTM
90% higher quality
100%
cross-team visibility
74% reduced costs
75% improved utilization
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 17
© Electric Cloud | electric-cloud.com | @electriccloud
Cisco Transformative Benefits
Challenges • Long delays between releases • Lack of test automation leading to
high number of escaped bugs • Poor resource utilization,
maintenance overhead
Solution • Centralized CD approach • Dynamic creation of workflows
74% better infrastructure
utilization
Accelerated time to market, with
better quality 10X
faster software development
© Electric Cloud | electric-cloud.com | @electriccloud
Qualcomm Transformative Benefits
Challenges • Velocity:
§ 2500+ Developers § WW distribution § 100,000 jobs/day § Complex workflows
Solution § Customized dashboards § Global rollout
Automated Linux/Android environments
Accelerated Chip design and test
ELIMINATED Manual error prone processes
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 18
© Electric Cloud | electric-cloud.com | @electriccloud
GE Energy Transformative Benefits
Challenges • 13 global dev locations, 10-15
teams; 800+ developers • Moving from Waterfall to Agile • Long build times (10-15 hours)
§ 1 build per month § Broken builds § Manual tests took weeks
Solution • Build Acceleration • CI as A Service with integrated
Preflights
Accelerated builds from 11 hours
to
20min
Eliminated
650k hours of lost
productivity per year
Improved Dev Productivity
32X
© Electric Cloud | electric-cloud.com | @electriccloud
Ericsson Transformative Benefits
Challenges • Hyper-competitive markets and
diverse product lines • Over 2500 developers • Poor developer productivity, time
to market, unreliable builds, difficult to maintain
• Poor resource utilization, maintenance overhead
Solution • Centralized CD infrastructure • Deployment as a service
Shared “private cloud” hub for
builds
Better quality, vitibility, resource
utilization, productivity time to market
6X
Faster Builds
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 19
© Electric Cloud | electric-cloud.com | @electriccloud
EMC Transformative Benefits
Challenges • Multi-site (US/China) Multiple OS • 1400 Devs, supported by US Build
and Release Team • Consolidating 3 business units • Adopting Agile • Scheduling slips, lower quality,
higher cost of administration
Solution • Centralized CD infrastructure • Build acceleration
MORE Visibility into consolidated business unit operations
Accelerated time to market, with
better quality
ELIMINATED Jenkins sprawl with centralized
control and more visibility
© Electric Cloud | electric-cloud.com | @electriccloud
Huawei Case Study: An Agile approach to
Continuous Delivery Transformation
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 20
© Electric Cloud | electric-cloud.com | @electriccloud
16 R&D Centers
140+ Countries
14 Regional HQs
28 Joint Innovation
Centers
150K Employees Worldwide
45 Training Centers
33.4%
14.5%
17%
35.1%
Revenue by Geo
China
EMEA
Asia Pacific
Americas
70K R&D Employees
(2012)
© Electric Cloud | electric-cloud.com | @electriccloud
The implementation: CD-DevOps Solution
20 Rockstars
3 Months to V1
>1000 CD Pipelines / Day
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 21
© Electric Cloud | electric-cloud.com | @electriccloud
The Results
• Bridging the gap between Dev and Ops • Multi-layer / multi-platform infrastructure • Devs gaining control over production environment • Concise definition and automation of processes • Globally distributed R&D teams
PROD BUILD
300min Per 10M LOC
DEV BUILD
10min Per 5M LOC
FULL TEST
1440min
REGRESSION TEST
240min
FEATURE DELIVERY TIME
30days (was 30 days)
PROD BUILD
10min Per 10M LOC
(was 300 min)
DEV BUILD
1min Per 5M LOC
(was 10 min)
FULL TEST
360min (was 1440 min)
REGRESSION TEST
60min (was 240 min)
FEATURE DELIVERY TIME
7days (was 30 days)
© Electric Cloud | electric-cloud.com | @electriccloud
What’s “faster?”
Hours to Minutes Compile and Build
Days to Hours Hardware Emulation
Hours to Minutes Code Analysis
Develop Design
Days to Hours Architect Evaluation
Product Validation
Days to Hours Full Regression (System)
Days to Minutes Full Regression (Software)
Weeks to Days Full Functional Testing
Solution Validation
Months to Weeks Solution Testing
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 22
© Electric Cloud | electric-cloud.com | @electriccloud
Agile and Beyond
© Electric Cloud | electric-cloud.com | @electriccloud
Continuous Discussions (#c9d9) An open forum to discuss Agile, DevOps and Continuous Delivery. Join us at electric-cloud.com/c9d9
/ @electriccloud - #c9d9
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 23
© Electric Cloud | electric-cloud.com | @electriccloud
Thank You
© Electric Cloud | electric-cloud.com | @electriccloud
EXTRAS
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 24
© Electric Cloud | electric-cloud.com | @electriccloud
BAD UX DESTROYS VALUE
© Electric Cloud | electric-cloud.com | @electriccloud
Continuous Delivery for Mobile
Ship.io
Build Deploy
1
4
Test
2
3
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 25
© Electric Cloud | electric-cloud.com | @electriccloud
Continuous Delivery for Embedded Devices
PLM Enterprise Application
Change Request
ALM Enterprise Application
Impact Analysis
Project Plan
Technical Spec
Test Plan
ElectricFlow
Code Build/CI Software-in-loop Hardware-in-loop Compliance Release
1
2 33
Binary & Manifest
© Electric Cloud | electric-cloud.com | @electriccloud
OTA Distribution
PLM Enterprise Application
Change Request
ElectricFlow
Extract binary and target list
1 3
Binary & Manifest
2
Initiate OTA process
Update meta data
Upload package
Wait for Success status
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 26
© Electric Cloud | electric-cloud.com | @electriccloud
Continuous Delivery to Data Center ALM Enterprise Application
Change Request
Project Plan
Technical Spec
Test Plan
ElectricFlow
CI Deploy
1
2 3
4
© Electric Cloud | electric-cloud.com | @electriccloud
Continuous Delivery for IoT TeamcenterPLM
ChangeRequest
AryngaOTA
ElectricFlow
Code Build/CI SoOware-in-loop Hardware-in-loop Compliance Release
1 2
Binary&Manifest
ChangeRequest
ElectricFlowProcesspayloadandtargetinforma6on
InvokeArynga GetConfirma6on
3 8
OTASuccessful
CreateReleasePkg
OTASuccessfulBinary&Manifest
ApproveReleasePkg
4 75 6
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 27
© Electric Cloud | electric-cloud.com | @electriccloud
Techniques • End-to-EndVisibilityandTraceability:
• ConnectandorchestratePLM,ALM,CD,OTAworkflows• IntegratedataofallproductcomponentsintosingleEBOM• Globalteamvisibility
• AcceleratedDelivery:• Removeerror-prone,laborintensivemanualtasksandtransi6onsorhandoffamonghardware,soOware,anddeliveryteams
• ReducingDesign-to-DelivercyclesacrosshardwareandsoOwareteams• Parallelizeandacceleratevarioustasksinelas6cprivate/semi-privatecloud
• PredictableQuality:• TestintegratedsystemsearlierandmoreoOen• Consistentbuild,test,releaseenvironmenttopreventenvironmentalbugs• Acceleratedcomplianceverifica6onandon-demandcompliancereport
© Electric Cloud | electric-cloud.com | @electriccloud
Integrated Hardware and Software Development, Test, and Release Processes
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 28
© Electric Cloud | electric-cloud.com | @electriccloud
Integrated Software OTA Update
© Electric Cloud | electric-cloud.com | @electriccloud
Arynga CarSync Architecture
CarSync™:End-End,OTAvehiclesoOware,firmware,anddatamanagementsolu6on.Features:
• HighlyscalableBackendarchitecturebasedontheErlangtechnology,
• BackOfficewithadvancedanduserintui6veGUI,• EasilyportableEmbeddedClient(bothopensourceand
proprietaryversionsavailable)• A-DiffToolforfilebasedOSanddirectFLASHmemory
updates.
• Asbenchmarkedbytheindustry–theA-Difftoolaffordsthefastestclientupdate6meandsmallestmemoryfootprint.
• Modulararchitectureforscalabilityandeasyintegra6onwith3rdpartySWandsystems.
OEM
Data Analytics
CarSync™ In-Vehicle Gateway
ECUs
Infotainment & Telematics Chassis Power Train Safety &
Security
Body & Comfort
CarSync™ Management System
Arynga Differential Tool
Tier 1 (Update)
CarSync™ BackOffice
Arynga Differential Tool
©ElectricCloud|www.electriccloud.comPresenta6ons6tle|Date 29
© Electric Cloud | electric-cloud.com | @electriccloud
PLM + ALM + CD = Multi Domain Continuous Delivery
© Electric Cloud | electric-cloud.com | @electriccloud
Global Team Coordination
Before:
• Redundant low utilization infrastructure for each team
• Multiple admins
• Inconsistent infrastructure
• No one can see the whole system
• Very hard to troubleshoot issues
• Lack of visibility to many different projects and groups
UsersinregionA
UsersinregionB
UsersinregionC
UsersinregionD
Highavailable,horizontalscalablecloudresourcemanager
ConsolidateddashboardsforAllprojectsfromdifferentregions
Compu6ngresourcesasprivatecloudaccessiblefromallregions
After:
• Less hardware BUT much higher utilization
• Consistent tool chain, configuration, and environment
• Centralized views to all projects in different regions
• Drill down views to accelerate troubleshooting
• Fast issues detection and resolution
• Divert human resources from managing manual process to R&D
• Authentication and Authorization for global Intellectual Property protection