Steve WitowskiVP, Business Aviation Safety

303 770 4276303.770.4276 steve.witowski@prism.aero

Safety Management-Safety ManagementHere We Are…

2

ObservationsObservations Business aviation- 2003 to today

Development has been fascinating• Development has been fascinating• Not regulated- (AC 120-92 in 2006)

I d t h fill d th l t id Industry has filled the regulatory void • Energy and commitment• Very dependent on culture• Very dependent on culture

Development and maturationSt d t l t hi hi h t• Steady struggle to achieve higher competency

• Instances of inconsistent progress

3

BackgroundBackground ARGUS PROS conducts 60-80 business aviation

audits per CYaudits per CY• ARGUS Platinum and IS-BAO• Part 91 and 135 operatorsPart 91 and 135 operators

SMS/ERP is a significant audit component • Follows FAA AC 120-92A or IS-BAO 3 0• Follows FAA AC 120-92A or IS-BAO 3.0

There’s a story hereL t f l bl d t• Large amounts of valuable data

• Trending is possible

4

OpportunityOpportunity• Accept-

• Data has value for SMS development and pmeasurement

Analyze audit results• Analyze audit results• Create a consistent, repeatable model

• Report back to the industry- Safety Promotion• Help operators understand where to look for

trending pitfallstrending pitfalls• Show other interested parties (FAA, EASA, CASA,

military, UN, etc) what’s really going on

5

ResultsResults• Data

• 397 audits from 2008-2013

• Analyze audit results• Model developed with data capture by category and• Model developed with data capture by category and

frequency + count

• Report back to the industry• SMS Audit Results report provided to the entire

aviation industry since 2009aviation industry since 2009• Used by the FAA, EASA, CASA, military, UN, etc

6

2013 Safety Management y gPerformance Report

• Report released here today• Available for download from ARGUS.aero tomorrow• You heard it here first…

7

PRISM TakeawayPRISM Takeaway• It’s our way to provide the aviation industry with

meaningful information derived organicallymeaningful information derived organically

• Reports on PRACTICE and not THEORYp

• In our view it’s a snapshot of the path to…

8

SMS Primer- Four PillarsSMS Primer Four Pillars

Policy:y(Structure)

RiskMgmt

Safety Assurance

Safety Promotion

(C lt )(Culture)

9

Audit Results- Fill the BucketsAudit Results Fill the Buckets

Ri k Safety PromotionPolicy(Structure)

RiskMgmt

Safety Assurance

Safety Promotion

(Culture)

10

The Elements of SMSThe Elements of SMS Safety policy and objectives

1.1 – Management commitment and responsibility1.2 – Safety accountabilities1 3 Appointment of key safety personnel1.3 – Appointment of key safety personnel 1.4 – Coordination of emergency response planning1 5 – SMS Documentation1.5 SMS Documentation

Safety risk management2.1 – Hazard identification2.2 – Risk assessment and mitigation

PRISM Solutions

The Elements of SMS (cont)The Elements of SMS (cont) Safety assurance

3.1 – Safety performance monitoring and measurement

3 2 Th t f h3.2 – The management of change

3.3 – Continuous improvement of the SMS

Safety promotion4.1 – Training and education

4.2 – Safety communication

PRISM Solutions

2013 SMS Audit Findings2013 SMS Audit Findings

13

2013 SMS Audit Findings- Highlights2013 SMS Audit Findings Highlights• Internal Evaluation Program (IEP)- 71%

• Critical uncovers latent deficiencies• Critical- uncovers latent deficiencies• Requires disciplined approach and dedicated people• Example- “IEP should include the identification of the root

f th f it ll dk icause of the non-conformity, as well as a recordkeeping system for all evidence related to the audit, finding, and the corrective action.”

S f t M t T i i 61%• Safety Management Training- 61%• Critical for employee participation• Business aviation still in SMS growth mode• Business aviation still in SMS growth mode• Example- “Continuing education and training should be

provided to the safety manager.”

14

2013 SMS Audit Findings- Highlights2013 SMS Audit Findings Highlights

SMS M l 2%• SMS Manual- 52%• Critical- foundation for processes and activities• Requires disciplined approach and dedicated people• Example- “The SMS manual needs to be reviewed to ensure it

continues to be appropriate.”

• Hazard/Safety Reporting- 45%• Hazard/Safety Reporting- 45%• Critical- information feeds SMS• Demands employee confidence in culture• Example- “Strive to get more reporting activity.”

15

Lessons Learned- SMSLessons Learned SMS• Internal evaluation is hard to do correctly

W th th ff t• Worth the effort• Training is an ongoing requirement

• Formal and/or informal• Formal and/or informal• The SMS manual doesn’t belong on a shelf

• Needs to change with the operationg p• Safety reporting is primarily about attitude

• Company and self culture• Risk assessment is PROACTIVE

• FRAT/GRAT is great but there is more

16

Lessons Learned- SMS (cont.)Lessons Learned SMS (cont.)

• Safety Committee (label) is a body of action• Decision making

• Company manuals need accuracy• Company manuals need accuracy • The SMS “fit”

• A safety policy is a real messagey p y g• Outdated still sends a message

• FRMS is growing just like SMS did• Needs a system integration

17

2013 ERP Audit Findings2013 ERP Audit Findings

18

2013 ERP Audit Findings- Highlights2013 ERP Audit Findings Highlights

• ERP Drills- 15%ERP Drills 15%• Critical- validates and identifies problems • Necessary training

E l O ti d t l t f ll ERP i• Example- Operation needs to complete a full ERP exercise that includes all applicable personnel.

• Next of Kin Notification and Family Assistance- 15%• Have a plan• Use HR if available

E l “D t i th ERP li di• Example- “Document in the ERP a policy regarding employee crisis support.”

19

2013 ERP Audit Findings- Highlights2013 ERP Audit Findings Highlights

• ERP Documentation- 12%ERP Documentation 12%• Critical- Controlled document/plan• Current info

Example Document the plan/equipment for an• Example- Document the plan/equipment for an emergency response center.

• Go-team- 11%• Identify who from the company will be responding on-site• May want some pre-arranged kit

E l “K b d l• Example- “Key go-team members need alternates assigned.”

20

Lessons Learned- ERPLessons Learned ERP

• Commit to ERP Drills• Worth the effort

• Define all plan details in advance• Define all plan details in advance• Use company HR if available• Alternates are likely needed

• The ERP manual must be controlled• Pay attention to “extra” components- soft and hard copy

21

Trend Comparison- SMSTrend Comparison SMS

22

Trend Comparison- ERPTrend Comparison ERP

23

Aggregate (2008-2013)- SMSAggregate (2008 2013) SMS

24

Aggregate (2008-2013)- ERPAggregate (2008 2013) ERP

25

Average per Audit (2008-2013)Average per Audit (2008 2013)

26

Summary TakeawaysSummary Takeaways• SMS is still growing in operations

• Culture• Education/expertise• 2013 results- what happened?

• What is your level of commitment?• What is your level of commitment?• Management involvement/support• Genuine safety practitioner• Training

• Business aviation must get better with IEP• The best and most realistic proactive practice

• ERP improvement has been substantial• Drills deserve your commitment

27

y

Completing ThoughtCompleting Thought…

“If you keep doing what you’re doing If you keep doing what you re doing, you’re going to keep getting what you got.”

Yogi BerraYogi Berra