Minimizing Downtime: Keeping Your Centricity™ Business System HummingAmy Hand – GE Healthcare, PMODavid Banks - GE Healthcare, NPRTPauline Troiano- GE Healthcare, NPRT

CENTRICITY LIVE 2015 April 29- May 2, 2015

Individual Page Use?: No

Are all Uses and Applications Discussed or Referenced in the Proposed Material on Label for the Product?: N/A

Relates to a Major new Product/Services Launch?: No

Includes Product or Service Claims, Features, Benefits or similar information?: No

Contains Competitive or Comparative Claims?: No

Includes Return on investment (ROI), quantifiable cost of ownership, reimbursement, or meaningful use claim or reference?: No

Include References to Market / Segment Share or Market / Segment Leadership?: No

Include identifiable Patient Information / Data?: No

If Customer Names are Used, are Necessary and Appropriate Permissions in Writing and on File?: N/A

Include Customer Testimonials?: No

If any non-GE Stock Images are Used, are Necessary and Appropriate Permissions in Writing and on File?: N/A

Do the Proposed Materials Contain Images of GE Products?: No

Do all Product Images Depict the Device(s) Being Promoted in the Piece?: N/A

This is a Translation of a Previously Approved Piece in Which no Changes Have Been Made?: No

This is a Revision of a Document Previously Approved for Ad / Promo Use?: No

2

3

©2015 General Electric Company – All rights reserved.

The results expressed in this document may not be applicable to a particular site or installation and individual results may vary. This document and its contents are provided to you for informational purposes only and do not constitute a representation, warranty or performance guarantee. GE disclaims liability for any loss, which may arise from reliance on or use of information, contained in this document. All illustrations are provided as fictional examples only. Your product features and configuration may be different than those shown. Information contained herein is proprietary to GE. No part of this publication may be reproduced for any purpose without written permission of GE.

DESCRIPTIONS OF FUTURE FUNCTIONALITY REFLECT CURRENT PRODUCT DIRECTION, ARE FOR INFORMATIONAL PURPOSES ONLY AND DO NOT CONSTITUTE A COMMITMENT TO PROVIDE SPECIFIC FUNCTIONALITY. TIMING AND AVAILABILITY REMAIN AT GE’S DISCRETION AND ARE SUBJECT TO CHANGE AND APPLICABLE REGULATORY CLEARANCE.

GE, the GE Monogram, Centricity, and imagination at work are trademarks of General Electric Company.

All other product names and logos are trademarks or registered trademarks of their respective companies.

General Electric Company, by and through its GE Healthcare division.

Keeping your System Humming

This is a 2 part session to discuss  how to reduce unplanned downtime, and minimize headaches with the help of regular system maintenance. Each part will take a close look at Monitoring and Maintaining, Tuning, Purging and Backups. We encourage you to share your best practices!

 

Part One will focus on the System process including: System monitoring tools, Cache configuration, and system purging recommendations.

Part Two will focus on the Application process including:  Proactive monitoring,  global maintenance,  and optimizing ETM performance.  

5

Monitor and Maintain: System Perspective

6

Maintain Current OS, Cache™, and Application Version

Review supported versions, how frequently to upgrade patches, etc.

Plan cache upgrades 18-24 months

Keep current on patches and support contracts

Speak with support rep on supported versions and check knowledge center for updates

On Going

Maintaining Journal Files

Separate disk/filesystems

Set purge criteria (3-7 days)

Do not move, delete or zip journal files

Switch primary/secondary

Recommended size is 1 or 2G

7

On Going

Performance

Run autogen, review report, make appropriate changes, and then reboot ( VMS )

Run reports on backend for hotspots and/or disk allocation (SAN)

Max user and quotas of the system limits

CIO on filesystems with cache databases and journal files ( AIX ), XFC off (VMS)

Balance write daemon

8

On Going

Fragmentation

Cache: Review with Integrity Check output

Operating System: Index File ( VMS )

Big block extents or pre-allocate cache.dat

GBLOCKCOPY

9

On Going

Review Cache Performance

^GLOSTAT - Cache efficiency

^mgstat - Cache performance monitoring routine

CSTAT queue sizes - External review of cache internal variables

10

On Going

Know Your System History

Performance history

Additional license added

Space growth

Baseline of resource utilization

11

On Going

Monitoring Tools: Centricity Business System Monitor Console (SMC)

Free tool available for clients that pro-actively monitors system level and application level processes

Various methods of alerting

Threshold-driven alerts

Able to monitor Production and Test UCIs

Easy to install, maintain and modify

Enter SR to have SMC installed on your system

12On Going

Cache and System License

%SYS.LICENSE tool

Trending (SMC)

Review parameters (when adding licenses)

13

On Going

Parameters to review when adding licenses

Server

memory configuration

Cache parameters

gmheapGlobal and routine buffers

VMS

# interactive loginsMAXPROCESSCNT (run autogen for other potential parameters)

AIX

maxuproc# of pty devices

15

Purging Your System: System Perspective

Purging Files

%ZIDSPUR Spool File

Clean up: Audit trails, UCIs/namespaces, interfaces, security plus logs, logging (web), error trap, 3rd party temp files, MCA fee schedules, temp globals/backup globals, ADM log files and night job table for unused processes, jobs, Integrity check reports, etc.

16

Daily to Monthly

Operating System Purging

VMS:

Accounting records, security audit logs, operator logs, print spool directory

AIX:

wtmp file, print spool directory, core dumps, mail

17

Monthly

18

System Tuning: System Perspective

System Reboot

Full system reboots are recommended to ensure memory is contiguous

Restarting Cache without a reboot causes memory to become fragmented over time

19

As Needed

Mapping

Check mapping of temp globals to cachetemp in LIVE namespace

20

When Settings Change

Max Sizes

Check database/namespaces

Avoid device/disk full at OS level

Max size for Report Writer database

Set mount at start up

21

On Going

Cache Parameters

Review global and routine buffer sizes

Locktable size

gmheap

W ##class(%SYSTEM.Config.SharedMemoryHeap).RecommendedSize(p)

cachetemp size

at least 2G for max size, expand by 250MB

AIX – ensure filesystem is large enough for max size

22

Monthly or when settings change

23

Back Ups: System Perspective

Back Up Testing and Restores

Review logs daily for errors

Tested through out the year:

New databases are added, verify part of backup

New hardware is added

Backup dependencies have been added or changed

24

Daily, Change to Settings

25

Monitor and Maintain: Application Perspective

Application License

%ZIDLMF – License Management Reporting

%ZIDLMFD - License Cleanup Daemon

26

On Going

Monitor Error Trap

Prevent disk space problems by proactively monitoring for disk errors

Prevent application problems by proactively monitoring for recurring errors

27

Daily

Monitor Night Jobs

Verify that Night Jobs started and completed successfully

Check Status Horolog

28

Daily

Monitor Interfaces

Verify that interfaces are running

Ensure that queues are processing as expected

29

Daily

Monitoring Tools: Centricity Business Proactive MonitoringStandard with Centricity Business v5.1 and higher

Proactively monitor automated processes across the Centricity Business product suite

Manage all monitors from a single workstation

Delivered with more than 30 standard monitors that can be modified to meet your business needs

Generates notifications and alerts based on unique thresholds and SQL based rules

Provides functionality to view alert history

30

On Going

Monitoring Tools: Centricity Business Proactive Monitoring

31

On Going

32

Purging: Application Perspective

Application Globals and Purging

Interfaces

UXERROR,UXLLPLOG,UXRCV,UXSND,ICHARGEX

Days to retain defined in Interface definition

Report Writer

UDQLDEX, UDQLDAT

Output globals from queries

Each query has number of days to retain

33

As Needed

Application Globals and Purging

TES Audit Trail

TVAUDHD,TVAUDIT,TVAUDITEDATA,TVAUDITX,TVAUDITY,TVAUDTY,TVAUDTN

Setting in Dictionary 33021 days to retain

Run purge via F5,A5 in TES

HPA/ADT Audit trail

IAUD,IAUDX

System options/Number of Days to retain Reg/Visit Audit trail

34

As Needed

Application Globals and Purging

Error trap

ZIDETRAP (houses all errors reported)

Only way to purge is to say Y to prompt “Delete errors more than 30 days old? N =>” 

Security Plus

ZSECLOG (security log report)

Manually run purge (F6,A7 in Sec +)

Can also be added to NJ table or Periodic Jobs

35

As Needed

Application Globals and Purging

Patient Confidentiality

AQPTS,AQPTSI

These are the live (AQPTS) and archive (AQPTSI) globals for the Patient Confidentiality module. Data from the live table can be archived to AQPTSI. Data from the AQPTSI global can be purged

BAR Statement Runs

ARSTATE

Dictionary settings in 207

36

As Needed

Application Globals and Purging

EDI Purge

EDIOUT, EDIREF, EDIIN, EDIAPP, EDIXREF, EDITP, EDIQOB, EDIQIB, EDI997, EDIVER, EDIFILE, EDIERR, EDIAPPV

EDI globals for inbound/outbound messages and runs

The number of days to retain EDI data is defined for each Trading Partner in BAR F43/A20

Purging (auto or manual) is done via F43/A30, Action code G

The options under action G are to either Purge Selected Runs (action P) or Enable/Disable Auto Purge (action X).

37

As Needed

Application Globals and Purging

BAR EDI 835 Runs using ARTS

ARTEDI global

This global houses ARTs EDI run info (EDI 835). It is very common for clients to never purge this info because of possible auditing. However, the ability to purge does exist.

The number of days to retain EDI data is defined for each Trading Partner in BAR F43/A20

Purging is done via F43/A2/A3, Action code W

38

As Needed

Application Globals and Purging

HMO Output Production Queue

HMOPRODQ

This global houses HMO Output production queue info. Allows the queuing of HMO member for form letter production and custom coded things like tapes and ID cards.

Purging is available via MCA F15/A6 for both A1 and A2. Both of these purge data from this global.

HMO Enrollment Globals

HMOENAL,HMOENHIS (reporting information)

MCA F15,A2,A16,A32

39

As Needed

Application Globals and Purging

ETM

Routine Purging of Edit Type Tasks

**A/R follow up type tasks (INS FUP, Rej, Self Pay) should be kept as long as ETM notes are needed

Routine Purging of Events

Excellent instructions and documentation in the Centricity Business Documentation Community

GBLOCKCOPY must be run to recover disk space freed up by purge

40

As Needed

41

Tuning: Application Perspective

ETM Views

Ensure SQL logic for views is written optimally

Dictionary 627 - Cache Query: ETM RPT Query Audit Trail Top N Run Times

Displays query views by execution time

Documentation: Tips and Tricks to Maximize the Performance of ETM Views and Queries

https://engage.gehealthcare.com/docs/DOC-35737

42

As Needed

Table Tuning

Helps maximize performance of ETM views and queries

Creates better statistics that can be used by the Cache SQL Optimizer to create a more efficient Query Plan.

In general, Table Tuning (preferably, run over the weekend) is needed:

after a conversion of large data

if there are many new tasks inserted into the Task table

a large number of rows are added or removed from the table

43As Needed

44

Back Ups: Application Perspective

Test Namespace/Backup

Always keep an up to date Test UCI/Namespace

Make changes in Test first and utilize TUS to move changes from primary test to production

When upgrading always keep a prior version test area around for reproducing issues

45

As Needed

Test Environments/Web Servers

Always have an up to date test web server

Never update security patches without first checking for compatibility

Documentation: GE Centricity™ Business Service Packs and Critical Patches: Centricity Business Development Testing

https://engage.gehealthcare.com/docs/DOC-35897

Always apply patches in test first then Production

46

As Needed

Thank You!

Questions?

47