monitoring and alerting - vmware validated design 4 · after you deploy the software-defined data...

Monitoring and Alerting19 SEP 2017VMware Validated Design 4.1VMware Validated Design for Software-Defined DataCenter 4.1

Monitoring and Alerting

VMware, Inc. 2

You can find the most up-to-date technical documentation on the VMware website at:

https://docs.vmware.com/

If you have comments about this documentation, submit your feedback to

[email protected]

Copyright © 2016–2017 VMware, Inc. All rights reserved. Copyright and trademark information.

VMware, Inc.3401 Hillview Ave.Palo Alto, CA 94304www.vmware.com

https://docs.vmware.com/

mailto:[email protected]

http://pubs.vmware.com/copyright-trademark.html

Contents

About VMware Validated Design Monitoring and Alerting 4

1 Enabling Alerts in vRealize Log Insight 5

View the Full List of Alerts for a Management Product 6

Enable the Alerts for vSphere Resources 7

Enable the Alerts for Storage Resources 9

Enable the Alerts for vSAN 12

Enable the Alerts for vSphere Networking 14

Enable the Alerts for NSX for vSphere 16

Enable the Alerts for vRealize Operations Manager 18

Enable the Alerts for vRealize Automation 19

Enable the Alerts for Microsoft SQL Server for vRealize Automation 22

2 Creating Custom SDDC vRealize Operations Dashboards 25

SDDC Capacity Overview Dashboard 25

Configure a Dashboard that Provides an Overview of SDDC Operation 28

3 Configure vRealize Operations Manager to Notify of SDDC Issues 40

Create Notifications in vRealize Operations Manager 40

List of Notifications for vRealize Operations Manager 41

4 Monitor vSphere Data Protection Jobs by Email 46

5 Configure vRealize Automation System Notification Events 48

VMware, Inc. 3

About VMware Validated DesignMonitoring and Alerting

VMware Validated Design Monitoring and Alerting provides step-by-step instructions about configuringvRealize Operations Manager and vRealize Log Insight for monitoring of the operations in the SDDC.This documentation also discusses enabling notifications about issues in your environment and operatinga software-defined data center (SDDC) based on the VMware Validated Design™ for Software-DefinedData Center.

After you deploy the Software-Defined Data Center from this VMware Validated Design, you can monitorthe parameters that are most important for environment management by using a set of dashboards foralerts and log events.

Intended AudienceThe VMware Validated Design Monitoring and Alerting documentation is intended for cloud architects,infrastructure administrators, cloud administrators and cloud operators who are familiar with and want touse VMware software to deploy in a short time and manage an SDDC that meets the requirements forcapacity, scalability, backup and restore, and extensibility for disaster recovery support.

Required VMware SoftwareVMware Validated Design Monitoring and Alerting is compliant and validated with certain productversions. See VMware Validated Design Release Notes for more information about supported productversions.

VMware, Inc. 4

Enabling Alerts in vRealize LogInsight 1Use the vRealize Log Insight known event signature engine to monitor key events. You can use a set ofalerts to send to vRealize Operations Manager and via SMTP for operations team notification.

The integration between vRealize Log Insight and vRealize Operations Manager allows for implementingthe following cross-product event tracking:

n Sending alerts from vRealize Log Insight to vRealize Operations Manager, which automatically mapsthem to the target objects

n Launching in context from a vRealize Operations Manager object to the objects logs in vRealize LogInsight

n Launching in context from a vRealize Log Insight event to the objects in vRealize OperationsManager

For applications that are failed over between regions, such as vRealize Automation and vRealizeOperations Manager, configure alerting in both regions to avoid missing any alerts when applicationsmove between regions.

Procedure

1 View the Full List of Alerts for a Management Product

Explore the alerts and queries that are available in vRealize Log Insight for the managementproducts in the SDDC such as vSphere, NSX for vSphere, vRealize Automation, and so on. Thealerts and queries are handled by the content packs for these products.

2 Enable the Alerts for vSphere Resources

Use the built-in problem and alert signatures in vRealize Log Insight for ESXi host and vCenterServer to enable alerts about issues in these components and map these alerts to the vRealizeOperations Manager inventory. For each alert, you create one instance for the management datacenter and one instance for the shared edge and compute data center.

3 Enable the Alerts for Storage Resources

Use the built-in problem and alert signatures in vRealize Log Insight to create alerts about storageand map these alerts to the vRealize Operations Manager inventory. For each alert, you create oneinstance for the management data center and one instance for the shared edge and compute datacenter.

VMware, Inc. 5

4 Enable the Alerts for vSAN

Use the built-in problem and alert signatures in vRealize Log Insight to create alerts for vSANmonitoring and map them to the vRealize Operations Manager inventory. For each alert, you createone instance for the management data center in each region. This validated design uses vSAN onlyfor the SDDC management components. If you use vSAN also for your tenant workloads, configurealerts accordingly.

5 Enable the Alerts for vSphere Networking

Use the in-built problem and alert signatures in vRealize Log Insight to create alerts for network-related events and map them to the vRealize Operations Manager inventory. For each alert, youcreate one instance for the management data center and one instance for the shared edge andcompute data center.

6 Enable the Alerts for NSX for vSphere

Create alerts using the in-built problem and alert signatures in vRealize Log Insight for NSX forvSphere and direct them to the vRealize Operations Manager inventory. For each alert, you createone instance for the NSX Manager for the management cluster and one instance for the NSXManager for the shared edge and compute cluster in the region.

7 Enable the Alerts for vRealize Operations Manager

Use the built-in problem and alert signatures in vRealize Log Insight for vRealize OperationsManager. You create one instance of each alert in Region A and in Region B because the vRealizeOperations Manager instance in the SDDC works in the context of both management and computeresources in each region. The SDDC also contains one analytics cluster that is failed over to RegionB and you receive alerts only about it.

8 Enable the Alerts for vRealize Automation

Use the in-built problem and alert signatures in vRealize Log Insight for vRealize Automation. Youcreate one instance of each alert in Region A and in Region B because the vRealize Automationinstance in the SDDC works in the context of the compute resources in each region. Theenvironment also contains one vRealize Automation deployment that is failed over to Region B andyou receive alerts only about it.

9 Enable the Alerts for Microsoft SQL Server for vRealize Automation

Use the inbuilt problem and alert signatures in vRealize Log Insight for the Microsoft SQL Server forvRealize Automation. For each alert, you create one instance for each region so that alerts are stillavailable if the Microsoft SQL Server instance is failed over to Region B.

View the Full List of Alerts for a Management ProductExplore the alerts and queries that are available in vRealize Log Insight for the management products inthe SDDC such as vSphere, NSX for vSphere, vRealize Automation, and so on. The alerts and queriesare handled by the content packs for these products.


VMware, Inc. 6

Procedure

1 Open the vRealize Log Insight user interface.

a Open a Web browser and go to the following URL.

Region vRealize Log Insight URL

Region A https://sfo01vrli01.sfo01.rainpole.local

Region B https://lax01vrli01.lax01.rainpole.local

b Log in using the following credentials.

Setting Value

User name admin

Password vrli_admin_password

2 Locate the content pack for the management product.

a In the vRealize Log Insight user interface, click the configuration drop-down menu icon andselect Content Packs.

b Under Installed Content Packs, select any content pack.

c Click Alerts or Queries tab to view the full list of alerts or queries for the product.

Enable the Alerts for vSphere ResourcesUse the built-in problem and alert signatures in vRealize Log Insight for ESXi host and vCenter Server toenable alerts about issues in these components and map these alerts to the vRealize OperationsManager inventory. For each alert, you create one instance for the management data center and oneinstance for the shared edge and compute data center.

For basic monitoring the vSphere components, use the following alerts:

Table 1‑1. vSphere Alerts in vRealize Log Insight

Alert Name Purpose Severity

*** CRITICAL ***Hardware: Physicalevent detected

The purpose of this widget is to notify when the following physical hardware events have beendetected, which indicates a hardware problem. Under most normal conditions, this widgetshould return no results. The following types of hardware events are returnedn Advanced Programmable Interrupt Controller (APIC)n Machine Check Exception (MCE)n Non-Maskable Interrupt (NMI)

Critical

Hardware: Faultymemory detected

During the previous boot of an ESXi host faulty memory was detected. Unless a correspondingcorrected message is seen, the memory should be replaced.

Critical

*** CRITICAL ***ESXi: Core dumpdetected

A core dump has been detected, which indicates the failure of a component in ESXi. This issuemay lead to VM crashes and/or host PSODs.

Critical


VMware, Inc. 7

Table 1‑1. vSphere Alerts in vRealize Log Insight (Continued)


*** CRITICAL ***ESXi: Stoppedlogging

The purpose of this alert is to notify when an ESXi host has stopped sending syslog to aremote server.

Critical

*** CRITICAL ***ESXi: RAM disk /inode table is full

A root file system has reached its resource pool limit. Various administrative actions depend onthe ability to write files to various parts of the root file system and might fail if the RAM diskand/or inode table is full.

Critical

ESXi: HA isolatedevents by hostname

During a health check, HA determined that a host was isolated. Depending on how HA isconfigured this may mean that VMs have been failed over from the isolated host.

Critical

vCenter Server: HAconnection failuredetected

A HA cluster has detected one or more unresponsive ESXi hosts. If the host(s) are marked asdead then VMs running on those hosts will be migrated to other systems.

Critical

Procedure







Setting Value

User name admin


2 In the vRealize Log Insight user interface, click Interactive Analytics.

3 Click the icon and select Manage Alerts.

4 Select an alert that is related to vSphere resources.

a In the search box of the Alerts dialog box, enter the following alert name as a search phrase.

*** CRITICAL *** ESXi: Core dump detected

b Select the alert from the search result and click the Edit icon next to the alert name.


VMware, Inc. 8

5 Create an instance of the alert for each data center in Region A.

a In the New Alert dialog box, click Run Query.

A query editor page opens.

b Click Add Filter and use the drop-down menus to define the following filter.

FilterValue for Management vSphereAlerts in Region A Value for Compute vSphere Alerts in Region A

Object type vmw_datacenter vmw_datacenter

Operation contains contains

Object sfo01-m01dc sfo01-w01dc

c Click the icon and select Create Alert from Query.

d In the New Alert dialog box, configure the following alert settings and click Save.

SettingValue for Management vSphere Alerts inRegion A

Value for Compute vSphere Alerts inRegion A

Name *** CRITICAL *** ESXi: Core dumpdetected (sfo01-m01dc)

*** CRITICAL *** ESXi: Core dumpdetected (sfo01-w01dc)

Description(Recommendation)

vsphere_alert_purpose

See Table 1‑1.

vsphere_alert_purpose

See Table 1‑1.

Email Email address to send alerts to Email address to send alerts to

Send to vRealize OperationsManager

Selected Selected

Fallback Object sfo01-m01dc sfo01-w01dc

Criticality critical critical

Raise an alert On any match On any match

e Repeat the steps to create the alert instance for the other data center in Region A.

6 Repeat Step 3 to Step 5 for the rest of the alerts, configuring two instances of each alert in Region A:for the sfo01-m01dc and sfo01-w01dc data centers.

7 Repeat the procedure in vRealize Log Insight in Region Bhttps://lax01vrli01.lax01.rainpole.local to create the alerts for both lax01-m01dc andlax01-w01dc data centers.

Enable the Alerts for Storage ResourcesUse the built-in problem and alert signatures in vRealize Log Insight to create alerts about storage andmap these alerts to the vRealize Operations Manager inventory. For each alert, you create one instancefor the management data center and one instance for the shared edge and compute data center.

For monitoring storage in the Software-Defined Data Center, you can use the following alerts in vRealizeLog Insight:


VMware, Inc. 9

Table 1‑2. Storage Alerts in vRealize Log Insight


*** CRITICAL ***Storage: AllPaths Down(APD)

One or more datastores has experienced an All Paths Down (APD) outage situation. Thisindicates that one or more datastores is or was unavailable. As a result of this issue, VMs are orwere unavailable and ESXi hosts may have been disconnected from vCenter Server. This issuerequires immediate attention.

Critical

*** CRITICAL ***Storage: VSANdevice offline

A Virtual SAN storage device that backs up the datastores might fail.This occurs due to a faultydevice firmware, physical media, or storage controller or when certain storage devices are notreadable or writeable.

Typically, such failures are irreversible. In some instances, permanent data loss might also occur,especially when data is not replicated on other nodes before failure. Virtual SAN automaticallyrecovers data when new devices are added to the storage cluster, unless data lost is permanent.

Critical

Storage: NFSconnectivity issue

The purpose of this alert is to notify when an NFS connectivity issue was detected. This means anNFS datastore is or was unavailable. Do to this issue, one or more VMs may be unavailable.

Critical

Storage: NFSlock file issue

The purpose of this alert is to notify when an NFS lock file issue has been detected. Stale NFSlock files can prevent VMs from powering on.

Critical

Storage SCSIPath dead

The purpose of this alert is to notify when a SCSI path has become unavailable. Assumingmultiple paths are in use and the other paths are online this means reduced redundancy andperformance. If all paths to a storage device become unavailable then VMs running on the storagedevice will become unavailable.

Critical

Storage:Snapshotconsolidationrequired

The purpose of this alert is to notify when a snapshot consolidation is required. A failed snapshotconsolidation operation that is not manually addressed can lead to a full datastore.

Critical

Procedure







Setting Value

User name admin





VMware, Inc. 10

4 Select the alerts that are related to storage.


*** CRITICAL *** Storage: All Paths Down (APD)






FilterValue for Management StorageAlerts in Region A Value for Compute Storage Alerts in Region A






SettingValue for Management Storage Alert inRegion A

Value for Compute Storage Alert inRegion A

Name *** CRITICAL *** Storage: All Paths Down(APD) (sfo01-m01dc)

*** CRITICAL *** Storage: All Paths Down(APD) (sfo01-w01dc)


storage_alert_purpose

See Table 1‑2.

storage_alert_purpose

See Table 1‑2.



Selected Selected








VMware, Inc. 11

Enable the Alerts for vSANUse the built-in problem and alert signatures in vRealize Log Insight to create alerts for vSAN monitoringand map them to the vRealize Operations Manager inventory. For each alert, you create one instance forthe management data center in each region. This validated design uses vSAN only for the SDDCmanagement components. If you use vSAN also for your tenant workloads, configure alerts accordingly.

For monitoring vSAN in the Software-Defined Data Center, you can use the following alerts in vRealizeLog Insight:

Table 1‑3. vSAN Alerts in vRealize Log Insight


VSAN - SSD healthchange to unhealthystate

This alert will fire when the state of any SSD changes to unhealthy. The reason could be eitherbecause of permanent disk failure, disk decommissioning, node shutdown, etc.

Critical

VSAN -Configuration failure- Insufficient space

This alert indicates that we cannot create a configuration for a new object(VM) in the VSANcluster because sufficient space is not available in the cluster. If we see this error, please checkthe error logs and try the provisioning operation after adding new hosts/disks.

Critical

VSAN - DeviceOffline

This alarm will trigger if a particular device goes offline. In this case, please check the deviceconfiguration and other cluster state.

Critical

VSAN - Objectcomponent statechanged todegraded

This alert will be triggered when VSAN object state changes to degraded state.Check the stateof the adapters, disks and network settings associated with the VSAN cluster.

Critical

Procedure







Setting Value

User name admin





VMware, Inc. 12

4 Select an alert that is related to vSAN storage.


VSAN - SSD health change to unhealthy state






Filter Value for Management vSAN Alerts in Region A

Object type vmw_datacenter

Operation contains

Object sfo01-m01dc



Setting Value for Management vSAN Alert in Region A

Name VSAN - SSD health change to unhealthy state (sfo01-m01dc)

Description (Recommendation) vsan_alert_purpose

See Table 1‑3.

Email Email address to send alerts to

Send to vRealize Operations Manager Selected

Fallback Object sfo01-m01dc

Criticality critical

Raise an alert On any match

e If you use a vSAN datastore in the shared edge and compute cluster in Region A, repeat thesteps to create an alert instance for the sfo01-w01dc data center.

6 Repeat Step 3 to Step 5 for the rest of the alerts, configuring an instance for the sfo01-m01dc datacenter, and for the sfo-w01dc data center if you use vSAN in the shared edge and compute cluster.

7 Repeat the procedure in vRealize Log Insight in Region Bhttps://lax01vrli01.lax01.rainpole.local to create the alerts for the lax01-m01dc datacenter, and for the lax01-w01dc data center if you use a vSAN datastore for the shared edge andcompute cluster.


VMware, Inc. 13

Enable the Alerts for vSphere NetworkingUse the in-built problem and alert signatures in vRealize Log Insight to create alerts for network-relatedevents and map them to the vRealize Operations Manager inventory. For each alert, you create oneinstance for the management data center and one instance for the shared edge and compute data center.

For basic monitoring of the vSphere networking components, use the following alerts:

Table 1‑4. vSphere Networking Alerts in vRealize Log Insight


Network: ESXiphysical NICdown

ESXi has reported that a physical NIC has become unavailable. Assuming other NICs are stillonline this indicates a lack of redundancy and a potential performance impact. If all physical NICsfor a vSwitch/dvSwitch are unavailable then communication problems to VMs and/or the ESXihost may be possible.

Critical

Network: ESXiuplinkredundancy lost

Only one physical NIC is currently connected, one more failure will result in a loss of connectivity. Critical

Network: Out ofMemory

ESXi 5.0 or later hosts with NetQueue enabled, run out of memory when using jumbo frames(MTU is 9000 bytes). The lack of memory for network packets leads to lost virtual machineconnectivity and may also lose connection with the vCenter Server. Other symptoms include:n Network performance of network card is substantially degradedn NFS datastores mounted and accessed through this card become unmounted or flap between

connected and disconnected state.vMotions time outn Restarting host management agents fail to complete when they attempt to re-initialize

Critical

Procedure







Setting Value

User name admin





VMware, Inc. 14

4 Select an alert that is related to vSphere networking.


Network: ESXi physical NIC down






FilterValue for Management vSphereNetworking Alerts in Region A

Value for Compute vSphere Networking Alertsin Region A






SettingValue for Management vSphereNetworking Alert in Region A

Value for Compute vSphere NetworkingAlert in Region A

Name Network: ESXi physical NIC down (sfo01-m01dc)

Network: ESXi physical NIC down (sfo01-w01dc)


networking_alert_purpose

See Table 1‑4.

networking_alert_purpose

See Table 1‑4.


Send to vRealizeOperations Manager

Selected Selected








VMware, Inc. 15

Enable the Alerts for NSX for vSphereCreate alerts using the in-built problem and alert signatures in vRealize Log Insight for NSX for vSphereand direct them to the vRealize Operations Manager inventory. For each alert, you create one instance forthe NSX Manager for the management cluster and one instance for the NSX Manager for the sharededge and compute cluster in the region.

For monitoring the NSX for vSphere configuration in the Software-Defined Data Center, you can use thefollowing alerts in vRealize Log Insight:

Table 1‑5. NSX Alerts in vRealize Log Insight


VMW_NSX_Firewall critical errors Firewall critical events:n 301501 - This is vsm side event if host failed to respond with in

time out windown 301503 - This is vsm side event if vsm failed while provisioning

firewall rulen 301506 - This is vsm side event if vsm failed to send exclude list

updaten 301031 - Failed to receive/parse/Update firewall config. Key value

will have context info like generation number and also otherdebugging info

Critical

VMW_NSX_VXLAN dataplane lostconnection to controller

This alert indicates VXLAN dataplane lost connection to controller. Critical

VMW_NSX_VXLAN configuration issue This alert is generated when VXLAN configuration pushed to hostbefore host was prep'ed - host must be rebooted to initializeconfiguration in correct order.

Critical

VMW_NSX_Manager - Host CommunicationErrors

This event will be generated when NSX Manager fails to receiveheartbeat from UserWorld Agent on the host within the thresholdperiod. The output is grouped by host-id. The host-id can be found fromvCenter.

Critical

Procedure







Setting Value

User name admin



VMware, Inc. 16



4 Select an alert that is related to NSX .


VMW_NSX_Firewall critical errors


5 Create an instance of the alert for each NSX Manager in Region A using the name of the NSXManager virtual machine in the query filter.




FilterValue for Management NSX Alertsin Region A Value for Compute NSX Alerts in Region A

Object type vc_vm_name vc_vm_name


Object sfo01m01nsx01 sfo01w01nsx01



SettingValue for Management NSX Alert inRegion A

Value for Compute NSX Alert in RegionA

Name VMW_NSX_Firewall critical errors(sfo01m01nsx01)

VMW_NSX_Firewall critical errors(sfo01w01nsx01)

Description (Recommendation) nsx_alert_purpose

See Table 1‑5.

nsx_alert_purpose

See Table 1‑5.



Selected Selected

Fallback Object sfo01m01nsx01 sfo01w01nsx01



e Repeat the steps to create the alert instance for the other NSX Manager in Region A.

6 Repeat Step 3 to Step 5 for the rest of the alerts, configuring two instances of each alert in Region A:for the sfo01m01nsx01 and sfo01w01nsx01 NSX Manager instances.


VMware, Inc. 17

7 Repeat the procedure in vRealize Log Insight in Region Bhttps://lax01vrli01.lax01.rainpole.local to create the alerts for both lax01m01nsx01 andlax01w01nsx01 instances of NSX Manager.

Enable the Alerts for vRealize Operations ManagerUse the built-in problem and alert signatures in vRealize Log Insight for vRealize Operations Manager.You create one instance of each alert in Region A and in Region B because the vRealize OperationsManager instance in the SDDC works in the context of both management and compute resources in eachregion. The SDDC also contains one analytics cluster that is failed over to Region B and you receivealerts only about it.

For monitoring the vRealize Operations Manager deployment in the Software-Defined Data Center, youcan use the following alerts in vRealize Log Insight:

Table 1‑6. vRealize Operations Manager Alerts in vRealize Log Insight


vRops: VC statsquery timed outoccurred

The purpose of this alert is to notify when vROPs instance is not able to get the data back fromvCenter instance within the 5 minute interval and the metrics back up and get dropped with theerror: Communication Error: com.integrien.adapter.vmware.VcCollector.collectMetrics - Vc statsquery timed out (ms): 300377. This is usually due to intermittent connection issues with thevCenter and hosts or down to the network not able to handle the request and timing out.

Critical

vRops: Out ofMemory errorsoccurred

This alert gets generated when OutOfMemoryError: Java heap space occurs. This couldindicate memory issues and could lead to degradation in performance.

Critical

Procedure







Setting Value

User name admin





VMware, Inc. 18

4 Select an alert that is related to vRealize Operations Manager resources.


vRops: VC stats query timed out occurred

5 Create an alert for vRealize Operations Manager in Region A using the name of the master virtualmachine in the query filter.




Filter Value for vRealize Operations Manager

Object type vc_vm_name

Operation contains

Object vrops01svr01a



Setting Value for vRealize Operations Manager

Name vRops: VC stats query timed out (vrops01svr01a)

Description (Recommendation) vrops_alert_purpose

See Table 1‑6.



Fallback Object vrops01svr01a



6 Repeat Step 3 to Step 5 for the rest of the alerts in Region A.

7 Repeat the procedure in vRealize Log Insight in Region Bhttps://lax01vrli01.lax01.rainpole.local to create the alerts for the vrops01svr01a mastervirtual machine.

Enable the Alerts for vRealize AutomationUse the in-built problem and alert signatures in vRealize Log Insight for vRealize Automation. You createone instance of each alert in Region A and in Region B because the vRealize Automation instance in theSDDC works in the context of the compute resources in each region. The environment also contains onevRealize Automation deployment that is failed over to Region B and you receive alerts only about it.


VMware, Inc. 19

For monitoring the vRealize Automation deployment in the Software-Defined Data Center, you can usethe following alerts in vRealize Log Insight.

Table 1‑7. vRealize Automation Alerts in vRealize Log Insight


*** CRITICAL*** vRA CAFEserviceunavailable!

A vRA CAFE service has become unavailable. This may happen because:n A service has failed - if the service does not automatically restart, this may impact vRA's ability

to functionn A service is blocked and cannot response at the moment - this may indicate increased load

within the environmentn vRA is starting and certain dependencies of the component are not available yet - this issue

should clear automatically as all services come online

Critical

*** CRITICAL*** vRA IaaSServicesStopped

A vRA service has become unavailable. This may happen because:n A service has failed - if the service does not automatically restart, this may impact vRA's ability

to functionn A service is blocked and cannot response at the moment - this may indicate increased load

within the environmentn Management Agent - in an HA deployment, only ONE Management Agent instance should be

running. If more than one is running, this will cause issues with normal functioning of the system.

Critical

*** CRITICAL*** vRA disk isfull

Windows host(s) have disk that is at capacity. If disk space runs out completely, it will impact theInfrastructure services provided by IaaS component of vRA and the Infrastructure tab will becomeunavailable from the vRA UI.

Critical

Procedure







Setting Value

User name admin





VMware, Inc. 20

4 Select an alert that is related to vRealize Automation.


*** CRITICAL *** vRA CAFE service unavailable!


5 Create an alert for vRealize Automation in Region A using the name of the primary vRealizeAutomation Appliance in the query filter.




Filter Value for vRealize Automation Alerts in Region A


Operation contains

Object vra01svr01a



Setting Value for vRealize Automation Alert in Region A

Name *** CRITICAL *** vRA CAFE service unavailable! (vra01svr01a)

Description (Recommendation) vra_alert_purpose

See Table 1‑7.



Fallback Object vra01svr01a



6 Repeat Step 3 to Step 5 for the rest of the alerts.

7 Repeat the procedure in vRealize Log Insight in Region Bhttps://lax01vrli01.lax01.rainpole.local to create the alerts for the vra01svr01a vRealizeAutomation Appliance.


VMware, Inc. 21

Enable the Alerts for Microsoft SQL Server for vRealizeAutomationUse the inbuilt problem and alert signatures in vRealize Log Insight for the Microsoft SQL Server forvRealize Automation. For each alert, you create one instance for each region so that alerts are stillavailable if the Microsoft SQL Server instance is failed over to Region B.

For monitoring the health of the Microsoft SQL Server installation in the Software-Defined Data Center,you can use the following alerts in vRealize Log Insight:

Table 1‑8. Microsoft SQL Server Alerts in vRealize Log Insight

AlertName Purpose Severity

MS-SQL:Failedloginattempt

Error codes in this group will have severity levels 14 or 16.

Login errors with severity level 14 would indicate security-related errors, such as permission denied.

Login errors with severity 16 would indicate login error that can be rectified by user. The exact errormessage text appears in the line just after the error code and severity level. Detailed error descriptioncan be found on:

http://technet.microsoft.com/en-us/library/cc645603%28v=sql.105%29.aspx

Critical

MS-SQL:Out ofMemory(Resources)

Error codes in this group will have severity levels 17 or 16.

Severity level 17 Indicates that the statement caused SQL Server to run out of resources (such asmemory, locks, or disk space for the database) or to exceed some limit set by the system administrator.

Severity level 16 indicates issues that can be addressed by the user.

For further information on error codes falling in the category refer:


Critical

MS-SQL :TransactionDeadlocked

Transaction deadlock errors are usually characterized by severity level 13.

This implies transaction was deadlocked on resources with another process and has been chosen as thedeadlock victim. This signifies that you will have to re run the transaction.

For further information on error codes falling in the category refer:


Critical

MS-SQL :DatabaseCorruption

Database corruption is defined as a problem associated with the improper storage of the actual zeroesand ones needed to store you database data at the disk or IO sub-system level.

Error codes in this group will have severity levels 20, 21, 22 or 23 or 16.

You might need to check the logical and physical integrity of all the objects in the specified database.

You can run

DBCC CHECKDB to check for any database corruption.

For more details on various error messages visit:


For detailed information on MS SQL severity:

http://msdn.microsoft.com/en-us/library/ms164086(v=sql.100).aspx

Critical


VMware, Inc. 22

HTTP://TECHNET.MICROSOFT.COM/EN-US/LIBRARY/CC645603%28V=SQL.105%29.ASPX



HTTP://MSDN.MICROSOFT.COM/EN-IN/LIBRARY/MS176064%28V=SQL.100%29.ASPX



Procedure







Setting Value

User name admin




4 Select an alert that is related to Microsoft SQL for vRealize Automation.


MS-SQL: Failed login attempt


5 Create an alert for the Microsoft SQL Server for vRealize Automation in Region A using the name ofthe virtual machine in the query filter.




FilterValue for Microsoft SQL for vRealize Automation Alertsin Region A


Operation contains

Object vra01mssql01


VMware, Inc. 23



Setting Value for Microsoft SQL for vRealize Automation Alert in Region A

Name MS-SQL: Failed login attempt (vra01mssql01)

Description (Recommendation) mssql_alert_purpose

See Table 1‑8.



Fallback Object vra01mssql01



6 Repeat Step 3 to Step 5 for the rest of the alerts in Region A.

7 Repeat the procedure in vRealize Log Insight in Region Bhttps://lax01vrli01.lax01.rainpole.local to create the alerts for the Microsoft SQL Server inthe region.


VMware, Inc. 24

Creating Custom SDDC vRealizeOperations Dashboards 2Monitoring the SDDC is critical to the health of the environment. You create custom vRealize OperationsManager dashboards to provide centralized SDDC dashboards. Using such dashboards simplifiesmonitoring the health of the SDDC as opposed to having to switch between multiple product-specificdashboards.

To create custom dashboards, verify that you have deployed vRealize Operations Manager according toimplementation guides. You must have the following management packs installed and configured:

n vRealize Operations Manager Management Pack for VMware vSphere

n vRealize Operations Manager Management Pack for VMware vSAN

n vRealize Operations Manager Management Pack for VMware vRealize Log Insight

n vRealize Operations Manager Management Pack for VMware vRealize Business for Cloud

n vRealize Operations Manager Management Pack for VMware vRealize Automation

n vRealize Operations Manager Management Pack for NSX-vSphere

n vRealize Operations Manager Management Pack for Storage Devices

Procedure

1 SDDC Capacity Overview Dashboard

This dashboard provides a summary of CPU, memory, and storage capacity provisioned, along withthe resource reclamation opportunities available in all environments monitored by vRealizeOperations Manager. Trend views within the dashboard allow you to predict running out of capacity.

2 Configure a Dashboard that Provides an Overview of SDDC Operation

Create a dashboard in vRealize Operations Manager where you can monitor the objects of theSDDC management stack.

SDDC Capacity Overview DashboardThis dashboard provides a summary of CPU, memory, and storage capacity provisioned, along with theresource reclamation opportunities available in all environments monitored by vRealize OperationsManager. Trend views within the dashboard allow you to predict running out of capacity.

VMware, Inc. 25

The Capacity Overview Dashboard provides you with a summary of the total physical capacity availableacross all your environments being monitored by vRealize Operations Manager. The dashboard providesa summary of CPU, memory, and storage capacity provisioned as well as the resource reclamationopportunities available in those environments. Since capacity decisions are mostly tied to logical resourcegroups, the Capacity Overview dashboard allows you to assess capacity and utilization at each resourcegroup level such as vCenter, datacenter, custom datacenter, or vSphere cluster. You can quickly select anobject and view the total capacity and used capacity of the object to understand the current capacitysituation. Capacity planning requires that you have visibility into the historical trends and future forecasts.The trend views within the dashboard provide you with this information to predict how soon you will runout of capacity.

Procedure

1 Log in to vRealize Operations Manager by using the operations interface.

a Open a Web browser and go to https://vrops01svr01.rainpole.local.


Setting Value

User name admin

Password vrops_admin_password

2 On the Home page in the left pane of vRealize Operations Manager, click Capacity Overview.


VMware, Inc. 26

3 You can use the Capacity Overview dashboard widgets in several ways.

a Using each of these widget categories you can drill down to the specific use cases and problemsyou are trying to solve.

Dashboard Widget Purpose/Usage

Total EnvironmentCapacity

Use this widget to view the total available capacity in the environment including information aboutthe number of hosts and datastores. You can also view storage, memory, and CPU capacity, andthe number of physical CPUs.

Select anEnvironment

Use this widget to select a data center, a cluster compute resource, or a vCenter Server. You canuse the filter to narrow your list based on several parameters. After you identify the data center youwant to view, select it. The dashboard is populated with the relevant data.

Total ReclamationOpportunity

Use this widget to view the reclaimable resources in the environment.

Total Capacity Use this widget to view the total physical capacity of the environment that includes capacityassigned as High Availability (HA). The actual capacity is less than the total capacity displayedwhen you consider HA and a buffer.

Used Capacity Use this widget to view the capacity that has been used in your environment

Memory CapacityUtilization Trend(TB)

Use this widget to view the overall memory capacity trend. This widget displays the total physicalresources you have. The physical resources include a HA buffer and a utilization buffer. Thiswidget also displays the total memory you have allocated to VMs. If the number is close to the totalphysical capacity, the VMs may contend for memory. Ensure that the contention level is lower thanwhat you promise to your customers. The chart also includes the actual utilization of memorycapacity. The actual utilization is based on the active memory and hence it tends to be lower, asVMs do not normally access most of their RAM at any given moment.

CPU CapacityUtilization Trend(GHz)

Use this widget to view the overall CPU capacity trend. This widget displays the total physicalresources you have. The physical resources include a HA buffer and a utilization buffer, whichreflects the total capacity. This widget also displays the total CPU capacity you have allocated toVMs. If the number is close to the total physical capacity, the VMs may contend for CPU. Ensurethat the contention level is lower than what you promise to your customers. The chart also includesthe actual utilization of CPU. The actual utilization is based on the CPU demand counter, whichtakes into account the CPU used to perform I/O on behalf of the VM. The ESXi host performsstorage I/O and network I/O on behalf of the VM, and this may be performed on a core that isdifferent from the one on which the VM runs. As a result, CPU demand is a more accuratereflection of the VM CPU usage.

Disk SpaceCapacityUtilization Trend

Use this widget to view the amount of disk space allocated to a VM and the amount that is actuallyused. This information is helpful when you plan for thin provisioning

Cluster CapacityDetails

Use this widget to view the capacity of each cluster in the environment. You can view details suchas the number of VMs, hosts, datastores, and CPUs in each cluster. You can also view details suchas the total CPU capacity and the provisioned CPU capacity, the total memory, and the provisionedmemory in each cluster

b If you plan to report the current capacity situation to others within your organization, you can editthe Cluster Capacity Details widget on this dashboard and export this as a report for sharingpurposes.


VMware, Inc. 27

Configure a Dashboard that Provides an Overview ofSDDC OperationCreate a dashboard in vRealize Operations Manager where you can monitor the objects of the SDDCmanagement stack.

Procedure

1 Create an Application for vRealize Log Insight

Create an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of vRealize Log Insight.

2 Create an Application for VMware Site Recovery Manager

Create an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of VMware Site Recovery Manager.

3 Create an Application for VMware vSphere Replication

Create an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of VMware vSphere Replication.

4 Create an Application for VMware vSphere Data Protection

Create an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of VMware vSphere Data Protection.

5 Create an Application for VMware vRealize Operations Manager

Create an application in vRealize Operations Manager to group the monitoring data for the virtualmachines of VMware vRealize Operations Manager.

6 Create an Application for VMware vSphere Update Manager Download Service

Create an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of VMware vSphere Update Manager Download Service (UMDS)

7 Collect the SDDC Objects in a Group

Create a custom group for each management application to monitor the health of the entireapplication stack as opposed to individual virtual machine health.

8 Configure a Dashboard that Provides an Overview of the SDDC State

Create a central dashboard that you can use to track the overall state of the SDDC.

Create an Application for vRealize Log InsightCreate an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of vRealize Log Insight.

vRealize Operations Manager builds an application to determine how your environment is affected whenone or more components in an application experiences problems. You can also monitor the overall healthand performance of the application.


VMware, Inc. 28

vRealize Operations Manager collects data from the components in the application and displays theresults in a summary dashboard for each application with a real-time analysis for any or all of thecomponents.

Because the Management Pack for vRealize Log Insight does not collect monitoring data about the virtualmachines of the vRealize Log Insight deployment, you create an application to watch their state.

Procedure




Setting Value

User name admin


2 In the left pane of vRealize Operations Manager, click the Environment menu and click theApplications tab.

3 On the Applications tab, click the Add icon to add an application.

4 In the Add Application dialog box, select Custom and click OK.

5 In the Application Management dialog box, in the Application text boxenter vRealize Log Insight.

6 In the Tiers pane, click Add Tier, enter Log Insight VMs as the Tier Name and click Update.

7 In the objects list underneath, enter vrli01 in the search box, and press Enter.

8 Select the Virtual Machine objects of vRealize Log Insight and drag them to the Tier Objects pane.

vRealize Log Insight Region A VMs vRealize Log Insight Region B VMs

sfo01vrli01a lax01vrli01a

sfo01vrli01b lax01vrli01b

sfo01vrli01c lax01vrli01c

9 Click Save.

Create an Application for VMware Site Recovery ManagerCreate an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of VMware Site Recovery Manager.



VMware, Inc. 29


Procedure




Setting Value

User name admin





5 In the Application Management dialog box, in the Application text boxenter Site Recovery Manager.

6 In the Tiers pane, click Add Tier, enter SRM VMs as the Tier Name and click Update.

7 In the objects list underneath, enter srm in the search box, and press Enter.

8 Select the Virtual Machine objects of Site Recovery Manager and drag them to the Tier Objectspane.

VMware Site Recovery Manager Region A VMs VMware Site Recovery Manager Region B VMs

sfo01m01srm01 lax01m01srm01

9 Click Save.

Create an Application for VMware vSphere ReplicationCreate an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of VMware vSphere Replication.




VMware, Inc. 30

Procedure




Setting Value

User name admin





5 In the Application Management dialog box, in the Application text boxenter vSphere Replication.

6 In the Tiers pane, click Add Tier, enter vSphere Replication VMs as the Tier Name and clickUpdate.

7 In the objects list underneath, enter vrms in the search box, and press Enter.

8 Select the Virtual Machine objects of vSphere Replication and drag them to the Tier Objects pane.

VMware vSphere Replication Region A VMs VMware vSphere Replication Region B VMs

sfo01m01vrms01 lax01m01vrms01

9 Click Save.

Create an Application for VMware vSphere Data ProtectionCreate an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of VMware vSphere Data Protection.




VMware, Inc. 31

Procedure




Setting Value

User name admin





5 In the Application Management dialog box, in the Application text boxenter vSphere Data Protection.

6 In the Tiers pane, click Add Tier, enter vDP VMs as the Tier Name and click Update.

7 In the objects list underneath, enter vdp in the search box, and press Enter.

8 Select the Virtual Machine objects of vSphere Data Protection and drag them to the Tier Objectspane.

VMware vSphere Data Protection Region A VMs VMware vSphere Data Protection Region B VMs

sfo01m01vdp01 lax01m01vdp01

9 Click Save.

Create an Application for VMware vRealize Operations Manager Create an application in vRealize Operations Manager to group the monitoring data for the virtualmachines of VMware vRealize Operations Manager.




VMware, Inc. 32

Procedure




Setting Value

User name admin


2 In the left pane of vRealize Operations Manager, click the Environment menu and clickthe Applications tab.



5 In the Application Management dialog box, in the Application text boxenter vRealize Operations Manager.

6 In the Tiers pane, click Add Tier, enter vRealize Operations Manager VMs as the Tier Name andclick Update.

7 In the objects list underneath, enter vrops01 in the search box and press Enter.

8 Select the Virtual Machine objects of vRealize Operations Manager Cluster and drag them to the TierObjects pane.

n vrops01svr01a

n vrops01svr01b

n vrops01svr01c

9 Click Save.

Create an Application for VMware vSphere Update ManagerDownload ServiceCreate an application in vRealize Operations Manager to group the monitoring data about the virtualmachines of VMware vSphere Update Manager Download Service (UMDS)




VMware, Inc. 33

Procedure




Setting Value

User name admin





5 In the Application Management dialog box, in the Application text box enter vSphere UMDS.

6 In the Tiers pane, click Add Tier, enter UMDS VMs as the Tier Name and click Update.

7 In the objects list underneath, enter umds in the search box, and press Enter.

8 Select the Virtual Machine objects of vSphere Update Manager Download Service and drag them tothe Tier Objects pane.

VMware vSphere UMDS Region A VMs VMware vSphere UMDS Region B VMs

sfo01umds01 lax01umds01

9 Click Save.

Collect the SDDC Objects in a GroupCreate a custom group for each management application to monitor the health of the entire applicationstack as opposed to individual virtual machine health.

Procedure




Setting Value

User name admin


2 In the left pane of vRealize Operations Manager, click the Environment menu and click the CustomGroups tab.

3 On the Custom Groups tab, click the Add icon to add a custom group.


VMware, Inc. 34

4 In the New group dialog box, enter SDDC Management in the Name text box.

5 From the Group Type drop-down menu, select Function.

6 Expand the Define membership criteria section.

7 To add the vRealize Automation objects, from the Select the Object Type that matches all of thefollowing criteria drop-down menu, select vRealize Automation Adapter > vRealize AutomationMP Instance.

8 Click Add another criteria set and repeat Step 7 to add each of the following object typesrepresenting the other management applications in the SDDC.

n vRBC Adapter > vRBC Adapter Instance

n vCenter Adapter > vSphere World

n NSX-vSphere Adapter > NSX-vSphere Environment

9 Expand the Objects to always include section.

10 Add the following application objects.

a Under Filtered objects, expand Custom Groups and select Applications.

b Select vRealize Log Insight, click the Add button to add the application objects to Objects toalways include list on the right.

c Add the rest of application objects.

n Site Recovery Manager

n vSphere Replication

n vSphere Data Protection

n vRealize Operations Manager

n vSphere UMDS

11 Click OK.

Configure a Dashboard that Provides an Overview of the SDDCStateCreate a central dashboard that you can use to track the overall state of the SDDC.

The SDDC overview dashboard has the following two aspects:

n Display the main indicators for the state of CPU, memory, connectivity and storage in themanagement cluster that hosts the management applications.

n Show the overall state of the management applications in the SDDC. You use the SDDCManagement custom group that represents a common object for all management applications.


VMware, Inc. 35

The SDDC dashboard consists of the following widgets:

n Twelve Heatmap widgets showing heatmaps of the compute resources in the SDDC. You arrange theheatmap widgets in three rows and four columns. Heatmap widgets arelabeled Heatmap X.Y where X is the row number and Y is the column number in the dashboard.

n One Health Chart widget

Table 2‑1. Configuration of the Heatmap Widgets in the First Row of the SDDC Dashboard

Widget Setting Heatmap 1.1 Heatmap 1.2 Heatmap 1.3 Heatmap 1.4

Title Physical CPURemaining

Physical MemoryRemaining

Management VM CPUUsed

Management VM CPUContention

Refresh Content On On On On

Refresh Interval 300s 300s 300s 300s

Name Management Hosts Management Hosts Management VMs Management VMs

Group by vCenter Adapter >Datacenter

vCenter Adapter >Datacenter



Then by - - - -

Mode Instance Instance Instance Instance

Object type vCenter Adapter >Host System

vCenter Adapter >Host System

vCenter Adapter >Virtual Machine


Attribute type CPU > CapacityRemaining (%)

Memory > CapacityRemaining (%)

CPU > Usage (%) CPU > CPU Contention(%)

Min Value (Color) 0 (red) 0 (red) 80 (green) 0 (green)

Max Value (Color) 25 (green) 25 (green) 100 (red) 2 (red)

Filter - - n Adapter Instances> vCenter Server >sfo01m01vc01

n Adapter Instances> vCenter Server >lax01m01vc01

n Adapter Instances >vCenter Server >sfo01m01vc01

n Adapter Instances >vCenter Server >lax01m01vc01

Table 2‑2. Configuration of the Heatmap Widgets in the Second Row of the SDDCDashboard


Title Physical Network I/O Physical DroppedPackets

Management VMMemory Used

Management VM SwapRate



Name Management Hosts Management Hosts Management VMs Management VMs

Group by vCenter Adapter >Datacenter




Then by - - - -


VMware, Inc. 36

Table 2‑2. Configuration of the Heatmap Widgets in the Second Row of the SDDCDashboard (Continued)



Object type vCenter Adapter >Host System

vCenter Adapter >Host System



Attribute type Network I/O > Demand(%)

Network I/O > PacketsDropped

Memory > Usage (%) Memory > Swapped(KB)

Min Value (Color) 80 (green) 0 (green) 50 (green) 0 (green)

Max Value (Color) 100 (red) 1 (red) 90 (red) 1 (red)





Table 2‑3. Configuration of the Heatmap Widgets in the Third Row of the SDDC Dashboard


Title Storage VSAN Latency Storage NFS Latency Management VMStorage Latency

Management VM DiskFree



Name Datastores Datastores Management VMs Management VMs

Group by > VirtualSAN Datastore Storage Devices >NFS Volume



Then by - - - -


Object type > VirtualSANDatastore

Storage Devices >NFS Volume



Attribute type Host Specific Metrics >Write Latency (ms)

Derived Statistics >Inferred Latency

Virtual Disk > ReadLatency (ms)

Disk Space > CapacityRemaining (%)

Min Value (Color) 0 (green) 0 (green) 0 (green) 5 (red)

Max Value (Color) 30 (red) 30 (red) 30 (red) 20 (green)






VMware, Inc. 37

Table 2‑4. Configuration of the Health Chart Widget in the SDDC Dashboard

Health Widget Setting Value

Title Management Applications

Refresh Content On

Refresh Interval 300s

Self Provider On

Mode Children

Order By Value Asc

Pagination number 15

Period Length Last 6 hours

Metric Health

Procedure




Setting Value

User name admin


2 On the Home page, from the Actions menu select Create Dashboard and in the DashboardConfiguration section of the New Dashboard dialog box, configure the following settings.

Dashboard Setting Value

Name SDDC Overview

Is default Yes

3 Add widgets to the dashboard.

a Expand the Widget List section.

b Drag 12 Heatmap widgets to the layout pane on the right, make three rows with four columns andalign them so that they are all approximately equal in size.

c Drag a Health Chart widget to the layout pane on the right.

4 Configure the Heatmap widgets.

a In the upper-right corner of each widget, click the Edit Widget icon and configure the widget.

b In the Edit Heatmap dialog box, configure the settings of the heatmap widget and click Save.


VMware, Inc. 38

5 Configure the Health Chart widget.

a In the upper-right corner of the widget, click the Edit Widget icon and configure the widget.

b In the Edit Health Chart dialog box, configure the settings of the Health Chart widget .

c From the objects list at the bottom, expand Function and select the SDDC Management customgroup and click Save.

6 In the New Dashboard dialog box, click Save.

The SDDC Overview dashboard becomes available in Dashboards list of the vRealize OperationsManager user interface.


VMware, Inc. 39

Configure vRealize OperationsManager to Notify of SDDCIssues 3Create a set of notifications in vRealize Operations Manager so that data center operators receive alertsabout issues in the SDDC main functions.n Create Notifications in vRealize Operations Manager

Create email notifications in vRealize Operations Manager so that the SDDC operators know ofissues in the main monitoring parameters of the environment.

n List of Notifications for vRealize Operations Manager

Configure vRealize Operations Manager to send email notifications about important alerts in theSDDC.

Create Notifications in vRealize Operations ManagerCreate email notifications in vRealize Operations Manager so that the SDDC operators know of issues inthe main monitoring parameters of the environment.

You create a set of notifications of important alerts in the SDDC. See List of Notifications for vRealizeOperations Manager.

Procedure




Setting Value

User name admin


2 On the main navigation bar, click Alerts.

3 In the Navigator, expand Alert Settings and click Notifications Settings.

VMware, Inc. 40

4 On the Notification Settings page, click the Add icon and configure the following notification settingsin the Add Rule dialog box.

Notification Setting Value

Name Virtual machine is projected to run out of disk space

Method Standard Email Plugin

Instance SMTP Alert Mail Relay

Recipient(s) Email address to send alerts to

Filtering Criteria

Scope Object Type

Object Type vCenter Adapter > Virtual Machine

5 Configure the trigger for the notification.

a In the Filtering Criteria section of the Add Rule dialog box, select Alert Definition from theNotification Trigger drop-down menu.

b Click the Select an Alert Definition button.

c In the Quick filter (Name) text box of the Alert Definitions dialog, enter disk space and pressEnter.

d Select the Virtual machine is projected to run out of disk space alert definition and clickSelect.

6 In the Add Rule dialog, click Save.

7 Repeat the steps to create the other SDDC notifications.

List of Notifications for vRealize Operations ManagerConfigure vRealize Operations Manager to send email notifications about important alerts in the SDDC.

You define notifications from the Alerts > Alert Settings > Notification Settings page in vRealizeOperations user interface. See Create Notifications in vRealize Operations Manager.

Notification Delivery PropertiesWhen you define notifications from vRealize Operations Manager, use the following properties to sendthem by email to the operations team in your organization.

Table 3‑1. Delivery Properties of vRealize Operations Manager Notifications

Notification Delivery Property Value

Method Standard Email Plugin

Instance SMTP Alert Mail Relay

Recipients Email address to send alerts to


VMware, Inc. 41

Virtual Machine and Host NotificationsCreate notifications for important virtual machines and ESXi host issues.

Table 3‑2. VM and Host Notifications in SDDC

Name ScopeNotificationTrigger Alert Definition

Virtual machine is projected torun out of disk space

1 Object Type

2 vCenter Adapter > Virtual MachineAlertDefinition

Virtual machine is projected torun out of disk space

Virtual machine has CPUcontention caused by co-stop

1 Object Type


Virtual machine has CPUcontention due to multi-vCPUscheduling issues (co-stop)caused by too many vCPUs

Virtual machine hasunexpected high CPUworkload

1 Object Type


Virtual machine has unexpectedhigh CPU workload

Virtual machine hasunexpected high memoryworkload

1 Object Type


Virtual machine has unexpectedhigh memory workload

Virtual machine has disk I/Olatency problem caused bysnapshots

1 Object Type


Virtual machine has disk I/Olatency problem caused bysnapshots

Virtual Machine is running outof disk space

1 Object Type


Virtual Machine is running out ofdisk space

Virtual machine has large disksnapshots

1 Object Type


Virtual machine has large disksnapshots

Not enough resources forvSphere HA to start the virtualmachine

1 Object Type


Not enough resources forvSphere HA to start the virtualmachine

vSphere HA cannot perform afailover operation for thevirtual machine

1 Object Type


vSphere HA cannot perform afailover operation for the virtualmachine

Standalone host has CPUcontention caused byoverpopulation of virtualmachines

1 Object Type

2 vCenter Adapter > Host SystemAlertDefinition

Standalone host has CPUcontention caused byoverpopulation of virtualmachines

Standalone host has memorycontention caused byoverpopulation of virtualmachines

1 Object Type


Standalone host has memorycontention caused byoverpopulation of virtualmachines

vSphere DRS enabled clusterhas CPU contention causedby overpopulation of virtualmachines

1 Object Type

2 vCenter Adapter > Cluster ComputeResource

AlertDefinition

Fully-automated DRS-enabledcluster has CPU contentioncaused by overpopulation ofvirtual machines


VMware, Inc. 42

Table 3‑2. VM and Host Notifications in SDDC (Continued)


vSphere DRS enabled clusterhas high CPU workload

1 Object Type


AlertDefinition

Fully-automated DRS-enabledcluster has high CPU workload

vSphere DRS enabled clusterhas memory contentioncaused by overpopulation ofvirtual machines

1 Object Type


AlertDefinition

Fully-automated DRS-enabledcluster has memory contentioncaused by overpopulation ofvirtual machines

vSphere DRS enabled clusterhas high memory workloadand contention

1 Object Type


AlertDefinition

Fully-automated DRS-enabledcluster has high memoryworkload and contention

vSphere HA failover resourcesare insufficient

1 Object Type


AlertDefinition

vSphere High Availability (HA)failover resources areinsufficient

Network-RelatedNotificationsCreate notifications for important network-related issues in distributed switches and NSX components.

Table 3‑3. Network-Related Notifications in SDDC


Distributed switch configurationis out of sync

1 Object Type

2 vCenter Adapter > vSphere DistributedSwitch

AlertDefinition

Distributed Switch configurationis out of sync

Host NSX messaginginfrastructure is reporting anissue

1 Object Type


Host's NSX messaginginfrastructure is reporting anissue

NSX Manager resource usageis high

1 Object Type

2 NSX-vSphere Adapter > NSX-vSphereManager

AlertDefinition

Manager resource usage ishigh

NSX Manager API calls arefailing

1 Object Type


AlertDefinition

Manager API calls are failing

VXLAN segment range hasbeen exhausted

1 Object Type


AlertDefinition

VXLAN segment range hasbeen exhausted

Less than three NSXControllers are active

1 Object Type

2 NSX-vSphere Adapter > NSX-vSphereController Cluster

AlertDefinition

Less than three controllers areactive

Edge resource usage is high 1 Object Type

2 NSX-vSphere Adapter > NSX-vSphereEdge

AlertDefinition

Edge resource usage is high


VMware, Inc. 43

Table 3‑3. Network-Related Notifications in SDDC (Continued)


High Availability is notconfigured correctly on theEdge

1 Object Type


AlertDefinition

High Availability is notconfigured correctly on theEdge

Edge VM is not responding tohealth check

1 Object Type


AlertDefinition

Edge VM is not responding tohealth check

One or more Load Balancerpool members are down

1 Object Type


AlertDefinition

One or more Load Balancerpool members are down

Storage NotificationsCreate notifications for important storage issues.

Table 3‑4. Storage Notifications in SDDC


Datastore is running out of diskspace

1 Object Type

2 vCenter Adapter > DatastoreAlertDefinition

Datastore is running out of diskspace

Datastore is projected to runout of disk space

1 Object Type

2 vCenter Adapter > DatastoreAlertDefinition

Datastore is projected to runout of disk space

After one additional hostfailure, vSAN Cluster will nothave enough resources torebuild all objects

1 Object Type

2 vSAN Adapter > VirtualSAN ClusterAlertDefinition

After one additional hostfailure, vSAN Cluster will nothave enough resources torebuild all objects

vSAN cluster health checks arereporting issues

1 Object Type


vSAN cluster health checks arereporting issues

vSAN Cluster flash read cachereservation is approachingcapacity

1 Object Type


vSAN Cluster flash read cachereservation is approachingcapacity

Notifications about vRealize Operations ManagerCreate notifications for important issues in the operation of vRealize Operations Manager.


VMware, Inc. 44

Table 3‑5. NotificationsforvRealize Operations Manager Issues


One or more vRealizeOperations services on a nodeare down

1 Object Type

2 vRealize Operations Adapter >vRealize Operations Node

AlertDefinition

One or more vRealizeOperations services on a nodeare down

Disk space on a vRealizeOperations Manager node islow

1 Object Type


AlertDefinition

Disk space on node is low

Node processing queue isbacking up

1 Object Type


AlertDefinition

Node processing queue isbacking up

FSDB failed to repair corruptedfiles

1 Object Type

2 vRealize Operations Adapter >vRealize Operations Fsdb

AlertDefinition

Fsdb failed to repair corruptedfiles

FSDB overload 1 Object Type

2 vRealize Operations Adapter >vRealize Operations Fsdb

AlertDefinition

Fsdb high load

Number of objects monitoredby this vRealize OperationsManager node exceeds theconfigured limit. Possible lossof data

1 Object Type

2 vRealize Operations Adapter >vRealize Operations Analytics

AlertDefinition

Number of Objects beingmonitored by this vRealizeOperations Node exceeds theconfigured limit. Possible lossof data

Remote Collector one or morevRealize Operations servicesare down

1 Object Type

2 vRealize Operations Adapter >vRealize Operations Remote Collector

AlertDefinition

One or more vRealizeOperations services on aremote collector are down

Remote Collector not reportingcorrect number of services

1 Object Type

2 vRealize Operations Adapter >vRealize Operations Remote Collector

AlertDefinition

Remote Collector not reportingcorrect number of services

vRealize Operations Clusterprocesses might be out ofmemory

1 Object Type

2 vRealize Operations Adapter >vRealize Operations Cluster

AlertDefinition

vRealize Operations Clusterprocesses may not haveenough memory


VMware, Inc. 45

Monitor vSphere DataProtection Jobs by Email 4vSphere Data Protection supports email notifications about the status of backup jobs. Configure vSphereData Protection to send daily emails. You can regularly check them as a part of your daily monitoringactivities.

Procedure

1 Log in to vCenter Server by using the vSphere Web Client.


Region Management vCenter Server URL

Region A https://sfo01m01vc01.sfo01.rainpole.local/vsphere-client

Region B https://lax01m01vc01.lax01.rainpole.local/vsphere-client


Setting Value

User name [email protected]

Password vsphere_admin_password

2 On the vSphere Web Client Home page, click the VDP icon.

3 On the Welcome to vSphere Data Protection page, select the region-specific vSphere DataProtection instance from the VDP Appliance drop-down menu and click Connect.

Region vSphere Data Protection Instance

Region A sfo01m01vdp01

Region B lax01m01vdp01

4 On the Configuration tab, click the Email button and click Edit.

5 Configure the following settings for email notification and click Save.

Email Notification Settings Region A Region B

Enable vSphere Data Protection alarm emailnotification

Selected Selected

Enable email reports Selected Selected

VMware, Inc. 46

Email Notification Settings Region A Region B

Send time 6:00 AM 6:00 AM

Send day(s) All days All days

Enable the CSV attachment in email report Selected Selected

Outgoing mail server FQDN of the mail server FQDN of the mail server

From address [email protected] [email protected]

To addresses(es) Email address to send alerts to Email address to send alerts to

6 Click the Send test email hyperlink and verify that you receive the test email.

7 Click OK in the Confirmation dialog box.

8 Repeat the steps to configure vSphere Data Protection in Region B to send daily email messages.


VMware, Inc. 47

Configure vRealize AutomationSystem Notification Events 5You can receive automatic notifications for several types of events, such as the successful completion ofa catalog request or a required approval.

System administrators can configure global email servers that handle email notifications.

Tenant administrators can override the system default servers, or add their own servers if no globalservers are specified. Tenant administrators select which events, also known as notification scenarios.Each component, such as the service catalog or IaaS, can define events that can trigger notifications.

Each user can choose whether to receive notifications. Users either receive all notifications configured bythe tenant administrator or no notifications, they do not have fine-grained control over which notificationsto receive.

Prerequisites

Verify that vRealize Automation has the inbound and outbound email servers configured. See Configurethe Default Email Servers in Region A in VMware Validated Design Deployment Guide for Region A.

Procedure

1 Log in to the vRealize Automation Rainpole portal.

a Open a Web browser and go to https://vra01svr01.rainpole.local/vcac/org/rainpole.


Setting Value

User name itac-tenantadmin

Password itac-tenantadmin_password

Domain Rainpole.local

2 On the Home page of the vRealize Automation management console, click the Administration taband click Notifications.

VMware, Inc. 48

3 Configure the scenarios to receive notifications about. By default all scenarios are active.

a In the Navigator, select Scenarios.

b If you do not want to be alerted on a scenario, select it and click the Suspend button.

c Verify that each of the scenarios you want to receive notifications about has Status - Active.

4 Subscribe to notifications from vRealize Automation.

a Click Preferences next to the ITAC-TenantAdmin user name on the top banner.

b Under Notifications, select English (United States) from the Language drop-down menu.

c Select Enabled next to the Email protocol, click Apply and click Close.

Notifications are now enabled for the ITAC-TenantAdmin account.


VMware, Inc. 49

monitoring and alerting - vmware validated design 4 · after you deploy the software-defined data...

Documents