expanding your options with the mq appliance
TRANSCRIPT
Session #3456: Expanding your options with the IBM MQ Appliance Leif Davidsen – Senior Offering Manager, IBM Messaging Anthony Beardsmore – IBM MQ Appliance Architect
Overview
• The scalability and security of IBM MQ V8 in a physical appliance form factor
• Rapid, reliable, simple, secure exchange of data across applications, systems and services
• Convenience, fast time-to-value, and low total cost of ownership of an appliance
• Use as a messaging hub to extend connectivity within your enterprise, in branch offices, factories or stores
What’s new in IBM MQ Appliance M2000 Integrates seamlessly into MQ networks and clusters
Simple out of the box High-Availability and Disaster Recovery with paired connectivity to other appliances
Simpler maintenance with fixpacks delivered as certified firmware updates onto a locked down appliance
Appliance delivered pre-optimized for maximum performance out-of-the-box
New MQ Console to provide a browser-based user interface offering personalized monitoring and configuration
General Availability: March 13th 2015
IBM MQ Appliance M2000
2
IBM MQ Appliance offers:
Optimized solutions to meet the needs of these use cases Differentiation compared to MQ software deployment approaches 2 price points to meet different deployment-based business needs
What do you want to do?
Consolidate my MQ
infrastructure into an “MQ
Hub” for lower TCO
Deploy to remote
premises, e.g. Branch, Factory,
Warehouse
Deploy to business partner,
e.g. Dealer, Broker
3 3
Challenges
Mixture of platforms and versions
Complex dependencies
Migrations difficult – lack of standardization
Application downtime impacts other applications
Consolidate my MQ infrastructure into a “MQ Hub” for lower TCO
Objectives
Reduce TCO
Reduce footprint
Standardise deployments
Build 'hub' - concentrate expertise
4
Benefits
Easy to deploy Simplified maintenance Familiar administration Separates applications from Infrastructure Supports existing MQ definitions, concepts and security model HA avoiding external dependencies
Challenges
Avoiding single points of failure
Outside assistance needed – lack of local skills and resources
Deploy to a remote premises
Objectives
Resilient connectivity to remote location
Robust and secure
Flexibility, minimal time to value at new sites
Benefits
Standardization makes ‘pre-canned’ rollout simpler
Remote configuration and management
High availability requires no additional systems or skills
5
Challenges
Partner may not have MQ or MQ skills today
Time to build and deploy
Configuration needs to meet our standards
Downtime directly effects business relationship
Deploying to business partner: Appliances as ‘Gateways’
Objectives
Extend connectivity to external business partner
Rapid onboarding
Control and limit access
QOS expectations from both parties
Benefits
Easy to deploy Simplified maintenance
Ability to preconfigure a very standard system both helps ensure standards applied and speed deployment
HA avoiding external dependencies
6
© 2015 IBM Corporation
High-end solution for enterprise consolidation use case Capable of handling large MQ workloads for persistent
and non-persistent messaging Host multiple Queue Managers to act as a messaging
hub A replacement for multiple separate MQ servers Built-in High Availability when paired to a 2nd appliance
and off-site disaster recovery to another Appliance Supports MQ AMS, and can be used to move MQ MFT
files between MFT endpoints
Lower-end solution for branch office or factory deployment
Same software and hardware as the Enterprise appliance, but processor usage limited
Designed to meet lower messaging throughput requirements
Supports all features of M2000A, including High Availability, Disaster Recovery and MQ AMS
Trade-up part available from M2000B capacity to M2000A capacity
IBM MQ Appliance M2000A (for Enterprise) IBM MQ Appliance M2000B (Branch etc.)
Easily deploy and maintain MQ messaging in minutes!
Which MQ Appliance is right for you?
7
Prebuilt for Hub pattern – no Apps on device No additional software installation
No user Exits in MQ
Monitoring agents must be remote
High Availability out-of-the-box Single Firmware update for whole appliance
Firmware update inc. appliance and MQ Fixpack
Can be rolled back as an single unit
Controlled administration environment Web, MQ Explorer and MQSC/cmd-line admin of MQ
IBM MQ Appliance IBM MQ V8 on Custom Server
Key Differences with Appliance Form-factor Apps Tuning
MQ / Middleware
OS
Hardware
DIY Hub or Generic server – Apps + Middleware Install any software
Build & maintain your own custom extensions
Add local monitoring agents
Needs HA Cluster SW or Network Storage for HA Custom tuning for each layer (OS/Middleware) Discrete maintenance for each layer
MQ Fixpacks;OS maintenance, security patches etc.
Generic OS shell for local administration MQ Explorer and MQSC/cmd-line administration of MQ
8
QM1 QM2 QM3
QM1 QM2 QM3
Fully synchronous replication (HA) or asynchronous (DR)
• No persistent data loss on failure (HA mode)
• No external storage • No additional skills
required
• Manual control of failover for migration/maintenance
• Queue manager level active/passive (i.e. both appliances can run workload)
Designed to be configured in seconds with no external dependencies
Availability options in the MQ Appliance
9
IBM MQ Appliance M2000 • Optimized messaging, right out of the box
• Secure your business with High Availability built-in
• Lower your TCO with simpler maintenance, and
lower data storage space and power requirements
• Deploy to partners and remote premises, without
requiring local MQ expertise
IBM Integration Bus V10 • Increased flexibility with separate deployment for MQ
• Install in minutes
• New patterns to rapidly create mobile integrations
• Flexible cloud deployment options
The Complete Messaging and Integration Solution
10
MQ Appliance key capabilities
11
Lets really simplify it…
An MQ Appliance is a box where you create and run queue managers…
Queue manager 1 Queue manager 2 Queue manager 3
Application Application
Application
Application Application
Queue manager 4
12
Physical configuration
2x Management 1GB Ethernet (also IPMI)
Display (includes capacity and version information)
Serial / KVM connection N.B. REQUIRED for initial setup General purpose 1GB Ethernet
(MQ Application traffic)
General purpose 10GB Ethernet (SPF+) (MQ Application traffic)
2x 1GB Ethernet: HA or general purpose
10 GB Ethernet (SPF+): HA or general purpose
HBA (unused)
13
M2000(mqcli)# crtmqm test Please wait while 64 GB file system is initialized for queue manager 'test'. IBM MQ Appliance queue manager created. The queue manager is associated with installation 'MQAppliance'. Creating or replacing default objects for queue manager 'test'. Default objects statistics : 83 created. 0 replaced. 0 failed. Completing setup. Setup completed.
M2000(mqcli)# strmqm test IBM MQ Appliance queue manager 'test' starting. The queue manager is associated with installation 'MQAppliance'. 5 log records accessed on queue manager 'test' during the log replay phase. Log replay for queue manager 'test' complete. Transaction manager state recovered for queue manager 'test'. IBM MQ Appliance queue manager 'test' started using V8.0.0.4. M2000(mqcli)# runmqsc test 5724-H72 (C) Copyright IBM Corp. 1994, 2014. Starting MQSC for queue manager test.
Serial/SSH HTTP
M2000(mqcli)# crtmqm test Please wait while 64 GB file system is initialized for queue manager 'test'. IBM MQ Appliance queue manager created. The queue manager is associated with installation 'MQAppliance'. Creating or replacing default objects for queue manager 'test'. Default objects statistics : 83 created. 0 replaced. 0 failed. Completing setup. Setup completed.
M2000(mqcli)# strmqm test IBM MQ Appliance queue manager 'test' starting. The queue manager is associated with installation 'MQAppliance'. 5 log records accessed on queue manager 'test' during the log replay phase. Log replay for queue manager 'test' complete. Transaction manager state recovered for queue manager 'test'. IBM MQ Appliance queue manager 'test' started using V8.0.0.4. M2000(mqcli)# runmqsc test 5724-H72 (C) Copyright IBM Corp. 1994, 2014. Starting MQSC for queue manager test.
MQ Channel (PCF)
New for Version 8!
New for
Appliance
Administration
14
Much more detail in…
3458A
The IBM MQ Appliance: Administration Simplified
Mandalay Bay NORTH - South Pacific Ballroom I
Tue, 23-Feb 01:15 PM - 02:15 PM
Aka… the session right after this!
15
M2000(mqcli)# crtmqm test Please wait while 64 GB file system is initialized for queue manager 'test'. IBM MQ Appliance queue manager created. The queue manager is associated with installation 'MQAppliance'. Creating or replacing default objects for queue manager 'test'. Default objects statistics : 83 created. 0 replaced. 0 failed. Completing setup. Setup completed. M2000(mqcli)# strmqm test IBM MQ Appliance queue manager 'test' starting. The queue manager is associated with installation 'MQAppliance'. 5 log records accessed on queue manager 'test' during the log replay phase. Log replay for queue manager 'test' complete. Transaction manager state recovered for queue manager 'test'. IBM MQ Appliance queue manager 'test' started using V8.0.0.4. M2000(mqcli)# runmqsc test 5724-H72 (C) Copyright IBM Corp. 1994, 2014. Starting MQSC for queue manager test.
M2000(mqcli)# crtmqm test Please wait while 64 GB file system is initialized for queue manager 'test'. IBM MQ Appliance queue manager created. The queue manager is associated with installation 'MQAppliance'. Creating or replacing default objects for queue manager 'test'. Default objects statistics : 83 created. 0 replaced. 0 failed. Completing setup. Setup completed. M2000(mqcli)# strmqm test IBM MQ Appliance queue manager 'test' starting. The queue manager is associated with installation 'MQAppliance'. 5 log records accessed on queue manager 'test' during the log replay phase. Log replay for queue manager 'test' complete. Transaction manager state recovered for queue manager 'test'. IBM MQ Appliance queue manager 'test' started using V8.0.0.4. M2000(mqcli)# runmqsc test 5724-H72 (C) Copyright IBM Corp. 1994, 2014. Starting MQSC for queue manager test.
M2000(mqcli)# crtmqm test Please wait while 64 GB file system is initialized for queue manager 'test'. IBM MQ Appliance queue manager created. The queue manager is associated with installation 'MQAppliance'. Creating or replacing default objects for queue manager 'test'. Default objects statistics : 83 created. 0 replaced. 0 failed. Completing setup. Setup completed. M2000(mqcli)# strmqm test IBM MQ Appliance queue manager 'test' starting. The queue manager is associated with installation 'MQAppliance'. 5 log records accessed on queue manager 'test' during the log replay phase. Log replay for queue manager 'test' complete. Transaction manager state recovered for queue manager 'test'. IBM MQ Appliance queue manager 'test' started using V8.0.0.4. M2000(mqcli)# runmqsc test 5724-H72 (C) Copyright IBM Corp. 1994, 2014. Starting MQSC for queue manager test.
Administrative user repository
Messaging user repository
Administrators are always defined locally on the appliance and can connect via SSH or WebUI to administer all aspects of the system
Messaging Users may be defined locally or in LDAP repository (choice per QM), and remote applications always connect with these credentials.
Secure administration
16
Traditional MQ (software) Queue Manager
Application
Application
M2000(mqcli)# crtmqm test Please wait while 64 GB file system is initialized for queue manager 'test'. IBM MQ Appliance queue manager created. The queue manager is associated with installation 'MQAppliance'. Creating or replacing default objects for queue manager 'test'. Default objects statistics : 83 created. 0 replaced. 0 failed. Completing setup. Setup completed. M2000(mqcli)# strmqm test IBM MQ Appliance queue manager 'test' starting. The queue manager is associated with installation 'MQAppliance'. 5 log records accessed on queue manager 'test' during the log replay phase. Log replay for queue manager 'test' complete. Transaction manager state recovered for queue manager 'test'. IBM MQ Appliance queue manager 'test' started using V8.0.0.4. M2000(mqcli)# runmqsc test 5724-H72 (C) Copyright IBM Corp. 1994, 2014. Starting MQSC for queue manager test.
New certificate management commands
TLS (SSL) on channels
End to end and at-rest encryption using AMS built in and included as standard
Secure messaging
17
Secure updates
Mq-appliance-8.0.0.3.scrypt3
Visit fix central to download appliance updates to a local server ready to deploy
Updates are supplied as a simple single file download, signed and secure, and are the only thing which can be installed on the appliance hardware.
Copy to appliance – update, and reboot. All driver, system and MQ updates are applied as a single operation
18
Log database or file
The MQ Appliance can be the Queue Manager to provide both regular MQ Queue Manager capabilities No other MQ server deployment
needed Also Coordination Queue Manager
capabilities No files are stored on the appliance No MQ MFT Agent needed on the
appliance to support this Highly available and robust Secure with MQ AMS entitlement built in
– Content encrypted based on policies
Applications exchanging file data
Agent Agent Agent
“Coordination” Queue Manager
Commands
Using MQ MFT and the MQ Appliance
19
• The IBM MQ Appliance supports a number of protocols for message transmission
• Today: – MQ client protocol – for connectivity from applications
•Client libraries available in the usual places, not shipped with the appliance – MQ server protocol – for connectivity with other queue managers
•This will support sender-receiver channels and server-requester channels, including cluster flows
• Subject to customer interest we may add further protocols such as – MQTT – for internet of things and mobile/web messaging – AMQP – for MQ Light API client connectivity
Connectivity
20
QM1 QM2 QM3
QM1 QM2 QM3
Fully synchronous replication
Key design points: - No (persistent) message loss - No external dependencies - Transparent to application
HA Overview
21
QM1 QM2 QM3
QM1 QM2 QM3
HA – When things go wrong
22
DR Replication Asynchronous (10 Gb Ethernet)
• New function in 8.0.0.4 update • Provides for longer distance
recovery than HA • e.g. Out Of Region standby site
• Still ultimately requires high bandwidth connectivity as all persistent data fully mirrored
• But - asynchronous so better choice than HA for higher latency, ‘bursty’ or ‘lossy’ networks)
• Also means most recent messages are potentially lost on failover, and application logic must consider
• Manual interaction required to trigger failover/fail back.
Disaster Recovery
23
Disaster Recovery – Flexible topologies
Production appliance
Off-site DR appliance
Asynchronous replication
Flexible Config •As with HA, configuration is per queue manager – though with DR there is no concept of a ‘group’. •Each QM independently configures replication to a particular appliance. •E.g. could configure single ‘DR’ site covering live appliances at multiple sites
Mixed Test/DR appliance
Production appliance
24
Much more detail in…
3465A
Deploying a Highly Available Messaging Hub Using the IBM MQ Appliance
Mandalay Bay NORTH - South Pacific Ballroom I
Thu, 25-Feb 10:30 AM - 11:20 AM
25
Monitoring MQ on the appliance
Typically, third party (or other IBM product) tooling will already support MQ appliance queue managers without changes. This image shows Tivoli Remote Agent displaying queue and channel information from an appliance queue manager. Various third party vendors have already explicitly confirmed support (check with vendor for specific product information).
But there are also appliance specific features… 26
• To create, click hotspot
Configure the widget
Display appliance resource use Platform-wide or queue manager CPU, Disk, memory, etc
Select: Resource class/type/element Queue manager(s) to monitor
Choose Resource class CPU Data stores API Usage stats
Monitoring System Resources Chart ‘widgets’ and new API
27
Monitoring applications
Classic use cases for dedicated/specialised exit code is addressed by enhanced application ‘activity trace’ – dynamic publish subscribe API for inspection of application MQ activity.
Which applications make use of which resources (e.g. queues)
What is coming in off this set of channels right now?
How can I keep an audit log of all messages put by a particular
application?
28
Find out more
29
The IBM MQ Appliance is available in two models, to suit a range of performance and capacity requirements
– They’re not sold on a PVU basis – but approximately 420 & 1400 PVU
• Appliance is dedicated to running messaging server workload – No other workload (applications or middleware) – Performance should be predictable – Capacity planning should be easier
• Firmware comes pre-tuned for maximum messaging performance – Placement of workload, resource utilisation, etc.
• Performance report MPA1 now available – Based on firmware level 8.0.0.3, – Includes scenario driven examples and M2000A/B comparisons.
• Performance report MPA2 now available – HA and DR, including over increased latency connections
Performance and capacity reports
30
Dedicated appliance KnowledgeCenter – particularly covers differences from software MQ installations http://www-01.ibm.com/support/knowledgecenter/SS5K6E/welcome GitHub community with example remote configuration scripts https://github.com/ibm-messaging/mq-appliance RedBook (draft at time of writing), particularly useful for first time setup and hardware configuration http://www.redbooks.ibm.com/Redbooks.nsf/RedpieceAbstracts/sg248283.html
Online
31
Monday 10:30-11:30 3592 New MQ features
3452 Managing applications
12:00-13:00 2835 MQ on z/OS and Distributed
15:00-16:00 3470 Latest MQ z/OS features 2833 Where is my message? 3544 MQ Light in an MQ infrastructure
16:30-17:30 3573 Hybrid cloud messaging 2941 MQ Advanced
Tuesday 08:30-09:30 3540 The MQ Light API
12:00-13:00 3456 The IBM MQ Appliance
13:15-14:15 3499 Introducing Message Hub 3458 MQ Appliance administration
14:30-15:30 6432 MQ updates and futures (InnerCircle) 2849 Messaging feedback roundtable
16:00-17:00 3544 MQ Light in an MQ infrastructure 3513 MQ hands on lab
Wednesday 08:30-09:30 3602 Managing your MQ environment
12:00-13:00 3613 Designing MQ self service 6408 Hybrid messaging roadmap (InnerCircle)
13:15-14:00 3416 HA and DR with MQ 3433 Why secure your messaging?
15:45-16:30 3429 Securing MQ 2847 Meet the messaging experts
16:00-17:00 3508 MQ Light hands on lab
16:45-17:30 2275 Migrating to the IBM MQ Appliance
Thursday 08:30-09:15 3420 MQ Clustering
2931 Business agility with self service MQ
09:30-10:15 3479 MQ z/OS clusters and shared queue 3450 Optimising MQ applications 2849 Messaging feedback roundtable
10:30-11:15 3465 MQ Appliance high availability 3481 MQ z/OS messaging connectivity
11:30-12:15 3474 Active-active messaging 3537 Monitoring and managing MQ 3425 MQ publish/subscribe
Find us at the EXPO: Hybrid Integration peds 65-68
Check out the Hybrid Messaging sub topic under the Hybrid Integration topic for further customer and business
partner sessions
Hybrid Messaging from the IBM experts at InterConnect 2016 Sunday
14:30-15:30 6408 Hybrid messaging roadmap (InnerCircle)
Notices and Disclaimers
33
Copyright © 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM.
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.
Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided.
Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.
Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.
References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business.
Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.
It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law
Notices and Disclaimers Con’t.
34
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.
The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right.
IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®, FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®, StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.
Thank You Your Feedback is Important!
Access the InterConnect 2016 Conference Attendee Portal to complete your session surveys from your
smartphone, laptop or conference kiosk.