java on zsystems zos

© 2014 IBM Corporation

1

IBM Java Technology for z/OS

27th April 2015

Tim EllisonRuntime Technology Center [email protected]

© 2014 IBM Corporation222

IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of other IBM trademarks is available on the web at "Copyright and trademark information" at http://www.ibm.com/legal/copytrade.shtml

Other company, product, or service names may be trademarks or service marks of others.

THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INFORMATION IS BASED ON IBM’S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE. IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, NOR SHALL HAVE THE EFFECT OF, CREATING ANY WARRANTIES OR REPRESENTATIONS FROM IBM (OR ITS SUPPLIERS OR LICENSORS), OR ALTERING THE TERMS AND CONDITIONS OF ANY AGREEMENT OR LICENSE GOVERNING THE USE OF IBM PRODUCTS OR SOFTWARE.

© Copyright International Business Machines Corporation 2011-2015. All rights reserved.

Trademarks, Copyrights, Disclaimers

http://www.ibm.com/legal/copytrade.shtml


Agenda

A gentle introduction to IBM's Java SDK

IBM SDK for Java & IBM zEnterprise – designed together for world-leading performance

A peek under the covers at how we optimize Java code on z Systems

APIs and enhancements explicitly for z/OS integration

Developer tools to enhance productivity

References and further reading


IBM's approach to Java SE technology

ReferenceJava

Technology

Oracle, opensource, etc

IBMJava

IBM RuntimeTechnology

Centre

Quality EngineeringPerformance

SecurityReliabilityScalability

Serviceability

Production Requirements

IBM Software GroupIBM eServer

ISVsIBM Clients

World class service and support

Available on more platforms than any other vendor

Optimised for IBM middleware and customer scenarios

Deep integration with hardware and software innovation

V a l u e - a d d e dp l a t f o r m s

O t h e rp l a t f o r m s

J 9 V i r t u a l M a c h i n e H o t s p o t V M

C o r e l i b r a r i e s

X M L C r y p t o C O R B A

X 8 6 x 8 6 - 6 4 P o w e r z A r c h L i n u x A I X z O S

W i n d o w s L i n u x L i n u x

x 8 6 - 6 4 S p a r c P A - R I S C i a 6 4S o l a r i s H P - U X

A W T S w i n g J a v a 2 d

XML Crypto Corba

“J9” Virtual machine


IBM invests in Java technology to make it ready for the most demanding business applications Performance

– Performance is key for all Java customers– IBM has decades of experience in performance engineering and cares deeply about creating high

performance, scalable solutions– We leverage this experience and close relationships with hardware, operating system and middleware

designers to drive best in class performance across our supported platforms

Security– IBM is a key contributor to Java and XML security standards– We offer FIPS certified JCE and JSSE providers and broad hardware crypto support

Reliability– Java is used in mission-critical applications– IBM has carefully redesigned the JVM, the engine at the heart of the Java runtime, for high reliability

Serviceability– In the event of failure, it is critical that problems can be found and isolated quickly– IBM focuses on trace and logging capabilities, first failure data capture, debugging and performance

interfaces and tools to ensure rapid problem resolution

Scalability – Highly configurable runtimes for a variety of application profiles– Pluggable interfaces with different implementations to match target requirements– Class library independence, new technology available on appropriate specification APIs


2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

A Bit of History: Java SE

7.06.0

• Performance improvements• Improved UI• Client WebServices Support• Jconsole monitoring• Collection framework enhancements

Java 6.0• New Language features

• Autoboxing• Enumerated types• Generics• Meta Data

Java 5.0

• Improvements in• Start up performance• Throughput performance• New Balanced GC• New feature in serviceability tooling• Soft Realtime evaluation• Performance exploitation of POWER7

z196™ ExploitationOOO Pipeline70+ New Instructions

JZOS/Security Enhancements

IBM Java 6.0.1 & 7.0• Improved performance

• Generational Garbage Collector• Shared classes support• New JIT technology

• First Failure Data Capture• Configurable Trace• Full Speed Debug• Hot Code Replace• Common runtime technology

• ME, SE, EE

IBM Java 5.0

• Small language changes• Improved IO APIs (NIO2)• Invoke Dynamic• Concurrency framework

Java 7.0

• Improvements in• Platform coverage• Performance• Serviceability tooling

• New Functionality• IBM WebSphere Real-

Time V1.0z10 ExploitationDFP exploitation for

BigDecimalLarge Pages

IBM Java 6.0

7.1

Standard Java Features

• Lambdas• Date and time

Type annotations• Profiles

Java 8.0

Improvements inPerformanceGC technology

zEC12 ExploitationTransactional executionRuntime InstrumentationFlash 1Meg pageable LPs2G large pagesHints/traps

Data Access AcceleratorCloud: Multi-tenancy/Virtualization

IBM Java 7.1

Additional IBM Java Features

8.0

6 7 8

6.01 & 7.0 865 7.1


IBM continues to offer quarterly service releases and APAR deliveries of Java 7, 6 and 5.● Ensures security fixes will be delivered rapidly to the field across all platforms.

Key dates● Java 5

● GA 2005● went out of currency in September 2013.● only receives customer and security fixes.● goes out of service in September 2015 (zOS Sept 2013).

● Java 6● GA 2007● will go out of currency in September 2015● receives platform & OS updates, as well as customer and security fixes.● goes out of service in September 2017 (zOS to be announced)

● Java 7● GA 7.0 2011, GA 7.1 2013● will go out of currency in September 2017● receives enhancements, platform & OS updates, as well as customer and security fixes.● goes out of service in September 2019 (zOS to be announced)

● Java 8• GA February 2015

• Receives enhancements, platform & OS updates, as well as customer and security fixes.

ref: http://www.ibm.com/developerworks/java/jdk/lifecycle/

IBM Java Service Schedule


IBM SDK for Java & IBM zEnterprise – designed together


zEC12 – New Hardware Enhancements for the IBM Java Runtime

Strong investment in Java on Z

Significant set of new hardware features tailored and co-designed with Java

Hardware Transaction Memory (HTM) Better concurrency for multi-threaded applicationseg. ~2X improvement to ConcurrentLinkedQueue

Run-time Instrumentation (RI)Innovative new hardware facility designed for managed runtimes Enables new expanse of JRE optimizations

2GB page framesImproved performance targeting 64-bit Java heaps

Pageable 1MB large pages using flashBetter versatility of managing memory

New software hints/directivesData usage intent improves cache managementBranch pre-load improves branch prediction

New trap instructionsReduce over-head of implicit bounds/null checks

New 5.5 GHz 6-Core Processor Chip

Large caches to optimize data serving

Second generation OOO design

Up-to 60% improvement in throughput amongst Java workloads measured with zEC12 and Java7SR3Engineered Together—IBM Java and zEC12 Boost Workload Performance

http://www.ibmsystemsmag.com/mainframe/trends/whatsnew/java_compiler/


IBM z13 and IBM Java 8 – designed together

Continued aggressive investment in Java on Z

Significant set of new hardware features tailored and co-designed with Java

Simultaneous Multi-Threading (SMT)– 2x hardware threads/core for improved throughput– Available on Integrated Information Processor (zIIP),

and Integrated Facility for Linux (IFL)

Single Instruction Multiple Data (SIMD)– Vector processing unit– Accelerates loops and string operations

Cryptographic Function (CPACF)– Transparently accelerate IBMJCE security provider – Block ciphering, Secure Hashing and Public Key

Cryptography

New Instructions

Up to 2X improvement in throughput per core for security enabled applications

Up to 50% improvement for generic applications

No applicationcode changes!

2

IBM Java 8 – (available March 6th, 2015**)

IBM SDK for z/OS, Java Tech. Edition, Version 8

New Java8 Language Features • Lambdas, virtual extension methods IBM z13 exploitation • Vector exploitation and other new instructions • Instruction scheduling General throughput improvements • Up-to 17% better application throughput • Significant improvements to ORB Improved crypto performance for IBMJCE • Block ciphering, secure hashing and public key

• Up-to 4x improvement to Public Key using ECC • CPACF instructions: AES, 3DES, SHA1, SHA2, etc

Significantly improved application ramp-up • Up-to 50% less CPU to ramp-up to steady-state • Improved perf of ahead-of-time compiled code Improved Monitoring • JMX beans for precise CPU-time monitoring Enhancements to JZOS Toolkit for Java batch

ASZ-2026 : Reasons to Love IBM Java and WebSphere Application Server on z Systems

** www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&supplier=897&letternum=ENUS215-004#


A peek under the covers:

How we optimize Java code for z Systems


Java Runtime Compilation : trade off effort and benefit

The VM searches the JAR, loads and verifies bytecodes to internal representation, runs bytecode form directly

After many invocations (or via sampling) code gets compiled at ‘cold’ or ‘warm’ level

An internal, low overhead sampling thread is used to identify frequently used methods

Methods may get recompiled at ‘hot’ or ‘scorching’ levels (for more optimizations)

Transition to ‘scorching’ goes through a temporary profiling step

cold

hot

scorching

profiling

interpreter

warm

Results can be stored for future runs and shared across invocationsXshareclasses

Java's intermediate bytecodes are compiled as required and based on runtime profiling- code is compiled 'just in time' as required- dynamic compilation can determine the target machine capabilities and app's demands

© 2014 IBM Corporation2 2

Example

Optimization level Code Size (bytes) Compilation Time (ms)

Wall clock runtime (ms)

Cold 139 2.2 31,685

Warm 265 4.9 10,078

Hot 436 8.9 7,765

Profiling 1,322 9.0 n/a

Scorching 578 11.0 6,187

public static int x = 55;

public static int compute(int i, int j, int[] a, int count) {int k = 0;for (int i = 0; i < count; i++) {

k = k + j + a[i] + (x * foo());}

return k;

}

public static int foo() {return 75;

}

Xjit:count=<n>, exclude={<method>}, limitFile=(<filename>, <m>, <n>), optlevel=[ noOpt | cold | warm | hot | veryHot | scorching ], verbose[={compileStart|compileEnd}], vlog=<filename>

IBM z13: SMT – Simultaneous Multi -Threading

SMT permits multiple independent threads to execute on a single core concurrently • Achieve more effectively utilization of processor resources

z13 SMT allows 2 threads-per-core to deliver better overall throughput for multiple concurrent workloads • Increases effective zIIP/IFL capacity • Doubles number of eligible threads

Threads share resources – may impact single thread perf • Pipeline (eg. physical registers, fxu, fpu, lsu etc) • Cache

Throughput improvement is workload dependent

Two zIIP lanes handle more traffic overall

4 ASZ-2026 : Reasons to Love IBM Java and WebSphere Application Server on z Systems

IBM z13: Vector Processing SIMD – Single Instruction Multiple Data

Operate on multiple data-elements (vectors) simultaneously • Can offer dramatic speed-up to data-parallel operations (matrix ops,

string processing, etc)

5 ASZ-2026 : Reasons to Love IBM Java and WebSphere Application Server on z Systems

Vector registers are 128-bits wide and can be used to operate concurrently on: • Two 64-bit floating point values • Four 32-bit floating point values • Sixteen 8-bit characters • Two 64-bit integer values • etc

6

Acceleration using SIMD with IBM Java 8 and z13

IBM z13 running Java 8 on z/OS Single Instruction Multiple Data (SIMD) vector engine exploitation

java.lang.String exploitation - compareTo - compareToIgnoreCase - contains - contentEquals - equals - indexOf - lastIndexOf - regionMatches - toLowerCase - toUpperCase - getBytes

java.util.Arrays - equals (primitive types)

String encoding converters For ISO8859-1, ASCII, UTF8, and UTF16 - encode (char2byte) - decode (byte2har)

Auto-SIMD - Simple loops

(eg. Matrix multiplication)

Primitive operations are between 1.6x and 60x faster with IBM Java8

(Controlled measurement environment, results may vary)



Data Access Accelerator (DAA) – in a nutshell

Data-centric tasks such as big data, analytics and inter-language communication require optimal performance for accessing and operating on native format data records and types from Java. Prefer to avoid object creation, data copying, abstraction, boxing etc

DAA provides a Java library for bare-bones data conversion, arithmetic etc.

Provides native-oriented operations directly on Java byte arrays

Orchestrated with JIT for deep platform optimization➔ No intermediate Java objects created when recognized by the IBM JIT ➔ Avoid expensive Java object instantiation by allowing in-place operations

Benefits:

Expose hardware acceleration in a platform and JVM-neutral manner (2 – 100x speed-up)

Can provide significant speed-up to record parsing frameworks

Can provide significant speed-up for data marshalling and inter-language communication


Data Access Accelerator – example

Problem: there is no intrinsic representation of a “packed decimal” in Java

Solution: trivially add two packed decimals by converting to BigDecimal:Step 1: convert from byte[] to BigDecimal

Step 2 : add BigDecimals together

Step 3: convert BigDecimal result back to byte[]

● IBM Java provides a helper method to do this operation for you:Old Approach:

byte[] addPacked(byte[] a, byte[] b) {

BigDecimal a_bd = convertPackedToBd(a[]);

BigDecimal b_bd = convertPackedToBd(b[]);

a_bd.add(b_bd);

return (convertBDtoPacked(a_bd));

}

BigDecimal convertPackedToBd(byte[] myBytes) {

… ~30 lines …

}

New Approach:

byte[] addPacked(byte[] a, byte[] b) {

DAA.addPacked(a[], b[]);

return (a[]);

}

e.g. you wish to add two packed decimal numbers

p.s. zSeries hardware has packed decimal machine instructions, e.g. AP (AddPacked)On IBM Java 7 Release 1, “DAA.addPacked(a,b)” is compiled to this one instruction!


z/OS Java Crypto Software Stack

CPACF or PCIe Card

Application Layer

Java Layer

Crypto Enablement Middleware Layer

Hardware Layer

PKCS11ImplIBMJCECCA

z/OS PKCS CertPath

JNI Layer PKCS11 CCA

z/OS

General Purpose CP or IFA(zAAP or zIIP)

Java Program

z/OS SW Crypto

ICSF RACF

z/OS

Java VirtualMachine (JVM)

Host OperatingSystem

IBMJCEIBMJSSE2

20


zEnterprise Data Compression (zEDC)

What is it? zEDC Express is an IO

adapter that does high

performance industry

standard compression

Used by z/OS Operating

System components,

IBM Middleware and ISV

products

Applications can use

zEDC via industry

standard APIs (zlib and

Java)

Each zEDC Express

sharable across 15

LPARs, up to 8 devices

per CEC.

Raw throughput up to 1

GB/s per zEDC Express

Hardware Adapter

Available from IBM Java 7R1 :Java applications compress files using java.util.zip.GZIPOutputStream class

Up to 91% reduction in CPU time using zEDC hardware versus zlib software

Up to 74% reduction in Elapsed time (not shown)

Compression ratio up-to ~5x


The results...

7

z/OS WAS 8.5.5.5 – SSL-Enabled DayTrader 3.0

2.6x improvement in throughput with IBM Java 8 and IBM z13



8 8

Mobile on z – z/OS Connect on IBM Java 8 and zEC12


5 - 16.4% throughput improvement from IBM Java 8 and IBM zEC12


9

IBM Business Rules Processing with IBM Java 8 and z13

Aggregate 2.1x improvement from IBM Java 8 and IBM z13



10

Java Store, Inventory and Point-of-Sale App with IBM Java 8 and z13

1.9x improvement in throughput with IBM Java 8 and IBM z13




APIs and enhancements explicitly for z/OS integration


z/OS – System z Java Extensions

IBM Java SDK provides deep integration with z/OS capabilitiesAccess to z/OS services

Access to all types of data

Access under control of z/OS security mechanisms

Integration into existing operational infrastructureSDKz/OS

Extensions

SDKBase

Function

e.g. JAAS wrapper of SAF (RACF, ACF2, or TopSecret), Traditional OS dataset access, Cryptographic hardware (Cards and CPACF), z/OS Console (modify and messages), z/OS system logger, JES job submission, DFSORT, SMF, etc.

Fully supported library extensions reduce the need to drop outside the Java environment to exploit native Z platform capabilities


Java powered environments and Interoperability

IBM Java Based Offerings– Transactional/Interactive

• WebSphere for z/OS (WAS z/OS)• WebSphere Process Server for z/OS (WPS)• JCICS• IMS Java• DB2 Stored Procedures

– Batch oriented• WebSphere Compute Grid (WAS-CG)

• WAS/JEE runtime extensions• IMS Java Batch regions (JMP)• JZOS component of z/OS SDK

• JES/JSE-based environment• z/OS V1R13 Java/COBOL Batch Runtime

Env.*• JES/JSE-based, designed to inter-op with DB2

while maintaining transaction integrity

Open Source or non-IBM vendor Application Server and Frameworks

– Tomcat, JBoss– iBatis, Hibernate, Spring– Ant

IBM Java drives a broad range of pre-existing assets, artifacts, processes, core competencies and platform strengths

COBOL/Native Interoperability– COBOL Invoke maps to JNI– RDz and JZOS** have tooling to map

COBOL copy books to Java classes– JCICS– IMS Java, JMP/JBP– WAS CG, WOLA– etc

* See http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&supplier=897&letternum=ENUS211-252

** Alphaworks only, and hence currently un-supported

http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&supplier=897&letternum=ENUS211-252






Developer tools to enhance productivity


Runtime Monitoring and Management Tools

Tools and documentation for application monitoring and problem diagnosis. Free unified suite of tools to understand different aspects of Java

applications. Lightweight, low performance overhead monitoring and diagnostics. Provide more than visualizations – also provide observations and

recommendations.

Tools in the IBM Monitoring and Diagnostic Tools Portfolio:

For More Information Visit:http://www.ibm.com/developerworks/java/jdk/tools/index.html

Interactive Diagnostic Data Explorer

Garbage Collection and Memory Visualizer

Memory Analyser

Health Centre


References and further reading


Customer experiences

Fiducia IT AG Manage more than 69 million accounts

at cooperative banks 17.1m current accounts 8.7m online accounts 3.8bn bookkeeping entries

Processing of 18.3bn host transactions Peak volume on 2.1.2012

103m host transactions/day 4,200 host transactions/sec.

Moving business logic into Java Main program was Cobol, so MPRs must be used Adopted IBM Java SE with JVM resident in the MPR Inter Language Communication (ILC) between Cobol and Java & Java calls Cobol

(cascading) Java, Cobol runs within the same transaction (UOW) with database support for:

DB2 from cobol and Java DL1 and MQ access from Java in a later step



Sparda

Workload consolidation onz196

ATMs & web banking

Presented their architecture and experiences at theIBM z Analyst Summit 2011



Health Care Service Corporation– Large US health insurance company

Migrating from WAS on z/OS V7.0 to V8.5.5.x using Java V6.0.1 canresult in up to 30% CPU saving, depending on what functionally your Application is using

Applications with small Heap size may benefit running in 31 bit mode

Take advantage on Pageable Large Page Support and Flash Express – we saw 4.4% CPU reduction

Tune your JVMs for optimum performance – we saw over 10% CPU reduction with proper tuning

Upgrade to WAS on z/OS V8.5.5.2 or higher and take advantage of Java V7.1– we observed 20% throughput improvement and 10-12% CPU reduction

Analyze your GC performance with PMAT or GCMV and watch out for Java OOM conditions, that can increase CPU usage considerably, due to excessive GC overhead


New and existing supported Java products – z/OS

IBM 31-bit SDK for z/OS, Java Technology Edition, Version 8– Web available on March 6, 2015– Product 5655-DGG, supported on z/OS V1.13 and above

IBM 64-bit SDK for z/OS, Java Technology Edition, Version 8– Web available on March 6, 2015– Product 5655-DGH, supported on z/OS V1.13 and above

Earlier Deliveries

– IBM 31-bit SDK for z/OS, Java Technology Edition, Version 7 Release 1• Web available on July 8, 2014• Product 5655-W43, supported on z/OS V1.12 and above

– IBM 64-bit SDK for z/OS, Java Technology Edition, Version 7.0• Web available on July 8, 2014• Product 5655-W44, supported on z/OS V1.12 and above

– IBM 31-bit SDK for z/OS, Java Technology Edition, Version 6.0.1• Web available on March 15, 2011 at Java SE 6 level• Product 5655-R31, supported on z/OS V1.10 and above

– IBM 64-bit SDK for z/OS, Java Technology Edition, Version 6.0.1• Web available on March 15, 2011 at Java SE 6 level• Product 5655-R32, supported on z/OS V1.10 and above

– IBM 31-bit SDK for z/OS, Java Technology Edition, Version 6.0.0• Web available on December 14, 2007 at Java SE 6 level• Product 5655-R31

– IBM 64-bit SDK for z/OS, Java Technology Edition, Version 6.0.0• Web available on December 14, 2007 at Java SE 6 level• Product 5655-R32

All products are delivered via the z/OS Java website in non-SMP/E format, and via ShopIBM in SMP/E format

All products are independently orderable and serviceable and follow the z/OS RFA rules for Withdrawal from Marketing and End of Service


Important references

z/OS Java web site– http://www.ibm.com/systems/z/os/zos/tools/java/

IBM SDK Java Technology Edition Version 7 Information Center– http://publib.boulder.ibm.com/infocenter/java7sdk/v7r0/index.jsp

IBM SDK Java Technology Edition Version 6 Supplement– http://public.dhe.ibm.com/common/ssi/ecm/en/zsl03118usen/ZSL03118USEN.PDF

JZOS Batch Launcher and Toolkit Installation and User’s Guide (SA38-0696-00) – For JZOS function included in IBM Java SE 7 SDKs for z/OS– http://publibz.boulder.ibm.com/epubs/pdf/ajvc0110.pdf

JZOS Batch Launcher and Toolkit Installation and User’s Guide (SA23-2245-03)– For JZOS function included in IBM Java SE 6 and SE 5 SDKs for z/OS– http://publibfi.boulder.ibm.com/epubs/pdf/ajvc0103.pdf