oracle linux nov 2011 webcast

39
<Insert Picture Here> WEBCAST: New Innovations in Oracle Linux Elena Zannoni, Director, Languages and Tools,Linux Engineering, ORACLE Chris Mason, Director, Linux Kernel Engineering, ORACLE

Upload: terry-wang

Post on 18-Dec-2014

349 views

Category:

Technology


1 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Oracle Linux Nov 2011 Webcast

<Insert Picture Here>

WEBCAST: New Innovations in Oracle Linux

Elena Zannoni, Director, Languages and Tools,Linux Engineering, ORACLEChris Mason, Director, Linux Kernel Engineering, ORACLE

Page 2: Oracle Linux Nov 2011 Webcast

2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Insert Information Protection Policy Classification from Slide 82 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle' products remains at the sole discretion of Oracle.

Page 3: Oracle Linux Nov 2011 Webcast

3 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Oracle Linux - Strategy

● Deliver the best performing, most modern and reliable Linux operating system for the enterprise

● Enhanced with features and improvements from mainline Linux development

● Full stack tested with real world workloads

● Offer enterprise class support at low cost

● Ensure Oracle Linux customers have full legal protection with complete indemnification

● Influence Linux roadmap upstream via direct community involvement

Page 4: Oracle Linux Nov 2011 Webcast

4 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Oracle Linux Leadership

GlobalSupport in 145

Countries

GlobalSupport in 145

Countries

#1 LinuxDatabase#1 LinuxDatabase

Pre-installedon Sun x86Hardware

Pre-installedon Sun x86Hardware

OracleProduct

Developmenton Linux

OracleProduct

Developmenton Linux

OracleValidated Con-

figurations

OracleValidated Con-

figurations

LinuxContributions

LinuxContributions

Page 5: Oracle Linux Nov 2011 Webcast

5 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Comprehensive Linux Solution

● Dedicated development team

● Dedicated QA team

● Dedicated support team

● Dedicated ISV and IHV team

● Oracle Linux training and certification

● Oracle Linux consulting services

Page 6: Oracle Linux Nov 2011 Webcast

6 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Roadmap and Releases

● Continue to track RHEL releases with Oracle Linux ISO releases and errata stream

● Unbreakable Enterprise Kernel release stream with yearly kernel updates tracking mainline

● 9 month grace period

● Allows customers to move to the next release on their own schedule

● Customer can stay on the same kernel release for 21 months

● Quarterly driver updates

Page 7: Oracle Linux Nov 2011 Webcast

7 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Mainline Linux Kernel

● In the last year (since 2.6.36)● 63,584 commits

● 1,570,669 new lines of code

● Roughly 1200 contributors to each release

● Each day● 164 new commits

● 4,000 new lines of code

Page 8: Oracle Linux Nov 2011 Webcast

8 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Mainline (are we done yet?)

● New hardware brings massive scalability changes and challenges

● High IOP/s networking and storage

● 200 IOP/s disks vs 250,000 IOP/s flash

● Dramatic bottlenecks in large SMP systems

● Performance is very dependent on power management

● Mainline kernels have changes to address performance on new hardware

Page 9: Oracle Linux Nov 2011 Webcast

9 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Unbreakable Enterprise Kernel R1

● Latest OFED stack (1.5.1)

● Advanced large NUMA system support

● Receive Packet Steering (RPS) and Receive Flow Steering (RFS)

● SSD detection

● Data Integrity up to SAN

● OCFS2 1.6

● Announced at OOW 2010

Page 10: Oracle Linux Nov 2011 Webcast

10 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Unbreakable Enterprise Kernel R2

● Version 2.6.39

● Based on upstream Linux Kernel 3.0.4

● Many scalability improvement and new features

● Beta release for Oracle Linux 6 at OOW 2011

● GA in CY2012

Page 11: Oracle Linux Nov 2011 Webcast

11 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Unbreakable Enterprise Kernel R2

● Transcendent memory

● Btrfs

● Resource Isolation – Cgroups

● OS Isolation – Linux Containers

● Transparent Huge Pages

● Pstore

● Transmit packet steering (XPS)

● Built in virtual switch

● Ksplice

Page 12: Oracle Linux Nov 2011 Webcast

12 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Backporting vs Tracking

● Backporting features

● Must be retested

● Result is different from upstream source

● Each backport makes future backports more complex

● Tracking mainline

● More consistent upstream testing required

● Entire stack should be tested for performance regressions

Page 13: Oracle Linux Nov 2011 Webcast

Distance from mainline

Page 14: Oracle Linux Nov 2011 Webcast

14 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

New Contributions

● ALL of Oracle's Linux kernel enhancements for The Unbreakable Enterprise Kernel are open source and have been made available to the Linux community.

● Git source tree with change logs and commit messages:

http://oss.oracle.com/git/?p=linux-2.6-unbreakable.git

Page 15: Oracle Linux Nov 2011 Webcast

What is DTrace? • A Solaris tool, available since 2005

• Allows static tracing using instrumentation compiled into kernel and applications

• Allows dynamic tracing by defining probe points 'on the fly'

• Probes and actions at probe points are defined by scripts written in the 'D' language

• Many types of providers, main ones are ● Dtrace: BEGIN, END, ERROR probes● Syscall: entry and exit of each system call● Profile: fires at specific time intervals (dynamic probes)● sysinfo, vminfo, fpuinfo, sched, io, iscsi, etc.: Static tracing in kernel: probes at

certain locations in subsystems● Pid: Static tracing in userspace applications: MySQL, Perl, Java● Pid: Dynamic tracing in userspace applications: can probe at every instruction in a

running process

• Speculative tracing: filter events and data presented to user after probes fired (uses intermediate holding buffer)

• Solaris documentation: http://www.oracle.com/technetwork/documentation/solaris-11-192991.html

Page 16: Oracle Linux Nov 2011 Webcast

Why DTrace on Linux

• Plethora of tools on Linux with different usage cases, syntax, data format and outputs

• Lack of integrated user space tracing solution for Linux

• Want to offer compatibility with existing DTrace scripts for Solaris

• Expertise of Solaris user and administrators can be reused on Linux

• Customer demand

Page 17: Oracle Linux Nov 2011 Webcast

DTrace on Linux• Initial release October 2011, version 0.1, still WIP

• Available on ULN channel: ol6_x86_64_Dtrace_BETA

• Userspace utilities RPM, and Kernel module RPMs

• Code posted here http://oss.oracle.com/git/● linux-2.6-dtrace-modules-beta.git● linux-2.6-dtrace-unbreakable-beta.git

• Functionality currently available: Dtrace provider, syscall provider

• Integrated with Oracle Unbreakable Enterprise Kernel:● Version 0.1 currently available on UEK 2.6.32

• x86_64 only

• Kernel changes are GPL

• Kernel Module is CDDL

• Testsuite ported

Page 18: Oracle Linux Nov 2011 Webcast

DTrace Next

• Profile provider• Static probes• Userspace application tracing• Move to UEK2 version 2.6.39 • Performance evaluation

Page 19: Oracle Linux Nov 2011 Webcast

19 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Ksplice

● Lets you install your important kernel updates with...

● No downtime

● No disruption

● No rebooting

● While applications are running

● Free with Oracle Linux Premier Support

Page 20: Oracle Linux Nov 2011 Webcast

20 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

How does it work?

Kernel update Zero downtime

kernel update

Customer systems

Client

Ksplice technology

Page 21: Oracle Linux Nov 2011 Webcast

21 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Deployment

● Get access key via ULN

● Super-easy installer:wget -N https://www.ksplice.com/uptrack/install-uptracksh install-uptrack YOUR_ACCESS_KEYuptrack-upgrade -y

● We email you when new updates are available

● Simple command-line tool for installing updates

● Rollback – updates can be reversed rebootlessly

Page 22: Oracle Linux Nov 2011 Webcast

22 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Installing New Updates[root@server ~]# uptrack-upgradeThe following steps will be taken:Install [1792zgqh] Clear garbage data on the kernel stack when handling signals.Install [q60l587z] CVE-2011-2491: Local denial of service in NLM subsystem.Install [rc7vca8p] CVE-2011-2492: Information leak in bluetooth implementation.Install [rwvu52id] CVE-2011-2495: Information leak in /proc/PID/io.Install [fn0egvef] CVE-2011-2497: Buffer overflow in the Bluetooth subsystem.Install [c6tugu59] CVE-2011-2517: Buffer overflow in nl80211 driver.Install [x4h2l5ob] CVE-2011-2695: Off-by-one errors in the ext4 filesystem.Install [d0ba3z30] CVE-2011-1576: Denial of service with VLAN packets and GRO.Go ahead [y/N]? yInstalling [1792zgqh] Clear garbage data on the kernel stack when handling signals.Installing [q60l587z] CVE-2011-2491: Local denial of service in NLM subsystem.Installing [rc7vca8p] CVE-2011-2492: Information leak in bluetooth implementation.Installing [rwvu52id] CVE-2011-2495: Information leak in /proc/PID/io.Installing [fn0egvef] CVE-2011-2497: Buffer overflow in the Bluetooth subsystem.Installing [c6tugu59] CVE-2011-2517: Buffer overflow in nl80211 driver.Installing [x4h2l5ob] CVE-2011-2695: Off-by-one errors in the ext4 filesystem.Installing [d0ba3z30] CVE-2011-1576: Denial of service with VLAN packets and GRO.Your kernel is fully up to date.Effective kernel version is 2.6.32-200.19.1.el6uek

Page 23: Oracle Linux Nov 2011 Webcast

23 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Ksplice Web Interface

Page 24: Oracle Linux Nov 2011 Webcast

24 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Btrfs – Features

● Designed for large files and file systems

● Simplified administration

● No volume manager needed

● Easy to add and remove capacity

● Online defragmentation / scrubbing

● Built in data integrity

● RAID

● Flexible

● File and file subvolume snapshots

● Transparent compression

Page 25: Oracle Linux Nov 2011 Webcast

25 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Btrfs – Recent developments

● LZO Compression

● Read-only snapshots

● Scrubbing with error correction

● Quickly find recent file changes

● Discard and Trim support

Page 26: Oracle Linux Nov 2011 Webcast

26 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Transcendent Memory – Cleancache

● Memory area to cache clean memory pages● Implemented on transcendent memory (tmem)● Eliminates costly disk reads● Shown to improve performance on a broad range of

workloads● Exposed via the VFS layer for easy integration with

existing file systems

Page 27: Oracle Linux Nov 2011 Webcast

27 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Compressed page cache (zcache)

● Cache that helps to keep more pages of the (filesystem) page cache longer in memory

● Provides additional cache using LZO compression and thus results in fewer disk I/O operations

Page 28: Oracle Linux Nov 2011 Webcast

28 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Resource Isolation – Cgroups

● Fine grained control of CPU, I/O and memory resources

● Protect memory for a given set of processes, e.g. CRS

● Pin processes to the same NUMA node and use NUMA-local memory

● DB consolidation on large NUMA servers

● I/O throttling support

● Device whitelisting

Page 29: Oracle Linux Nov 2011 Webcast

29 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

OS Isolation – Linux Containers

● OS Isolation via resource management (Cgroups)● Multiple userspace versions of an OS on the same

server● Isolated environments with own process and network

space● Lightweight, very low overhead

Page 30: Oracle Linux Nov 2011 Webcast

30 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Linux Containers – Isolated environments

IE IE IE

Linux Kernel

Root Root Root

Apps

System Libs

Apps

System Libs

Apps

System Libs

• Start/Stop

• Freeze• Create/Destroy

Page 31: Oracle Linux Nov 2011 Webcast

31 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Transparent Huge Pages

● Better supports memory management capabilities of modern CPUs

● Allows memory pages larger than 4kB (2MB)

● Frequently accessed virtual addresses for memory-intensive workloads can be better cached

● Much lower overhead to track page state

Page 32: Oracle Linux Nov 2011 Webcast

32 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Transmit packet steering (XPS)

● Spreads outgoing network traffic across CPUs on multiqueue devices

● Selects a transmit queue during packet transmission based on configuration by mapping the CPU transmitting the packet to a queue

● Analog to RPS (included in UEK R1): Where RPS is selecting a CPU based on receive queue, XPS selects a queue based on the CPU

Page 33: Oracle Linux Nov 2011 Webcast

33 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Other Scalability Improvements

● NUMA and lock contention optimizations throughout the kernel

● VFS: directory cache improvements for multi-threaded and single-threaded workloads

● Ext4, XFS, Btrfs improvements

● BKL (Big Kernel Lock) removal, replaced with much more fine-grained locking code

Page 34: Oracle Linux Nov 2011 Webcast

34 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Networking – Built in Virtual Switch

● Based on Open vSwitch

● Network virtualization

● Virtual Network Cards (VNICs)

● VLANs

● Virtual Switches

● Resource management

● QoS

● sFlow monitoring

● Distribution across multiple physical servers

● Can operate as soft switch within OS or control stack for switching silicon

Page 35: Oracle Linux Nov 2011 Webcast

35 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Oracle Linux Support

Page 36: Oracle Linux Nov 2011 Webcast

Next Steps

Page 37: Oracle Linux Nov 2011 Webcast

37 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Q&A

Page 38: Oracle Linux Nov 2011 Webcast

38 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Page 39: Oracle Linux Nov 2011 Webcast

39 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Insert Information Protection Policy Classification from Slide 8