how to use the powerpoint template - oracle · mysql fabric . connector . application . read-slaves...

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

最新动态：MySQL 新特性 2015-04-22

马楚成 MySQL Principal Sales Consultant [email protected]

Copyright © 2014, Oracle and/or its affiliates. All rights reserved.


Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

2

演示者

演示文稿备注

This is a Safe Harbor Front slide, one of two Safe Harbor Statement slides included in this template. One of the Safe Harbor slides must be used if your presentation covers material affected by Oracle’s Revenue Recognition Policy To learn more about this policy, e-mail: [email protected] For internal communication, Safe Harbor Statements are not required. However, there is an applicable disclaimer (Exhibit E) that should be used, found in the Oracle Revenue Recognition Policy for Future Product Communications. Copy and paste this link into a web browser, to find out more information. http://my.oracle.com/site/fin/gfo/GlobalProcesses/cnt452504.pdf For all external communications such as press release, roadmaps, PowerPoint presentations, Safe Harbor Statements are required. You can refer to the link mentioned above to find out additional information/disclaimers required depending on your audience.


周年纪念！5 年， 10年，20年

20 年: MySQL成立于1995

10 年: Oracle 领导 InnoDB

5 年: Oracle领导MySQL

3

演示者

演示文稿备注

Big round of applause for the community


甲骨文对MySQL近5年的管理更多的投资，更多创新

Jan 2010 今天

4

2x 工程人员 3x质量保证人员 2x支持人员

演示者

演示文稿备注

5 years since the acquisition, and we’ve come a very long way We have by far the largest MySQL development team in history


MySQL Enterprise Monitor 2.2

MySQL Cluster 7.1

MySQL Cluster Manager 1.0

MySQL Workbench 5.2

MySQL Database 5.5

MySQL Enterprise Backup 3.5




All GA!

Oracle Products Certifications

MySQL Windows Installer

MySQL Enterprise Security

MySQL Enterprise Scalability

MySQL Enterprise Audit

MySQL Cluster 7.2


MySQL Utilities

MySQL Workbench 6.0

All GA!

MySQL Windows Tools

MySQL Database 5.6

MySQL Cluster 7.3


MySQL Workbench 6.1


MySQL Fabric

MySQL Workbench 6.2

MySQL Cluster 7.4

MySQL Database 5.7 RC*

*Development Milestone Release

All GA!

Available Now!

MySQL的推动创新: 2010 - 2015

Partial List of Releases Delivered

5

演示者

演示文稿备注

Since the acquisition, Oracle has delivered more products, at a higher quality, than at any time in MySQL history. MySQL 5.5 and 5.6 have been widely acknowledged as the best releases ever


5分钟的 MySQL 产品概述 www.youtube.com/MySQLChannel

MySQL Enterprise Edition 企业版 MySQL Cluster 集群

Oracle Confidential – Restricted 6


管理和监控加强功能支持

• Scalability • High Availability • Security • Audit • Encryption • Firewall

• Monitoring • Backup • Development • Administration • Migration

• Technical Support • Consultative Support • Oracle Certifications

MySQL Enterprise Edition

7


MySQL最新动态 • MySQL Security

– MySQL企业防火墙Enterprise Firewall in 5.6.24 – MySQL企业加密Enterprise Encryption

• Monitoring – Oracle Enterprise Manager – MySQL Plugin

• MySQL Fabric 1.5 GA

• MySQL Workbench 6.2 GA • MySQL Cluster 7.4 GA – What’s New • MySQL 5.7 RC – What’s New

Early Lab Release (labs.mysql.com)

8

MySQL Security Oracle Enterprise Manager – MySQL Plugin GA MySQL Fabric 1.5 GA MySQL Workbench 6.2 GA MySQL Cluster 7.4 GA MySQL 5.7 RC

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal 9

MySQL的安全性概述认证 Authentication

授权 Authorization

加密 Encryption

防火墙 Firewall

MySQL安全性

审计 Auditing

GA

GA



MySQL Enterprise Encryption Standards Based Cryptography

• MySQL的加密库 –对称加密AES 256 –公共密钥/非对称加密

• 密钥管理 –生成公钥和私钥 –密钥交换方法: RSA, DSA, DH

• 签名和数据验证 –加密散列为数码签名，验证和确认

10

GA


MySQL Enterprise Firewall • 实时保护

–查询分析，并通过White List

• 阻止SQL注入攻击SQL Injection • 阻止可疑流量

–阻止并侦测政策以外的交易

• 学习/记录White List –对用户以SQL命令自动创建批准列表

• 透明 –无需更改应用程序

11

MySQL Enterprise Firewall monitoring


MySQL Enterprise Firewall • 阻止SQL注入攻击SQL Injection

12

• 侦测和封锁发政策以外数据库事务 • 日志记录与分析

Select *.* from employee where id=22

Select *.* from employee where id=22 or 1=1 封锁和记录 ✖

允许和记录 ✔

White List Applications


• 通过 Dashboard 统一管理 Oracle stack (Web和云平台)

• 大约70 ％ Oracle客户，同时使用MySQL –对于Web ，开发的，部门和嵌入式应用 – #1 整合要求

13

Oracle Enterprise Manager – MySQL监控 GA



MySQL Fabric 1.5 (HA)高可用性和分片 (Sharding)

• 高可用性 – Server monitoring; auto-promotion and transparent

application failover

• 分片进行横向扩展 – Application provides shard key

• Integer, date or string

– Range or Hash – Tools for resharding

• Fabric-aware connectors [Python, Java, PHP, .NET, C (labs)] – 更低的延迟，避免瓶颈

MySQL Fabric

Connector

Application

Read-slaves

SQL

HA group

Read-slaves

HA group

Connector

Application

14

GA MySQL Security Oracle Enterprise Manager – MySQL Plugin GA MySQL Fabric 1.5 GA MySQL Workbench 6.2 GA MySQL Cluster 7.4 GA MySQL 5.7 RC

演示者

演示文稿备注

“date” and “string” are highlighted as this is new in 1.5


• Fabric 分片 – Fabric node-浏览，查看，连接

• Performance Dashboard – 查看实时服务器性能 – Performance Schema报告和图表

• Visual Explain – 图表条目查询计划

• 地理信息系统浏览器GIS Viewer [5.7] – 可以“地图”作为视化查询结果

• 迁移 – New Microsoft Access – Microsoft SQL Server, Sybase, PostgreSQL

• Metadata Locks (MDL) View [5.7] – Shows Blocked and Waiting On

• Shared Snippets – Centralized SQL template repo

• Native 64 bit Windows & Linux

MySQL Workbench 6.2

17

GA MySQL Security Oracle Enterprise Manager – MySQL Plugin GA MySQL Fabric 1.5 GA MySQL Workbench 6.2 GA MySQL Cluster 7.4 GA MySQL 5.7 RC http://dev.mysql.com/doc/workbench/en/wb-what-is-new-62.html

http://zh.wikipedia.org/wiki/%E5%9C%B0%E7%90%86%E4%BF%A1%E6%81%AF%E7%B3%BB%E7%BB%9F


MySQL Cluster 7.4 GA – February 26, 2015

18

http://www.oracle.com/us/corporate/press/2431648



MySQL Replication

MySQL Fabric

DRBD

Windows/Solaris/Clusterware Clustering or Oracle VM

MySQL Cluster

MySQL HA Solutions

19th February 2015

Getting Higher & Higher Availability

Copyright 2015, Oracle and/or its affiliates. All rights reserved 19


MySQL Cluster NDB Engine History

NDB Engine 2003

…………. 6.2GA Sep2007

6.3GA Jan2008

7.0GA April2009

7.1GA April2010

7.2GA Based on MySQL

5.5 Feb2012

7.3GA – Based on MySQL

5.6 June2013

7.4 GA Feb 015

February 2015 Copyright 2015, oracle and/or its affiliates. All rights reserved 20


MySQL Cluster 架构

MySQL Cluster Data Nodes

Clients

Application / MySQL节点

数据节点

Copyright 2015, oracle and/or its affiliates. All rights reserved 21

演示者

演示文稿备注

Arch behind cluster. Apears as 1 logical database to app and developers, connect to any node, query is routed Under covers, 3 types of nodes – intelligence in data nodes. Tables auto-sharded across commodity h/w. Each data node manages a shard or fragment of the db. Creates a replica – all updates sync replicated between replicas. If failure, failover less than 1 sec. Data nodes handle all cluster membership, failover and recovery Connect to data nodes via Application layer, via MySQL Server, Could use one of NoSQL APIs, so these are cluster libraries embedded into your app All multi master, so update from any node in app layer instantly available to any other node


MySQL Cluster架构

MySQL Cluster Data Nodes

Clients

数据节点


Application / MySQL节点

演示者

演示文稿备注

Arch behind cluster. Apears as 1 logical database to app and developers, connect to any node, query is routed Under covers, 3 types of nodes – intelligence in data nodes. Tables auto-sharded across commodity h/w. Each data node manages a shard or fragment of the db. Creates a replica – all updates sync replicated between replicas. If failure, failover less than 1 sec. Data nodes handle all cluster membership, failover and recovery Connect to data nodes via Application layer, via MySQL Server, Could use one of NoSQL APIs, so these are cluster libraries embedded into your app All multi master, so update from any node in app layer instantly available to any other node


MySQL Cluster 7.4 GA

• 200 Million NoSQL Reads/Sec

• 2.5M SQL Ops/Sec • 50% Faster Reads • 40% Faster Mixed

Performance

• Active-Active Geographic Redundancy

• Conflict Detection/Resolution

Active-Active

• 5X Faster Maintenance Ops

• Detailed Reporting

Management



Performance Enhancements MySQL Cluster 7.4

50% Read-Only Increase


40% Read/Write Increase

演示者

演示文稿备注

This chart shows the nodal speedup against MySQL Cluster 7.3 and *not* scalability as you add more nodes 48-core (96 CPU threads) HW. Table scans speed up more than PK access - More work done between each real-time break 8 LDM’s 8 Sysbench Tables 8 Partitions per table 6 Cluster connections


什么是冲突？

John.balance==$100

John.balance-=$40 John.balance==$60

John.balance==$200

John.balance==$100

John.balance+= $100 John.balance==$200

John.balance==$60

花费$40 存款$100

$60 $200



如何使用冲突检测和解决

决定哪些表需要保护

对于每个表，指定有什么的冲突

在例外表中记录应用程序/DBA来处理异常数据

回滚冲突的数据行

回滚冲突的交易



Demo


simple1 (10)

simple2 (10)

simple3 (10)

simple1 (10)

simple2 (10)

simple3 (10)

simple1 (10) (13)

STOPPED

simple1 (10) (20) simple2 (10) (20)

simple3 (10) (20) OK (no stop) simple1 (10) (20) simple2 (10) (20)

simple3 (10) (20) ????

Exception

simple1 (13), simple2(10), simple3(20) simple1 $EX(10->20), simple2$EX(10->20)

Started

simple1 (13), simple2(10), simple3(20)

simple1 (10) (20) simple2 (10) (20)

Rollback


MySQL Cluster: Active-Active Geo-Replication • 异步复制 between MySQL Clusters • Active-Active

–不浪费资源 - Update anywhere –冲突检测

• 通过异常表通知，应用可以处理

–自动解决冲突

• 无需更改应用架构

28

演示者

演示文稿备注

This is actually an existing feature but it has evolved over the years based on user feedback in Cluster 7.4 we consider it a complete solution.


MySQL Cluster 7.4重新启动的改善

• 长时间维护时间一般是由于数据节点重启时间 • MySQL Cluster 7.4 = 5.5X 重新启动更快 • 对节点和滚动重启，缩短时间

–升级，添加节点，

• 有利于“手动”或MySQL集群管理器操作 (MCM) • 缩短了维护时间5倍

使数据节点(Data Node)重新启动更快！



MySQL 5.7(RC)候选发布版已经推出！

30

增强的InnoDB:更快的在线数据库和大容量装载操作更快

复制的新加和增强功能(incl. 多源, 多线程的从属服务...)

新的优化器 Cost Model:更大的用户控制和更好的查询性能

Performance Schema 优化

MySQL SYS Schema

性能和可伸缩性可管理性

跟MySQL 5.6比较快2 倍

提高安全性：安全初始化，设置和管理

NEW! JSON Support (now in labs)

RC

And many more new features and enhancements...add link to blog here



0

100,000

200,000

300,000

400,000

500,000

600,000

700,000

8 16 32 64 128 256 512 1,024

Que

ries p

er S

econ

d

Connections

MySQL 5.7: Sysbench Read Only (Point Select)

MySQL 5.7

MySQL 5.6

MySQL 5.5

MySQL 5.7: Sysbench Benchmark

Intel(R) Xeon(R) CPU E7-4860 x86_64 4 sockets x 10 cores-HT (80 CPU threads) 2.3 GHz, 512 GB RAM Oracle Linux 6.5

2x Faster than MySQL 5.6 3x Faster than MySQL 5.5

645,000 QPS

32

演示者

演示文稿备注

Huge performance gains


MySQL 5.7: InnoDB, NoSQL With Memcached 6x Faster than MySQL 5.6 Thank you, Facebook

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

8 16 32 64 128 256 512 1,024

Que

ries p

er S

econ

d

Connections

MySQL 5.7 vs 5.6 - InnoDB & Memcached

MySQL 5.7

MySQL 5.6

1 Million QPS

33

Intel(R) Xeon(R) CPU E7-4860 x86_64 4 sockets x 10 cores-HT (80 CPU threads) 2.3 GHz, 512 GB RAM Oracle Linux 6.5


• 优化器(Optimizer)和分析器(Parser)重构 – 提高了可读性，可维护性和稳定性

– 可以更容易的功能增加，与降低风险

• 新提示(Hints)框架 – 支持更多的Hints

• 改进的JSON EXPLAIN • 对运行的线程-EXPLAIN

• 新 - 基于成本的优化器

• 对新增的/增强的功能支持 – Generated Columns – InnoDB based internal temp tables – ONLY_FULL_GROUP_BY mode – InnoDB & GIS – 等等

执行查询更快，同时使用更少的CPU和磁盘空间!

MySQL 5.7:优化器 (Optimizer)改善

34


0

20

40

60

80

100

Q2 Q18

Exec

utio

n tim

e re

lativ

e to

5.6

(%)

CPU bound

5.65.7

Optimizer Cost Model:性能改进 DBT-3 (SF10)

2 out of 22 queries get an improved query plan

0

20

40

60

80

100

Q2 Q18

Exec

utio

n tim

e re

lativ

e to

5.6

(%)

Disk bound

5.65.7

演示者

演示文稿备注

Does this have any real effect? Here Is the result from running DBT3 again. 2 out of 22 queries have improved query plans. Here I also have included the results when data is not in the InnoDB buffer. Look at for instance Q2, the time for running this query has gone from almost 3 minuttes to about 1 second. For Q18 the execution time has gone from 20 minutes to 40 seconds.


MySQL 5.7: Optimizer -成本信息 JSON EXPLAIN • JSON EXPLAIN

–包括所有可用的成本信息 –在MySQL Workbench, 可以使用Visual

Explain

36

{ "query_block": { "select_id": 1, "cost_info": { "query_cost": "200.40" }, "table": { "table_name": "nicer_but_slower_film_list", "access_type": "ALL", "rows_examined_per_scan": 992, "rows_produced_per_join": 992, "filtered": 100, "cost_info": { "read_cost": "2.00", "eval_cost": "198.40", "prefix_cost": "200.40", "data_read_per_join": "852K" }, "used_columns": [ "FID", "title", "description", "category", "price", "length", "rating", "actors" ], ...

MySQL Workbench


Memory Instrumentation

• 聚集统计数字 – 使用的内存类型(caches,

internal buffers, …) – Thread/account/user/host间接执行存储器操作

• 属性包括： – 使用的内存（bytes） – 操作计数 – High/Low Water Marks

Statement Instrumentation

• Stored Procedures

• Stored Functions

• Prepared Statements • Transactions

附加信息

• 复制从站状态

• MDL锁仪表

• 每个线程的用户变量

• 服务器阶段跟踪 • 跟踪长时间运行的SQL • 同时减少占用空间和开销

MySQL 5.7: Performance Schema 提升

37


过去和现在.. MySQL Performance Schema

• MySQL 5.5

• Only waits events – Mutex waits – Conditions waits – R/W locks waits – File I/O waits

• Setup_(timers/consumers/instruments) tables

• Few summary tables

• 17 Tables and 218 Instruments

• MySQL 5.6

• Statements and stages

• Table, Index and network I/O. Table locks

• Host Cache

• User, account, host

• Setup_(actor/objects)

• Multiple summary tables

• Events’ hierarchy


• MySQL 5.7 (RC)

• Instrumentation: – Transactions – Metadata locks – Prepared statements – Stored programs – Memory usage

• User variables

• Replication summary tables


• …

38


MySQL SYS Schema 对于数据库管理员，开发人员和操作人员辅助对象

• 有助于简化DBA/ OPS任务 – 监控服务器的运行状况，用户和/或主机的统计数据，和其他关键指标

– 诊断和调整性能问题

• 提供简单易懂的看法与意见 – IO热点，锁定和昂贵的SQL语句 – Schema, table and index statistics

• SYS是类似于 – Oracle V$ catalog views – Microsoft SQL DMVs (Dynamic Mgmnt Views)

39


• Native Partitioning 分区 – 减少资源(内存）的使用问题 – 支持Transportable tablespace

• Native全文搜索 – 支持CJK（中日韩）!

• Native Spatial Indexes 地理空间索引 • 支持 innodb_page_size = 32K and 64K

• General TABLESPACE support – create table tbl_name

TABLESPACE=‘tblspace_name’

• 高速缓存预载的增强支持 – 在启动时加载热数据

• 配置fill-factor “MERGE_THRESHOLD” – 减少存储占用空间

• 提高大容量数据加载性能 – Redologging OFF –支持创建全文索引 –“sorted index build”

MySQL 5.7: InnoDB 功能提升

40


MySQL 5.7: InnoDB – 永远在线 • 在线调整InnoDB的缓冲池

–允许DBA调整缓冲区的大小没有任何停机 –实时适应变化数据库的使用模式

• 独立的UNDO tablespace – With automatic online truncation

• 其他在线ALTER TABLE支持 –加大VARCHAR, Rename Index

• 动态配置 –使现有设置动态配置 –作为新的功能和设置设计的原则

41


• GTID增强 – 上线，分阶段部署GTIDs – 无需启动从机二进制日志

• 增强的半同步复制 – 无损数据复制

• 多源复制 – 整合来自多个主机数据

• 动态过滤器

• 从机的吞吐量是以前的8倍 – 从删除的瓶颈 – 避免从机的瓶颈 – 跟上主机与8+从属线程 – 选择保存COMMIT排序 – 自动从交易重试

MySQL 5.7: Replication功能提升

42


• 无存储共享的多主数据库同步系统

• 多主随时随地更新

• 自动组员管理和故障检测

MySQL Group Replication 多主同步复制

应用

MySQL 主机 Replication Plugin

API

MySQL Server

Group Comms (Corosync)

43

labs.mysql.com


• 重写使用Boost.Geometry – 对于空间计算 – 空间分析 – 启用完全符合OGC

• GeoHash

• GeoJSON

• 辅助功能，诸如ST_Distance_Sphere（）和ST_MakeEnvelope（）

MySQL 5.7: GIS 改进

44

演示者

演示文稿备注

Started out as the Generic Geometry Library by OSGeo. Now it’s of course part of Boost.


总结

45

分享了MySQL新动态

• MySQL Security • Oracle Enterprise Manager – MySQL Plugin GA • MySQL Fabric 1.5 GA • MySQL Workbench 6.2 GA • MySQL Cluster 7.4 GA • MySQL 5.7 RC


MySQL 5.7(RC)候选发布版已经推出！

46

性能和可伸缩性可管理性

RC

InnoDB - 更好的事务吞吐量，可用性，提升IO能力 Replication - 更好的可伸缩性和可用性 Fabric - 高可用性和分片 Performance Schema新加的和改进的性能指标 Optimizer -更好EXPLAINing,分析,查询性能 GIS与InnoDB的空间索引和Boost.Geometry整合

可以立即下载！ dev.mysql.com/downloads/mysql/

how to use the powerpoint template - oracle · mysql fabric . connector . application . read-slaves...

Documents