6/ · 2019. 6. 6. · oyi. =*ig@ ptrcmd ())papae )04 ,1t hig@ p9trcmfdpa e h9nh ),, nh )0 4,1 14 4...

28
© Copyright 2017 Pivotal Software, Inc. All rights Reserved. Version 1.0 6/ " &!$%# June 2019 Pivotal China

Upload: others

Post on 26-Nov-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

© Copyright 2017 Pivotal Software, Inc. All rights Reserved. Version 1.0

6/

June 2019

� � Pivotal China

Page 2: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

o● iG@ P TrC Md ())pa pae )0 4 ,1 t

● H iG@ P 9TrC m F d pa e

● H9 nh ),, nh)0 4 ,1 14 4 pa9 N e

● S H9 rgP ( ,, Lo

● D H eN n . , , , .. 51 Sl

● A rN r i mQ M rgP + )104 2 L 00 gPat

● D N O

● D O 9d F

● o 9 G

5 , 50 4 ,1 04

Page 3: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

O P

� ( B G

� I KQD IH LQ

� ( ( - / ( / (

� AD

� -

� (

� )

Page 4: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

6 LFJ:Ck v

u• Cloud Foundry: 8 B

,, o

• 11 0 1 ,0 ,27 (

6 LFJ:C F J: H HL 6

• 6 LFJ:C K J F HL 6:J L 8 J

• Greenplum: MPP DB

• 6FIJ H 74: OLTP• Gemfire: In-Memory Data Grid

• GH 2:L: H: MFHB

• r

• GH CFK ur

• w r

Pivotal Labs

i v k 6 LFJ:C m oQ J0K; 8 0:J 1,5 + $ FF C ecd+ $ ( P

wk $ ) % P R k P $ taP P (%

H GCK n p f bH GCK sSGFIJ H 74 sPl R sn H GCK sP g

Page 5: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

15��������, ��� ����������PostgreSQL�Greenplum

Page 6: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

� ����������� �� ������

Page 7: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

� ( DHG ITA

� K P G K S

� ( ( - / ( / (

� -

� (

� ( LB KQO

� )

Page 8: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

�����#�

���$���!�

● S● L● N L L● L

�������"���

●●● L L● Q L L

�� ������ �������

● L S

● L

● o

Page 9: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

* Be *

l A Ke uK I n r

B l b

s D*beta available, GA expected 6/30/19

G g• P D D

• 6 l m

• t l G B K prl D :

Page 10: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

6

b , U

h K

K

l Pp m AS r l

U G AMCi

G

e F h a c b

, Dno b�

Page 11: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

� ( DHG ITA

� K P G K S

� ( ( - / ( / (

� -

� (

� ( LB KQO

� )

Page 12: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

?

Pivotal Greenplum Database

#��MPP�� �����BI������

postgres&"%��"� � ���(��

�� ����Greenplum V5��$!50�)– GP V6 Beta 2019 6 .

Page 13: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

- - A CVH GTO

● b k● s u z● m GP5 r

50● s (ODS) W z

mLO T

● l lsegmentsL PU

d L a Segments

--

● O O I G J /A ● n● I G J /A S ● W ou -z

● Qz B3● , Qcx BA H AG

K

● y PostgreSQL 9.4(1N+ CodeCommit)

● KzDH K K G t tLt

● - l eL

● q L H CBAF FG AG ) F p

● (E AC H B A AG Eh qL p

k● EDH G f

● ( GE ) F /● i●

P6T D

P

Page 14: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

� ( DHG ITA

� K P G K S

� ( ( - / ( / (

� -

� (

� ( LB KQO

� )

Page 15: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

Ai I ruvs?Ppe Lg ? mQ

Apache MADlib

g g gltS

G a o n U

Page 16: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

$ 7 1

5 , Source: FICO

���(transparency)

���(������� �”��”)

����(binary prediction)

Fraud

OK

0 7 - %

Page 17: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

Data Transformation

Traditional BI

MachineLearning

GraphData ScienceProductivity Tools

Geospatial

Text

��� ����(<=1GB/�)

����� ���� �

���

Deep Learning

Page 18: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

© 2014 Pivotal Software, Inc. All rights reserved.

April 2018

Array and Matrix OperationsMatrix Factorization• Low Rank• Singular Value Decomposition (SVD)Norms and Distance FunctionsSparse VectorsEncoding Categorical VariablesPath FunctionsPivotSessionizeStemming

All Pairs Shortest Path (APSP)Breadth-First SearchHyperlink-Induced Topic Search (HITS)Average Path LengthCloseness CentralityGraph DiameterIn-Out DegreePageRank and Personalized PageRankSingle Source Shortest Path (SSSP)Weakly Connected Components

,Cross ValidationPrediction MetricsTrain-Test Split

Descriptive Statistics• Cardinality Estimators• Correlation and Covariance• SummaryInferential Statistics• Hypothesis TestsProbability Functions

:Neural NetworksSupport Vector Machines (SVM)Conditional Random Field (CRF)Regression Models• Clustered Variance• Cox-Proportional Hazards Regression• Elastic Net Regularization• Generalized Linear Models• Linear Regression• Logistic Regression• Marginal Effects• Multinomial Regression• Naïve Bayes• Ordinal Regression• Robust VarianceTree Methods• Decision Tree• Random Forest

• ARIMA

:Association Rules (Apriori)Clustering (k-Means)Principal Component Analysis (PCA)Topic Modelling (Latent Dirichlet Allocation)

Columns to VectorConjugate GradientLinear Solvers• Dense Linear Systems• Sparse Linear SystemsMini-BatchingPMML ExportTerm Frequency for TextVector to Columns

• k-Nearest Neighbors

Balanced/ Random/ Stratified Sampling

18

Page 19: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

����� �������� ������

U r AeTA

(

hy t( C

e)

, CMe s

R A

StandbyMaster

MasterHost

SQL

Interconnect

Segment HostNode1

Segment HostNode2

Segment HostNode3

Segment HostNodeN

GPU N

…GPU 1 GPU N

…GPU 1 GPU N

…GPU 1

…GPU N

…GPU 1

• dDQG leLgfno

• , C Me

• ( SwmP

• S

• iKTb PTS

• a N SF d

Page 20: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

� ( DHG ITA

� K P G K S

� ( ( - / ( / (

� -

� (

� ( LB KQO

� )

Page 21: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

����� ���������������������

���������������������������� ��� Pivotal Greenplum for Kubernetes

Page 22: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

● i C● t p● R● fh● & / :● : :

●●●

.● :●

●● D WG :● l : c ● ZJ c

I

C

r●●● K● v● a●

K8s ClusterK8s

Cluster

Greenplum Operator

GCEP ersistent DiskAWSElasticBlockStore

Vsphere Volume(formerlyScaleIO)Azure Disk

DA & . : eGnm

● ZJu

○ yrh

○ nmr s

○ L o r kN

● bP c F

Page 23: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

8 , 8(

t i

Gc r

D

p )8 ( ) (

D

Gok S

S n

vCI

v gf

)/ u

yK

d l

be

s

ma

Page 24: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

� ( DHG ITA

� K P G K S

� ( ( - / ( / (

� -

� (

� ( LB KQO

� )

Page 25: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

© Copyright 2017 Pivotal Software, Inc. All rights Reserved. Version 1.0

Pivotal Postgres DBaaS

Page 26: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

����������

Page 27: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

© 2015 Pivotal Software, Inc. All rights reserved.

HO

1 1

1

3AD

30 -- 2

SL

GBcf

push

OLTPDB for PCF

Database!

DBA

Page 28: 6/ · 2019. 6. 6. · oYI. =*iG@ PTrCMd ())papae )04 ,1t HiG@ P9TrCmFdpa e H9nh ),, nh )0 4,1 14 4 pa9 Ne [>%o0 S H9rgP ( ,, Lo [~H D HeN n%1W$'. , , ,M .. 51 S l ArNri mQMrgP + )

/

© Copyright 2019 Pivotal Software, Inc. All rights Reserved.