挖财的互联网金融技术实践与探索@upyun opentalk

42
挖财的互联网金融技术探索 陨石王福强 @FuqiangWang(http://afoo.me)

Upload: fuqiang-wang

Post on 17-Jul-2015

203 views

Category:

Technology


3 download

TRANSCRIPT

Page 1: 挖财的互联网金融技术实践与探索@upyun opentalk

挖财的互联网金融技术探索陨石☄王福强

@FuqiangWang(http://afoo.me)

Page 2: 挖财的互联网金融技术实践与探索@upyun opentalk

大连 杭州 阿里 挖财

金融 互联网 互联网金融

Page 3: 挖财的互联网金融技术实践与探索@upyun opentalk

挖财不仅仅只是一款记账app

Page 4: 挖财的互联网金融技术实践与探索@upyun opentalk

branch “互联⺴⽹网”

branch “⾦金融”

just merge, then we get “互联⺴⽹网⾦金融”?

Page 5: 挖财的互联网金融技术实践与探索@upyun opentalk

WE ARE STILL

THEN FOLLOWING …

Page 6: 挖财的互联网金融技术实践与探索@upyun opentalk

1. Separation Everywhere

Page 7: 挖财的互联网金融技术实践与探索@upyun opentalk

[ Micro ] Services Everywhere

SETTLEMENT

Page 8: 挖财的互联网金融技术实践与探索@upyun opentalk

Scale MySQL For Cashflow

Cobar != CobarClient

Naming Consistency Sucks Here

Page 9: 挖财的互联网金融技术实践与探索@upyun opentalk

Different Is Good

Page 10: 挖财的互联网金融技术实践与探索@upyun opentalk

2.Message Passing Everywhere

Page 11: 挖财的互联网金融技术实践与探索@upyun opentalk

Local Remote

Sync

Async

Page 12: 挖财的互联网金融技术实践与探索@upyun opentalk

RPC

DUBBO HTTP HARPY

Page 13: 挖财的互联网金融技术实践与探索@upyun opentalk

Commands & Events

Page 14: 挖财的互联网金融技术实践与探索@upyun opentalk

3. Async Everywhere

Latency, latency, latency

Page 15: 挖财的互联网金融技术实践与探索@upyun opentalk
Page 16: 挖财的互联网金融技术实践与探索@upyun opentalk

Taming

Throttling

Clustering

Hibernate

Page 17: 挖财的互联网金融技术实践与探索@upyun opentalk

Push is NOT so reliable _ Poll lives long

Page 18: 挖财的互联网金融技术实践与探索@upyun opentalk

Async Is Not Enough, Non-blocking Matters

• adbcj - < https://github.com/mheath/adbcj >

Page 19: 挖财的互联网金融技术实践与探索@upyun opentalk

4. Immutability Everywhere宁多勿缺

Page 20: 挖财的互联网金融技术实践与探索@upyun opentalk

Kafka As The Big Journals

• expiration after 1 month(default is 1 week)

• topics with hierarchy

• replicas first, partitions if needed

• http senders, tcp receivers

Page 21: 挖财的互联网金融技术实践与探索@upyun opentalk

Traveling Back…

• Logging,Logging,Logging…

• Trace Tables

• Event Sourcing

• Akka Persistence

Page 22: 挖财的互联网金融技术实践与探索@upyun opentalk

5. Security Everywhere

Page 23: 挖财的互联网金融技术实践与探索@upyun opentalk

5.1 Interception Everywhere

Page 24: 挖财的互联网金融技术实践与探索@upyun opentalk

同盾⻛风控

WAF

NFw

AUTH

⼈人⼯工

Page 25: 挖财的互联网金融技术实践与探索@upyun opentalk

5.2 Bulkheads Everywhere

Page 26: 挖财的互联网金融技术实践与探索@upyun opentalk

Guess, Why We Don’t Use Kafka Partitions Heavily?

Separation != Isolation

Page 27: 挖财的互联网金融技术实践与探索@upyun opentalk

5.3 Monitoring Everywhere

Page 28: 挖财的互联网金融技术实践与探索@upyun opentalk

do u mean IDS?

Page 29: 挖财的互联网金融技术实践与探索@upyun opentalk

From Zero to One

Page 30: 挖财的互联网金融技术实践与探索@upyun opentalk

From One To Manyzabbix

fluentd flume

Page 31: 挖财的互联网金融技术实践与探索@upyun opentalk

5.4 Switches Everywhere

Page 32: 挖财的互联网金融技术实践与探索@upyun opentalk

! " #

fallback direction

Page 33: 挖财的互联网金融技术实践与探索@upyun opentalk

Everywhere5.5 攘外不忘安内

Page 34: 挖财的互联网金融技术实践与探索@upyun opentalk
Page 35: 挖财的互联网金融技术实践与探索@upyun opentalk

Where U Going?

Page 36: 挖财的互联网金融技术实践与探索@upyun opentalk

6. Redundancy Everywhere

Page 37: 挖财的互联网金融技术实践与探索@upyun opentalk

Storage

• Taming MySQL As Per Our Needs

• Async Replication

• Multi-write

• Resort to proper commercial solutions

• If you are fucking rich ;-)

Page 38: 挖财的互联网金融技术实践与探索@upyun opentalk

Computation

• Binary Star

• Zookeeper As coordination service

• Clustering

• Zookeeper/DNS As Service Registry Service

• Raft/Paxos if great, but we can’t manage it well yet.

Page 39: 挖财的互联网金融技术实践与探索@upyun opentalk

7. Reactive EverywhereFinal Destination

Page 40: 挖财的互联网金融技术实践与探索@upyun opentalk

–I don’t fucking know who said it.

“No man ever steps in the same river twice”

Page 41: 挖财的互联网金融技术实践与探索@upyun opentalk

We are

here, !

but Still

on the

road ….

Page 42: 挖财的互联网金融技术实践与探索@upyun opentalk

still expecting

funny&amazing guys to

JOIN US!

Thank you~

让简历砸来得更猛烈些吧~, amen~ yunshi [在] wacai [点儿] com