in-memory data grids essentials. oracle coherence

Scalable eCommerce Platform Solutions

In-Memory Data Grids Essentials. Oracle CoherenceVladimir KondraschenkoMax Myslyvtsev

About me

Vladimir Kondraschenko

• Lead Java engineer• More than 10 years of hands on experience in

– software design and coding– technical leadership– development management

vkondraschenko@griddynamics.com

Agenda

• Preconditions of using IMDG• Architecture overview– topology– distributed cache layer– local cache layer

• Cache operations• Persistence integration• Tips

Different Solutions

Coherence

Preconditions of Using IMDG

• Big amounts of data (10-100 GB)• Low latency• High availability• Distributed calculations

Transport

Local Data

Architecture Layers

Transport

Local Data

Transport

Local Data

Transport

Local Data

Transport

Local Data

Shared Data

Scalable eCommerce Platform SolutionsScalable eCommerce Platform Solutions

Transport LayerDiscovery and communication

IMDG Topology

Discovery• Multicast• Well-known address

Communication• Custom protocols over TCP or UDP• Senior node• Heartbeats

– Cluster heartbeats– Node heartbeats

Senior

Node Departure• TCP Ring• IP monitor• Timeout

Node Departure• TCP Ring• IP monitor• Timeouts

Box1: IP 177.230.14.5

IP ping

Node Departure• TCP Ring• IP monitor• Timeout

Shared Data LayerCluster-wide data

Distributed Cache

Cluster

Client Node

Cache Interface

Storage Node

Data Storage

Cache Interface

Cache Topology

• ReplicatedStorage 1

Storage 2

Storage 3

Storage 1

Storage 2

Storage 3

• Partitioned

Storage 3

Repartitioning

Storage 1

Storage 3

Storage 2

CAP Theorem

Coherence Coherence

Get/Put/Remove, Query, Invocation, Map-Reduce

Cache operations

Key hashing

Cache Operations: Put/Get

Storage 1 Storage 2

Client

Primary A

A B C D E F

• Client knows responsible storage– Key hash is used to find it

• Automatic backups

Backup A

Backup F Primary F

Storage 2Storage 2Storage 1

Cache Operations: Query• Broadcast request

– Unless Query is Key-Associated• All entries are evaluated

– Unless Indexes are used

field1=10 or field2>70field1=10 and key=A

key:field1:field2:

Cache Operations: Invocation/Entry Processor• Task is serialized and distributed

– May contain additional data• Configurable execution scope

– Specific nodes– All nodes– Nodes bound to data

Node 1 Node 2

Task Task

Client

• Data-bound mapping– By keys– By Query

• Parallel execution

Storage 2Storage 1

key:field1:field2:

Cache Operations: Map-Reduce

sum(field2) where field1>20

40 60 80

key:field1:field2:

Persistence integration

Synchronous Persistence Integration

• Read-through

• Write-through

StorageClient Durable Storage

Data Grid

Client Durable Storage

Data GridStorage

• Refresh-ahead

• Write-behind

Asynchronous Persistence Integration

Storage QueueClient Durable Storage

Data Grid

Storage QueueClient Durable Storage

Data Grid

Local Data LayerNode-specific data

Storage Storage

Near Caching• Local access by primary key• Lazy population• Invalidation

– On entry change– By timeout

Near Cache

Distributed Cache

Continuous Caching• Local access by any Query• Eager population• Near real-time data

Storage Storage

Continuous Cache

Distributed Cache

TipsUsing Oracle Coherence in practice

Before integrating Oracle Coherence• Do I really need IMDG or just a cache?• How large my cluster should be?• How much heap memory should be

configured for each node?• What GC configuration to use?• Do I have a relevant environment

to test my application?

Memory usageLimit cache size• By binary size (per node)• By number of objects in cache (per node)

Estimate cache object memory consumption• Use BinaryMemoryCalculator• Remember about backup copies• Cache listeners (near cache, custom)

Investigation & troubleshooting• Coherence Management Framework (JMX)

– view cluster and nodes settings– list caches (front and back) on each node– view cache dynamic metrics

• Coherence command-line tool– manage cache services– manipulate cache data

• Profiling and heap analysis– analyze heap dump– analyze GC logs

Thank you!Questions & Answers

References• Workshop

– https://github.com/mmyslyvtsev/imdg-workshop• Coherence Knowledge Base

– http://coherence.oracle.com• Developers Guide

– http://docs.oracle.com/cd/E18686_01/coh.37/e18677/toc.htm• Book

– http://www.amazon.com/Oracle-Coherence-3-5-Aleksandar-Seovic/dp/1847196128

in-memory data grids essentials. oracle coherence

query

cache

oracle

storage 2

storage 3

field2

field1

node

Software

smart grids and energy storage - rvo.nl grids and energy...

smart grids. more efficient and reliable grids

soft-shake.ch - data grids and data grids

coherence and cohesion in writing - radio … · ielts...

smart grids more efficient and reliable grids

lecture 3 interference, diffraction, coherence, refraction...

4 unit - pallaviwankhede2019.files.wordpress.com · 4 unit...

hanzi grids hanzi grids hanzi...

meet the grids - web design using grids

coherence, truth, and the development of scientific...

coherence gettingstarted

cache coherence techniques - dipartimento di...

coherence and fringe localization -...

[coherence] coherence 모니터링 v 1.0

smart grids and micro grids

brand coherence

parallel programming on computational grids. outline grids...

optical coherence tomography and optical coherence ... ·...

adobe indesign -...

electronic coherence, vibrational coherence, and solvent...