london - amazon s3and... · london ©2015, amazon web services, inc. or its affiliates. ... every...

LONDON

©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved


How the Cloud Enables Innovation

Frank DiGiammarino

General Manager, US State and Local Government

Worldwide Public Sector, Amazon Web Services

Deep experience in building

and operating global web

scale systems

About Amazon Web

Services

…get into cloud computing?

How did Amazon…

Administration

& Security

Access

ControlIdentity

Management

Key Management

& Storage

Monitoring

& Logs

Resource &

Usage Auditing

Platform Services

Analytics App Services Developer Tools & Operations Mobile Services

Data

Pipelines

Data

Warehouse

Hadoop

Real-time

Streaming Data

Application

Lifecycle

Management

Containers

Deployment

DevOps

Event-driven

Computing

Resource

Templates

Identity

Mobile

Analytics

Push

Notifications

Sync

App

Streaming

Email

Queuing &

Notifications

Search

Transcoding

Workflow

Core Services

CDNCompute(VMs, Auto-scaling

& Load Balancing)

Databases(Relational,

NoSQL, Caching)

Networking(VPC, DX, DNS)

Storage(Object, Block

and Archival)

Infrastructure

Availability

Zones

Points of

PresenceRegions

Enterprise

Applications

Business

Email

Sharing &

Collaboration

Virtual

Desktop

Technical &

Business Support

Account

Management

Partner

Ecosystem

Professional

Services

Security &

Pricing Reports

Solutions

Architect

s

SupportTraining &

Certification

Rich Set of Programmable Services

Scale of AWS

Every day, AWS adds the equivalent

server capacity to power Amazon when

it was a global, $7B enterprise

Lower Costs with AWS Up-Front and Increase Savings as

Your Usage Grows

Source: IDC Whitepaper, sponsored by

Amazon, “The Business Value of Amazon

Web Services Accelerates Over Time.”

July 2012

1

“Average of 400 servers

replaced per customer”

Replace up-front

capital expense with

low variable cost

2

48 Price

Reductions

Economies of scale

allow us to continually

lower costs

3

Pricing model choice

to support variable &

stable workloads

4

Save more money as

you grow bigger

On-demand

Reserved

Spot

Tiered Pricing

Volume Discounts

Custom Pricing

In the old days…

Spend millions to create a circa-

2010 AWS clone that is frozen in

time

-Large, upfront capital investment

-Basic compute and storage only

-You are responsible for feature upgrades

-Slow to get new capabilities

Before (9 years ago), NASA…

Spent more and

accomplished less

Today on the cloud, they are

100x more cost effective and

taking in 10x more data

Create new things, infuse new

capabilities into mission in

minutes

Two years ago, AWS helped NASA tell the Curiosity story

Skycrane Maneuver First selfie from another planet

By Using AWS, The State of Arizona Saves 75% Annually

Arizona is located in the Western region of the United States.

Aaron Sandeen

Deputy Director & CIO, State of Arizona

”

“• Needed to replace 1,300+ aging servers

that had been in operation for 5+ years

• In its first phase, migrated Domain Name

System (DNS) server to Amazon Route 53

• Designed to support website traffic from

130 + federated agencies, 32,000

employees, and 6 million residents

• Saves over 75% in annual operating costs

for its DNS system when compared to its

previous on-premises solution


UCAS – 3 years of continuous

innovation Phil Howell – Head of Enterprise Technology Architecture

Me?

Live in Cheltenham (with these two tinkers)

Oh crikey!! 20 years as an IT pro

Musician by night (sometimes)

With UCAS 2 ½ years

Innovation at UCAS…

• Start with a problem

• Convert the problem into a challenge

• Challenge colleagues to suggest creative solutions

• Generate ideas collaboratively

• Combine and evaluate ideas

• Develop ideas

• Implement ideas

Emergency architecture…

If you can read this you

really don’t need

glasses!!

Complex?

Where did this come

from?

PLATFORM SERVICE

LOGICAL

APPLICATION COMP.

IDS Agent

PLATFORM SERVICE

Windows Azure Microsoft Cloud Platform

LOGICAL TECHNOLOGY COMP.

Web Role

PHYSICAL APPLICATION

COMP.

Windows Server 2K

PHYSICAL

APPLICATION COMP.

IIS

LOGICAL

APPLICATION COMP.

UCAS Track in

The Cloud


Web Role


COMP.

Windows Server 2K

PHYSICAL

APPLICATION COMP.

IIS

LOGICAL

APPLICATION COMP.

UCAS Track in

The Cloud

LOCATION

LOCATION

PHYSICAL TECHNOLOGY COMP.

adsvr1.ucas.ac.uk

172.16.0.1

Dell PowerEdge 2850

2 x 2.8GHz Xeon

1GB RAM


Alert Logic

m1.medium

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS AgentLOGICAL TECHNOLOGY COMP.

HYPERIC MONITORING

m3.xlarge

15 GiB memory13 EC2 Units (4 v.cores)

EBS storage only64-bit platform

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

TECHNOLOGY COMP.

Cloud Gateway

Elastic Load

Balancer


XML Link Elastic Load Balancer


TOPAZ Elastic Load Balancer


CLOUD GATEWAY

m1.large 7.5 GiB RAM, 4 EC2 Units (2 Vcores)

850 GB storage, 64-bit platform

I/O Performance: High

EBS-Optimized Available: 500 Mbps


CLOUD GATEWAY




EBS-Optimized Available: 500 MbpsLOGICAL TECHNOLOGY COMP.

BATCH EXECUTION SERVER






RDS ODBC LINK “Arkle” Passive

Node

RDS Ex Large

Oracle 11g

PHYSICAL APPLICATION COMP.

Windows Server 2008 R2

LOGICAL

APPLICATION COMP.

Windows Service

Bus


PURPOSED FOR TOPAZ m1.large 7.5 GiB RAM, 4 EC2 Units (2 Vcores)





PURPOSED FOR XML LINK 2 m1.large 7.5 GiB RAM, 4 EC2 Units (2 Vcores)














LOGICAL

APPLICATION COMP.

VPC Routing Table

Internet Gateway


RHEL 6.3

LOGICAL

APPLICATION COMP.

Hyperic

Monitoring




OC4J JVM

PHYSICAL

APPLICATION COMP.

IIS




OC4J JVM

PHYSICAL

APPLICATION COMP.

IIS





LOGICAL

APPLICATION COMP.

VPC Routing Table


OC4J JVM

LOGICAL APPLICATION

COMP.

Web Link Application


OC4J JVM


PURPOSED FOR TOPAZHigh Mem M2.4xLarge, 26EC2 Units, 64GB RAM


Red Had Enterprise Linux V6.3

LOGICAL

APPLICATION COMP.

Topaz Application

LOGICAL

APPLICATION COMP.

XML Link Application

LOGICAL DATA

COMPONENT

Topaz Cloud Master Database

(READ/WRITE)Oracle 11g


PURPOSED FOR ODBC LINKHigh Mem M2.4xLarge, 26EC2 Units, 64GB RAM



LOGICAL DATA

COMPONENT

ODBC Link Database

(READ ONLY)Oracle 11g


PURPOSED FOR XML LINKHigh Mem M2.4xLarge, 26EC2 Units, 64GB RAM



LOGICAL DATA

COMPONENT

XML Link Database



OC4J JVM

LOGICAL

APPLICATION COMP.

Topaz Application


OC4J JVM

LOGICAL

APPLICATION COMP.


LOGICAL APPLICATION

COMP.


LO

GIC

AL T

EC

HN

OLO

GY

CO

MP

.

Access C

ontr

ol Lis

t

Adm

in &

Tools

(Utility

)

LO

GIC

AL T

EC

HN

OLO

GY

CO

MP

.

Access C

ontr

ol Lis

t

Adm

in &

Tools

(Monitoring)

LOGICAL

APPLICATION COMP.

VPC Routing Table


RDS ODBC LINK “Arkle” Active Node

RDS M2.2xlarge

Oracle 11g



LOGICAL APPLICATION COMP.

Batch Jobs

LOGICAL DATA COMPONENT

ODBC Link

“Arkle” RDS

Active node

LOGICAL

APPLICATION COMP.

Cloud Gateway

(Windows Service)

LOGICAL

TECHNOLOGY COMP.

Cloud Gateway

Elastic Load

Balancer

PHYSICAL DATA

COMPONENT

ORACL RDS 250GB

DB M1 Large

Standard IOPS


SKYBOT SHEDULER

m1.large


COMP.


LOGICAL

APPLICATION COMP.

IDS Agent


Network Time Protocol

m1.small


COMP.

RHEL 6,3

LOGICAL

APPLICATION COMP.

Network Time

Controller (NTP)


Staging Server

m1.medium



LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

10 x ebs Vols

(see disk preforma)

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

10 x ebs Vols

(see disk preforma)

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

10 x ebs Vols

(see disk preforma)

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

1 x 4 volume @ 200

IOPS 1 TB

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

1 x 2 volume @ 200

IOPS – 250 GB


Web Link Elastic Load Balancer




PURPOSED FOR WEB LINKHigh Mem M2.4xLarge, 26EC2 Units, 64GB RAM



LOGICAL DATA

COMPONENT

WebLink Link Database 4

(READ / WRITE)Oracle 11g

LOGICAL

APPLICATION COMP.

Oracle GoldenGate


PURPOSED FOR WEB LINK 8 m1.large, 7.5 GiB RAM, 4 EC2 Units

(2 V.cores) 850 GB storage, 64-bit











COMP.

OC4J JVM

PHYSICAL

APPLICATION COMP.

IIS


COMP.

OC4J JVM

LOGICAL

APPLICATION COMP.

Topaz Application


COMP.

OC4J JVM

LOGICAL

APPLICATION COMP.


LOGICAL APPLICATION

COMP.


LOGICAL

APPLICATION COMP.

Oracle GoldenGate

LOGICAL

APPLICATION COMP.

Oracle GoldenGate

LO

GIC

AL T

EC

HN

OLO

GY

CO

MP

.

Access C

ontr

ol Lis

t

Adm

in &

Tools

(Exte

rnal A

ccess)

LOGICAL APPLICATION

COMP.

IIS

LOGICAL

APPLICATION COMP.

SkyBot

Batch Manager


Debian 6LOGICAL

APPLICATION COMP.

AlertLogic

IDS Service & Traffic

Manager


Course Collect M3 Extra large, 15 GiB, 13 EC2 64-bit

API name: m3.xlarge


RHEL 6.3


Web Logic 10.3.5


Web Logic 10.3.5

LOGICAL

APPLICATION COMP.

Course Collect

(Course Manager)

LOGICAL

APPLICATION COMP.

Course Collect

(Visual Rules)


Course CollectMASTER COURSE DATABASE

RDS m2.2xlarge34 GB, 13 ECUs

64-bit


Oracle 11g

LOGICAL DATA

COMPONENT

MASTER COURSE DATABSE

Read / Write

LOGICAL

TECHNOLOGY COMP.

Couse Collect

Elastic Load

Balancer

LOGICAL

TECHNOLOGY COMP.

Couse Collect

Elastic Load

Balancer


Dev PC

PLATFORM SERVICE

RackConnect Cloud Servers


Cloud Server

rcwebsvr1


RHEL 6.1


Varnish80


Apache: 8080

LOGICAL

APPLICATION COMP.

Drupal

LOGICAL

TECHNOLOGY COMP.

memcached


Cloud Server

rcwebsvr2


RHEL 6.1


Varnish80


Apache: 8080

LOGICAL

APPLICATION COMP.

Drupal

LOGICAL

TECHNOLOGY COMP.

memcached


Cloud Server

rcwebsvr3


RHEL 6.1


Varnish80


Apache: 8080

LOGICAL

APPLICATION COMP.

Drupal

LOGICAL

TECHNOLOGY COMP.

memcached

Cache timeoutsynchronization

Cache timeoutsynchronization

PLATFORM SERVICE

RackConnect Cloud Database Layer

Reference DataReference Data Reference Data


Cloud Database

Drupalu53r

Durable Data Storage

PLATFORM SERVICE

PHYSICAL

TECHNOLOGY COMP.

CISCO ASA5510 FIREWALL

PHYSICAL

TECHNOLOGY COMP.

F5 1600 LTMLOAD BALANCER

PLATFORM SERVICE

RackConnect Cloud Servers


Cloud ServerShared Content Storage

rccontentsvr1

PLATFORM SERVICE

Public SegmentLOGICAL

TECHNOLOGY COMP.

Internet Routing Layer

LOGICAL

TECHNOLOGY COMP.

Aggregate Switching Layer

Shared with mob.ucas Production

UCAS Rosehill


Link Proof


Firewall


App Director


Firewall


VMPHYSICAL

APPLICATION COMP.

Red Hat virtual Instance

LOGICAL APPLICATION

COMP.

oraweb15.dmz.ucas.ac.ukLOGICAL APPLICATION

COMP.

oraweb14.dmz.ucas.ac.ukLOGICAL APPLICATION

COMP.

www3.dmz.ucas.ac.ukLOGICAL APPLICATION

COMP.

www2.dmz.ucas.ac.ukLOGICAL

APPLICATION COMP.

www1.dmz.ucas.ac.uk

Provides VIP and Web Farm

Pri:10.178.198.227Pub:5.79.59.154RAM 4GB 2 x vCPU, 160GB Store

Pri:10.178.198.15Pub:5.79.59.1554GB 2 x vCPU

Pri:10.178.198.nnPub:5.79.59.nnn4GB 2 x vCPU

PLATFORM SERVICE

Co

nte

nt D

eliv

ery

Ne

two

rk - A

WS

Clo

ud

Fro

nt

4 GB RAM15GB diskName: mobiledbUser: Drupalu53r

Managed Cloud MySQL

6802 6802


Apache: 8080

Pri:Pub:RAM 2GB 2 x vCPU 80Gb storage

LOGICAL

TECHNOLOGY COMP.

Cloud Block StorageShared Content Store

100GB

End to End Application Architecture – Rackspace - RackConnect

Drupal Rack Connect

Author

Version

Date

Rob Hart

0.5

10 January 2014

Media Project Production Environment

LOGICAL

APPLICATION COMP.

Message

Queue

LOGICAL DATA

COMPONENT

BLOB Storage

PHYSICAL DATA

COMPONENT

Diagnostic Store

LOGICAL TECHNOLOGY

COMP.

Web Role

LOGICAL

APPLICATION COMP.

Azure Diagnostic

Manager


Web Role


COMP.

Windows Server 2K

PHYSICAL

APPLICATION COMP.

IIS

LOGICAL

APPLICATION COMP.

UCAS Course

Search

LOGICAL

TECHNOLOGY COMP.

Load Balancer


Web RolePHYSICAL APPLICATION

COMP.

Sphinx Index and Doc

Store

LOGICAL DATA

COMPONENT

UST Data Store

LOGICAL

APPLICATION COMP.

Message

Queue

PHYSICAL TECHNOLOGY

COMP.

LRAC04

SunFire v890

8 x 1.5Ghz

64GB RAM

Solaris 10

10.10.10.182

PHYSICAL TECHNOLOGY

COMP.

LRAC05

SunFire v890

8 x 1.5Ghz

64GB RAM

Solaris 10

10.10.10.192


LRAC ORACLE RAC DB INSTANCE

PHYSICAL

TECHNOLOGY COMP.

App Director

PHYSICAL

TECHNOLOGY COMP.

App Director

LOGICAL

TECHNOLOGY COMP.

URLS

LOGICAL

TECHNOLOGY COMP.

Load Balanced

VIPFor UCAS Apply

PHYSICAL

TECHNOLOGY COMP.

Linkproof

Link Balancers

NATs

PHYSICAL

TECHNOLOGY COMP.

CISCO 6509e

Core Network Switch

PHYSICAL

TECHNOLOGY COMP.

CISCO 6509e

Core Network Switch

LOGICAL

TECHNOLOGY COMP.

Internet Boundary

Firewall Context

(From Palo-Alto

Firewall HA Pair)

PHYSICAL TECHNOLOGY

COMP.

Onyx Database

BODB01

Sun E2900

Solaris 10

4 x 1.5Ghz CPU

32GB RAM

10.10.10.33


LAPP24

SunFire v490

4 x 1.35GHz US-IV

16GB RAM

10.10.0.22

PHYSICAL

TECHNOLOGY COMP.

RACDB1

T2000

8x1.2Ghz

Solaris 10

10.10.10.80

PHYSICAL

TECHNOLOGY COMP.

RACDB2

T2000

8x1.2Ghz

Solaris 10

10.10.10.81


APPRAC ORACLE RAC DB INSTANCE


LWEBDC01

T3-1

8x1.65GHz

192.168.1.60


LWEBDC02

T3-1

8x1.65GHz

192.168.1.61

PHYSICAL

TECHNOLOGY COMP.

CISCO 3750 Switch

PHYSICAL

TECHNOLOGY COMP.

CISCO 3750 Switch


LWEBDC03

T3-1

8x1.65GHz

192.168.1.62

PHYSICAL TECHNOLOGY

COMP.

INFMGT01

T2000

8 x 1.2Ghz

32GB RAM

10.10.0.137


Oraweb11

Sun T2000 1CPU8 Cores

32GB RAM192.168.1.109


Oraweb12

Sun T2000 1CPU8 Cores

32GB RAM192.168.1.110


LAPPDC04

10.11.0.40

SUN T5240

16 x 1.4Ghz


LAPP07

10.11.0.43

LDOM


WWW3

192.168.61.202

T2000

8 x 1.2Ghz


STARDB01

10.10.11.10

SUN v890

8 x 1.5Ghz CPU

64GB RAM


ORAWEB16

192.168.61.201

T2000

8 x 1.2GHz

PHYSICAL

TECHNOLOGY COMP.

Link Balancer

And Firewalls


SUN StorageTek

3510 Storage Array

100Mbps Internet

Connection


ORAWEB17

192.168.61.70

T2000

8 x 1.2GHz

PHYSICAL

TECHNOLOGY COMP.

CAPSCAN

Postcode Lookup

INFORMATION

SYSTEM SERVICE

Data Cache

Payments

Service

INFORMATION

SYSTEM SERVICE

Email SMTP Relay

At MessageLabs

SendGrid

E-Mail SMTP call (port 25)

Payments Data Call

Capscan Data Call

(port 29720)

Star Bristol Disaster Recovery Location for UCAS Apply and Onyx



Sun StorageTek

6540-1 SAN

96 x 300GB 15kRPM Disk

2 x Controller Interfaces


Sun StorageTek

6540-2 SAN

96 x 300GB 15kRPM Disk

2 x Controller Interfaces


Qlogic 5602 SAN Switches x 8


UCAS and GTTR Apply (AppRac)

Data on 4 LUNS on 6 x disk (RAID 5)

LOGS on 2 x 2 x disk (RAID1+ASM0)


TOPAZ Database Storage

41 LUNS on 2 x 12 disk RAID 5 Volumes

Approx 4930GB Total Presented Storage

ASM Mirrors between 6540-1 and 6540-2

UNIX Shared Storage Subsystem

LOGICAL DATA

COMPONENT

Onyx DatabaseInstance

Oracle 10g


Topaz DatabaseInstance

Oracle 10g


UCAS Apply Database Instance Oracle 10g


GTTR Apply Database Instance Oracle 10g

LOGICAL TECHNOLOGY

COMP.

SANTricity

SAN Management

Application


LAPPDC01

SUN T5240

128GB RAM

10.10.0.163


SUN Solaris 10 Operating System


Topaz

LAPP02

LDOM – 10.10.0.168

24 vCPU 10GB RAM


GTTR

LAPP12

LDOM

10.10.0.202


UCAS Apply

LAPP01

LDOM

10.10.0.169


UCAS Apply OAS

Application


GTTR Apply WebLogic

Application


Topaz OAS Application

(Also used for RMI)


LAPPDC02

SUN T5240

128GB RAM

10.10.0.164




Topaz

LAPP04

LDOM – 10.10.0.173

24 vCPU 10GB RAM


GTTR

LAPP13

LDOM

10.10.0.197


UCAS Apply

LAPP03

LDOM

10.10.0.172


UCAS Apply OAS

Application


GTTR Apply WebLogic

Application



(Also used for RMI)


LAPPDC03

SUN T5240

128GB RAM

10.10.0.174




LAPP06

Topaz

LDOM – 10.10.0.178

24 vCPU 10GB RAM


GTTR

LAPP14

LDOM

10.10.0.201


UCAS Apply

LAPP05

LDOM

10.10.0.177


UCAS Apply OAS

Application


GTTR Apply WebLogic

Application



(Also used for RMI)




GTTR

ORAWEB8

LDOM

192.168.1.102


UCAS Apply

LWEB02

LDOM

192.168.1.66






GTTR

ORAWEB9

LDOM

192.168.1.103


UCAS Apply

LWEB12

LDOM

192.168.1.67


UCAS Apply

LWEB22

LDOM

192.168.1.69


COMP.

UCAS Apply Web

Instance


COMP.

GTTR Apply Web

Instance


COMP.

UCAS Apply Web

Instance


COMP.

GTTR Apply Web

Instance


COMP.

UCAS Apply Web

Instance


WWW1

Static Content

Server

192.168.1.166


WWW2

Static Content

Server

192.168.1.167


GTTR Apply Farm :192.168.11.217

UCAS Apply Farm: 192.168.11.229


SUN Solaris 10 Operating

System



System

PHYSICAL DATA COMPONENT

Static Web Content


Static Web Content



System



System


NetUpdate

Hahtsite Web (Foreground)


NetUpdate

Hahtsite Web (Foreground)


PHYSICAL

TECHNOLOGY COMP.

VMWareSvr2

DellR9000

4xCPU, 8GB

10.10.10.27

PHYSICAL

TECHNOLOGY COMP.

VMWareSvr1

DellR9000

4xCPU, 8GB

10.10.10.26

PHYSICAL

TECHNOLOGY COMP.

VMWareSvr3

DellR9000

4xCPU, 8GB

10.10.10.28

PHYSICAL

TECHNOLOGY COMP.

VMWareSvr4

DellR9000

4xCPU, 8GB

10.10.10.35


Qlogic SAN Switches x 2

PHYSICAL

TECHNOLOGY COMP.

Nexan-SAN1

SATABoy Storage

Array

11TB Total Storage

PHYSICAL

TECHNOLOGY COMP.

Nexan-SAN2

SATABoy Storage

Array

11TB Total Storage

PHYSICAL

TECHNOLOGY COMP.

Datacoresvr1

Dell Poweredge

2950

2.33GHz, 8GB RAM

10.10.10.38

PHYSICAL

TECHNOLOGY COMP.

Datacoresvr2

Dell Poweredge

2950

2.33GHz, 8GB RAM

10.10.10.39

Syncrhonous Replication


VMware Data Stores

for Virtual Machines

x86 Shared Storage Subsystem


Update

IP192.168.1.80

1 vCPU1GB RAM


Update2

IP192.168.1.82

1 vCPU1GB RAM

VMware Virtual Infrastructure


Ford

4 x vCPU, 4GB RAM

10.10.10.18


Microsoft Windows NT4 Operating

System


Hahtsite Control Host


Microsoft Windows NT4 Operating

System


Hahtsite Backup Control Host


Microsoft Windows 2008 R2

Operating System


NetUpdate Database

(Informix)


BACKGROUND10

4 x vCPU3GB RAM

194.80.167.66


Microsoft Windows 2000SP3

Operating System


Hahtsite Background Host


Update


BACKGROUND11

4 x vCPU3GB RAM

194.80.167.67



Operating System




BACKGROUND12

4 x vCPU3GB RAM

10.10.10.67



Operating System




BACKGROUND14

4 x vCPU3GB RAM

10.10.10.126



Operating System




BACKGROUND15

4 x vCPU3GB RAM

10.10.10.127



Operating System




BACKGROUND16

4 x vCPU3GB RAM

10.10.0.12



Operating System




TASKSVR1

2 x vCPU2GB RAM

194.80.167.9


Microsoft Windows 2003 Operating

System


Windows Task Scheduler


Search


GTTR


CLV02


Update


Search


GTTR


CLV02


ApplyT


Stamford


Search


NetUpdate


CLV02


Stamford


Search


NetUpdate


General


Search


NetUpdate


CLV02


Search


CLV02


General


VPN Tunnel 2PALO ALTO Primary and Secondary.

Interface : TBATerminates : TBA

Virgin 1GBPSInternet Connection

Virgin 1GBPSInternet Connection


VPN Tunnel 1Palo Alto Primary and Secondary.

Interface : TBATerminates : TBA


Galleon NTS-6000 Time Appliance

timesvr1.ucas.ac.uk

10.10.10.250


Galleon NTS-6000 Time Appliance

timesvr2.ucas.ac.uk

10.10.10.251


Application Tier vLAN 1


Web Tier

LOGICAL

TECHNOLOGY COMP.

Application Tier

vLAN 1


Microsoft Windows 2003


Microsoft DDNS and Active

Directory


adsvr2.ucas.ac.uk

10.0.3.100

Dell PowerEdge 2850

2 x 2.8GHz Xeon

1GB RAM


Microsoft Windows 2003


Microsoft DDNS and Active

Directory


NTP Server


NTP Server


Solaris 10


Topaz Application


Onyx Application

Rosehill


Web Tier vLAN


Solaris 10 Operating System






Apply Web Instance


Apply Web Instance


Apply Web Instance


Application Tier vLAN




Apply Application Instance




Oracle 10g Database Instance

LOGICAL DATA

COMPONENT

Apply Database

LOGICAL DATA

COMPONENT

Onyx Database


MS SQL Server 2012


Windows Service Bus

Repository

LOGICAL TECHNOLOGY

COMP.

AWS Elastic Block

Store (EBS)

1 volumes @

STANDARD IOPS

50 GB per device per

month

LOGICAL

APPLICATION COMP.

Network Address

Translation


Web Role


COMP.

Windows Server 2K

PHYSICAL

APPLICATION COMP.

IIS

LOGICAL

APPLICATION COMP.

UCAS Track in

The Cloud

LOGICAL

TECHNOLOGY COMP.

Load Balancer

1..n

LOGICAL TECHNOLOGY

COMP.

Web Role

LOGICAL

APPLICATION COMP.

Azure Diagnostic

Manager

PHYSICAL DATA

COMPONENT

Diagnostic Store

LOGICAL

APPLICATION COMP.

Azure Service Bus

LOGICAL

APPLICATION COMP.

Message

Queue

LOGICAL

APPLICATION COMP.

Message

Queue

Primary Availability Zone

Data Replication (Oracle Data Guard) and RDS Multi-AZ Replication

PLATFORM SERVICE

DataCache Secure Payments Service


Payments Gateway

https://testserver.datacache.com/transaction : Test System

https://mars.transaction.datacache.com/transaction : Production System

Connection via HTTPS from Topaz Application

LOGICAL

APPLICATION COMP.

IDS Agent


Track Application Server m1.large 7.5 GiB RAM, 4 EC2 Units (2 Vcores)





OC4J JVM

PHYSICAL

APPLICATION COMP.

IIS

LOGICAL

APPLICATION COMP.

Topaz Adapter

LOGICAL

APPLICATION COMP.

Veridata Agent

LOGICAL

APPLICATION COMP.

Veridata Agent

LOGICAL

APPLICATION COMP.

Veridata Agent

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

10 x ebs Vols

(see disk preforma)

PLATFORM SERVICE

LOGICAL

APPLICATION COMP.


Alert Logic

m1.medium

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent


Zone B Primary

DDNS / AD

m1.small

LOGICAL

APPLICATION COMP.


HYPERIC MONITORING

m3.xlarge

15 GiB memory13 EC2 Units (4 v.cores)

EBS storage only64-bit platform

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

APPLICATION COMP.

IDS Agent

LOGICAL

TECHNOLOGY COMP.

Cloud Gateway

Elastic Load

Balancer






CLOUD GATEWAY






CLOUD GATEWAY




EBS-Optimized Available: 500 MbpsLOGICAL TECHNOLOGY COMP.

BATCH EXECUTION SERVER







Node

RDS Ex Large

Oracle 11g



LOGICAL

APPLICATION COMP.

Windows Service

Bus





















LOGICAL

APPLICATION COMP.

VPC Routing Table

Internet Gateway


RHEL 6.3

LOGICAL

APPLICATION COMP.

Hyperic

Monitoring




OC4J JVM

PHYSICAL

APPLICATION COMP.

IIS




OC4J JVM

PHYSICAL

APPLICATION COMP.

IIS





LOGICAL

APPLICATION COMP.

VPC Routing Table


OC4J JVM

LOGICAL APPLICATION

COMP.



OC4J JVM


PURPOSED FOR TOPAZHigh Mem M2.4xLarge, 26EC2 Units, 64GB RAM



LOGICAL

APPLICATION COMP.

Topaz Application

LOGICAL

APPLICATION COMP.


LOGICAL DATA

COMPONENT

Topaz Cloud Master Database

(READ/WRITE)Oracle 11g


PURPOSED FOR ODBC LINKHigh Mem M2.4xLarge, 26EC2 Units, 64GB RAM



LOGICAL DATA

COMPONENT

ODBC Link Database



PURPOSED FOR XML LINKHigh Mem M2.4 xLarge, 26 EC2 Units 64GB RAM



LOGICAL DATA

COMPONENT

XML Link Database



OC4J JVM

LOGICAL

APPLICATION COMP.

Topaz Application


OC4J JVM

LOGICAL

APPLICATION COMP.


LOGICAL APPLICATION

COMP.


LO

GIC

AL T

EC

HN

OLO

GY

CO

MP

.

Access C

ontr

ol Lis

t

Adm

in &

Tools

(Utility

)

LO

GIC

AL T

EC

HN

OLO

GY

CO

MP

.

Access C

ontr

ol Lis

t

Adm

in &

Tools

(Monitoring)

LOGICAL

APPLICATION COMP.

VPC Routing Table



RDS Ex Large

Oracle 11g




Batch Jobs


ODBC Link

“Arkle” RDS

Active node

LOGICAL

APPLICATION COMP.

Cloud Gateway

(Windows Service)

LOGICAL

TECHNOLOGY COMP.

Cloud Gateway

Elastic Load

Balancer

PHYSICAL DATA

COMPONENT

ORACL RDS 250GB

DB M1 Large

Standard IOPS


SKYBOT SHEDULER

m1.large


COMP.


LOGICAL

APPLICATION COMP.

IDS Agent


Network Time Protocol

m1.small


COMP.

RHEL 6,3

LOGICAL

APPLICATION COMP.

Network Time

Controller (NTP)


Staging Server

m1.medium



LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

10 x ebs Vols

(see disk preforma)

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

10 x ebs Vols

(see disk preforma)

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

10 x ebs Vols

(see disk preforma)

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

1 x 4 volume @ 200

IOPS 1 TB

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

1 x 2 volume @ 200

IOPS – 250 GB






PURPOSED FOR WEB LINKHigh Mem M2.4xLarge, 26EC2 Units, 64GB RAM



LOGICAL DATA

COMPONENT

WebLink Link Database 4

(READ / WRITE)Oracle 11g

LOGICAL

APPLICATION COMP.

Oracle GoldenGate














COMP.

OC4J JVM

PHYSICAL

APPLICATION COMP.

IIS


COMP.

OC4J JVM

LOGICAL

APPLICATION COMP.

Topaz Application


COMP.

OC4J JVM

LOGICAL

APPLICATION COMP.


LOGICAL APPLICATION

COMP.


LOGICAL

APPLICATION COMP.

Oracle GoldenGate


COMP.


LOGICAL

APPLICATION COMP.

DDNS / AD

LOGICAL

APPLICATION COMP.

Oracle GoldenGate

LO

GIC

AL T

EC

HN

OLO

GY

CO

MP

.

Access C

ontr

ol Lis

t

Adm

in &

Tools

(Exte

rnal A

ccess)

LOGICAL APPLICATION

COMP.

IIS

LOGICAL

APPLICATION COMP.

SkyBot

Batch Manager


Debian 6LOGICAL

APPLICATION COMP.

AlertLogic

IDS Service & Traffic

Manager


Course Collect M3 Extra large, 15 GiB, 13 EC2 64-bit

API name: m3.xlarge


RHEL 6.3


Web Logic 10.3.5


Web Logic 10.3.5

LOGICAL

APPLICATION COMP.

Course Collect

(Course Manager)

LOGICAL

APPLICATION COMP.

Course Collect

(Visual Rules)


Course CollectMASTER COURSE DATABASE

RDS m2.2xlarge34 GB, 13 ECUs

64-bit


Oracle 11g

LOGICAL DATA

COMPONENT

MASTER COURSE DATABSE

Read / Write

LOGICAL

TECHNOLOGY COMP.

Couse Collect

Elastic Load

Balancer

LOGICAL

TECHNOLOGY COMP.

Couse Collect

Elastic Load

Balancer


MS SQL Server 2012


Windows Service Bus

Repository

LOGICAL TECHNOLOGY

COMP.

AWS Elastic Block

Store (EBS)

1 volumes @

STANDARD IOPS

50 GB per device per

month

LOGICAL

APPLICATION COMP.

Network Address

Translation

Secondary Availability Zone

LOGICAL

APPLICATION COMP.

IDS Agent


Track Application Server m1.large 7.5 GiB RAM, 4 EC2 Units (2 Vcores)





OC4J JVM

PHYSICAL

APPLICATION COMP.

IIS

LOGICAL

APPLICATION COMP.

Topaz Adapter

LOGICAL

APPLICATION COMP.

Veridata Agent

LOGICAL

APPLICATION COMP.

Veridata Agent

LOGICAL

APPLICATION COMP.

Veridata Agent

LOGICAL

TECHNOLOGY COMP.

AWS Elastic Block

Store (EBS)

10 x ebs Vols

(see disk preforma)

Standby Only

Standby Only

LOGICAL

APPLICATION COMP.


ORACLE (OEM)

m1.large


COMP.

RHEL 6.3

LOGICAL

APPLICATION COMP.

OEM

LOGICAL

APPLICATION COMP.

Veridata

LOGICAL

APPLICATION COMP.


ORACLE (OEM)

m1.large


COMP.

RHEL 6.3

LOGICAL

APPLICATION COMP.

OEM

LOGICAL

APPLICATION COMP.

Veridata

Stan

dby Only

LOGICAL

APPLICATION COMP.

IDS Agent


Zone A Secondary

DDNS / AD

m1.small


COMP.


LOGICAL

APPLICATION COMP.

DDNS / AD

LOGICAL

APPLICATION COMP.

IDS Agent


Zone A Primary

DDNS / AD

m1.small


COMP.


LOGICAL

APPLICATION COMP.

DDNS / AD

LOGICAL

APPLICATION COMP.

IDS Agent


Zone B Secondary

DDNS / AD

m1.small


COMP.


LOGICAL

APPLICATION COMP.

DDNS / AD

LOGICAL

APPLICATION COMP.

IDS Agent



Node

RDS Ex Large

Oracle 11g



RDS M1 xlarge

Oracle 11g


ODBC Link

“Arkle” RDS

Active node


LOGICAL

APPLICATION COMP.

IDS Agent



RDS M1 xlarge

Oracle 11g


ODBC Link

“Arkle” RDS

Active node

Stan

dby Only


Access Control List

Database Zone


Access Control List

Database Zone

LOGICAL

APPLICATION COMP.

IDS Agent


SMTP Relay

m1.large


COMP.


LOGICAL APPLICATION

COMP.

IIS

LOGICAL

TECHNOLOGY COMP.

LOGICAL

TECHNOLOGY COMP.

SMTP

Elastic Load

Balancer

LOGICAL

APPLICATION COMP.

IDS Agent


SMTP Relay

m1.large


COMP.


LOGICAL

TECHNOLOGY COMP.

LOGICAL

TECHNOLOGY COMP.

SMTP

Elastic Load

Balancer

LOGICAL APPLICATION

COMP.

IIS


Access Control List

Public / Private Transit


Access Control List

To Web / App Zone


Access Control List

Public / Private Transit


Access Control List

To Web / App Zone

What’s in the mix here?

Amazon Web Services, Microsoft Azure, Rackspace, Claranet, Self Hosting,

Imperva, ScaleXtreme, VMware, Solaris LDOMs, Oracle Goldengate,

Windows, LINUX, Solaris, AIX, Java, .NET, OC4J and many, many more…

Maturing innovation…2013

Emergency

action needed

RAPID migration

of critical

services to AWS

Some

automation

2014

Continued

innovation and

learning

Legacy migration

completes

Home grown

automation

Better discipline

2015+

Culture of gentle

innovation

Adoption of AWS

for .NET

MORE

automation

Dev ops??

Management

enabled change

Architecture

enabled

innovation

Developer

enabled

innovation

What have we learned?

• Innovation is a journey not a single event (Cliché alert)

• A permissive environment is VITAL to benefiting from

innovation

• You’ve got to know where you’re heading though!

• AWS is an INCREDIBLY capable platform

• Work with your AWS account team

What’s next…

• Aurora

• Canary and blue/green deployments

• .NET and Elastic Beanstalk, self healing, auto-scaling, immutable

infrastructure

• No-SQL databases

• Cloud enabled Service Oriented Architecture and Event Driven Architecture

• Advanced cloud integration

• The sky’s the limit…

LONDON

Successful Government Adoption Models

Security and Compliance

Procurement

Culture

Broad Adoption

DefinitionPolicy

New IT Procurement Models

Traditional

Large full-service workloads and programs implemented by a systems integrator who provides application development, management, and infrastructure.

Cloud may be a part of this.

IaaS

Infrastructure

management is

decoupled from

application

development.

Professional services

contractors deploy apps

on your cloud

infrastructure.

In-House DevOps

You want to build and

deploy your own

applications and need

easy access to

infrastructure to support

development operations,

testing, deployment, and

maintenance.

These require new acquisition strategies

Changing IT Acquisition Strategies

Old World IT

• Price lock

• Vendor lock-in

• Rigid CLIN structure

• CapEx

• Budget for tech refresh

• Months to plan and order

• Design lock-in

New World of Cloud Computing

• Variable costs

• No required minimum commitments

• Rapid innovation

• OpEx

• Cloud providers continually upgrade

• Rapid deployments

• Agile architecture

Shifts from serving existing infrastructure to serving the mission of the agency

Job Accelerator Program

The Infocomm Development Authority of

Singapore (IDA) has announced a

collaboration with Amazon Web Services

(AWS) to help independent software

vendors (ISVs) develop a Software-as-a-

Service (SaaS) model for their business,

enabling them to extend their offerings

beyond Singapore.

Singapore Government partners AWS

to build local SaaS capabilities

AWS Global Impact Initiatives for Science

AWS Research Grants AWS Hosted Public Datasets

• Dedicated team focusing on Scientific Computing & Research workloads

• Globally focussed and engaged in Big Science projects like the SKA.

• Leveraging AWS resources all over the world.

• Ensuring the cloud is able to make a disruptive impact on science.

AWS Scientific Computing

Team

• Grants to initiate & support

development of cloud-enabled

technologies.

• Typically one-off grants of AWS

resources like EC2 (compute) or S3

& EBS (storage) or more exotic like

Kinesis & twitter feeds.

• Frequently results in reusable

resources, like AMIs or open data,

which we strongly encourage.

• Lowers the risk to try the cloud.

• Large and globally significant datasets

hosted and paid for by AWS for

community use

• Data can be quickly and easily processed

with elastic computing resources in the

surrounding cloud

• AWS hopes to enable more innovation

• Provided in partnership owners who

curate the data with

• Provided in partnership content owners,

who curate the data.

OpenFDA

Offers access to

FDA public data to

further regulatory or

scientific missions,

educate the public,

and save lives.

Singapore OneMap

Integrated open data

and mapping system

for government is used

by over 80 agencies

and serves over 100

million users.

Landsat on AWS

Hosting Landsat data on

Amazon S3 led to

development of seven

new public data analysis

and processing tools in

under two months.

Open Data on AWS

Thank you! Please let us know how we can help.

Frank DiGiammarino

[email protected]

london - amazon s3and... · london ©2015, amazon web services, inc. or its affiliates. ... every...

Documents