writing highly scalable websocket using the atmosphere framework and scala

Writing highly scalable WebSocket using the Atmosphere Framework

Jeanfrancois ArcandWordnik.com

Who is Wordnik

• Well Funded Silicon Valley based Startup–Creators of Meaning Discovery Engine

• Wordnik extracts Meaning from Text–Lexicographic and Computational Linguistic algorithms

–Data & Algorithms exposed via Swagger API

• Self-updating English Language Dictionary–Based on in-context usage

–Proprietary Text Corpus• Word Graph relates all words in English

• Micro Service Architecture Infrastructure–Java/Scala/MongoDB 2

Who I amWho I am

• Twitter: @jfarcand

Creator of Grizzly

Framework

Creator of Grizzly

Framework

Who I amWho I am

Creator of Grizzly

Framework

Creator of Grizzly

Framework

Significant contributor of

GlassFish

Who I amWho I am

Creator of Grizzly

Framework

Creator of Grizzly

Framework

GlassFish

Creator of the AsyncHttpClie

Who I amWho I am

Creator of Grizzly

Framework

Creator of Grizzly

Framework

GlassFish

Creator of AtmosphereCreator of

Atmosphere

Who I amWho I am

Creator of Grizzly

Framework

Creator of Grizzly

Framework

GlassFish

Creator of AtmosphereCreator of

Atmosphere

Tomcat, Apache Digester, Sitebricks,

Jersey, Aether/Maven, etc.

Tomcat, Apache Digester, Sitebricks,

Jersey, Aether/Maven, etc.

The Atmosphere FrameworkThe Atmosphere Framework

A Portable Comet

Framework

A Portable Comet

Framework

A Portable Comet

Framework

A Portable Comet

Framework

Support All native Comet

API and Servlet 3.0

A Portable Comet

Framework

A Portable Comet

Framework

API and Servlet 3.0

Atmosphere Client JQuery

Plugin

A Portable Comet

Framework

A Portable Comet

Framework

API and Servlet 3.0

Plugin

Support available

WebSocket Native API

Support available

A Portable Comet

Framework

A Portable Comet

Framework

API and Servlet 3.0

Plugin

Support available

Plugs in for Redis, Active

MQ (JMS), JGroups, XMPP,

A Portable Comet

Framework

A Portable Comet

Framework

API and Servlet 3.0

Plugin

Support available

Supported/Integrated by almost

all major frameworks and javascript library

Supported/Integrated by almost

all major frameworks and javascript library

WebSocket Spec is evolving

fast on both Browser and Server Side

Chrome/Safari/Opera: WebSocket

FF: MozWebSocketIE: (crikets …

Atmosphere JQuery Plug In hide that and

propose a uniform API

Decide the best transport,

negociate it with the server

Decide the best transport,

negociate it with the server

Java LandscapeJava Landscape

Jetty 7.0: First to Support WebSocket

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.4.5 and

8.0.2 and up:

Spec change

Jetty 7.4.5 and

8.0.2 and up:

Spec change

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.4.5 and

8.0.2 and up:

Spec change

Jetty 7.4.5 and

8.0.2 and up:

Spec change

GlassF

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.4.5 and

8.0.2 and up:

Spec change

Jetty 7.4.5 and

8.0.2 and up:

Spec change

GlassF

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.4.5 and

8.0.2 and up:

Spec change

Jetty 7.4.5 and

8.0.2 and up:

Spec change

GlassF

Tomcat 7

zzzzzzzzzzzz

Tomcat 7

zzzzzzzzzzzz

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.4.5 and

8.0.2 and up:

Spec change

Jetty 7.4.5 and

8.0.2 and up:

Spec change

GlassF

Tomcat 7

zzzzzzzzzzzz

Tomcat 7

zzzzzzzzzzzz

WOUAAAAAAAAAAAAAAAAtmosphere to the

rescue!!

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.4.5 and

8.0.2 and up:

Spec change

Jetty 7.4.5 and

8.0.2 and up:

Spec change

GlassF

Tomcat 7

zzzzzzzzzzzz

Tomcat 7

zzzzzzzzzzzz

rescue!!

Are you crazy enough to

rewrite your entire app?

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.2.x ->

API Changes, break

compatibility

Jetty 7.4.5 and

8.0.2 and up:

Spec change

Jetty 7.4.5 and

8.0.2 and up:

Spec change

GlassF

Tomcat 7

zzzzzzzzzzzz

Tomcat 7

zzzzzzzzzzzz

rescue!!

rewrite your entire app?Really want to

use proprietary

solution like ?

Really want to use

proprietary solution like ?

How?How?

Integrate with all

framework? Check!

Integrate with all

framework? Check!

How?How?

Integrate with all

framework? Check!

Integrate with all

framework? Check!

Want Servlet API? Check!Want Servlet API? Check!

How?How?

Integrate with all

framework? Check!

Integrate with all

framework? Check!

Want REST like API? Check!

How?How?

Integrate with all

framework? Check!

Integrate with all

framework? Check!

Fallback to Comet? Check!

How?How?

Integrate with all

framework? Check!

Integrate with all

framework? Check!

Pure WebSocket?

Check!

Pure WebSocket?

Check!

How?How?

Integrate with all

framework? Check!

Integrate with all

framework? Check!

Pure WebSocket?

Check!

Pure WebSocket?

Check!

WebSocket Sub Protocol?

How?How?

Integrate with all

framework? Check!

Integrate with all

framework? Check!

Pure WebSocket?

Check!

Pure WebSocket?

Check!

WebSocket Sub Protocol?

Atmosphere provides a uniform API and hides

the underlying transport details

(async I/O included)

Atmosphere provides a uniform API and hides

the underlying transport details

(async I/O included)

ConceptsConcepts

Upgrade/SuspendUpgrade/Suspend

ConceptsConcepts

BroadcastBroadcast

ConceptsConcepts

BroadcastBroadcast

ResumeResume

ConceptsConcepts

BroadcastBroadcast

ResumeResume

Client choose the best

technique (ws or comet)

Client choose the best

technique (ws or comet)

Async I/O(Input/Output

Stream)

ConceptsConcepts

BroadcastBroadcast

ResumeResume

Cloud enabled (zzzzzz)

Stream)

Stream)Survive ProxyCloud EnabledSurvive ProxyCloud Enabled

ZzzzzzzzzEnough Bla Bla Bla,

let’s do Scala!

ZzzzzzzzzEnough Bla Bla Bla,

let’s do Scala!

APIAPI

AtmosphereHandler

APIAPI

Jersey to the rescue!

(@ and Prog API)

AtmosphereHandler

APIAPI

AtmosphereHandler

WebSocketProtocol

WebSocketProtocolJersey to the

rescue!(@ and Prog

(@ and Prog API)

APIAPI

AtmosphereHandler

WebSocketProtocol

Servlet APIServlet API

(@ and Prog API)

The DemoThe Demo

Jetty 8Jetty 8 Tomcat 6

Tomcat 6

RedisRedis

ChromeChrome Redis CLIRedis CLI SafariSafari

WebSocketWebSocketWebSocket FAIL ->

StreamingWebSocket FAIL ->

Streaming

Broadcaster

2005- AtmosphereHandler

def onRequest(r: AtmosphereResource[HttpServletRequest, HttpServletResponse]): Unit = {

var req: HttpServletRequest = r.getRequest

var res: HttpServletResponse = r.getResponse

var method: String = req.getMethod

if ("GET".equalsIgnoreCase(method)) {

var b: Broadcaster = lookupBroadcaster(req.getPathInfo)

r.setBroadcaster(b)

if (req.getHeader(HeaderConfig.X_ATMOSPHERE_TRANSPORT).equalsIgnoreCase(HeaderConfig.LONG_POLLING_TRANSPORT)) {

req.setAttribute(ApplicationConfig.RESUME_ON_BROADCAST, true)

r.suspend(-1, false)

} else {

r.suspend(-1)

} else if ("POST".equalsIgnoreCase(method)) {

var message: String = req.getReader.readLine

if (message != null && message.indexOf("message") != -1) {

b.broadcast(message.substring("message=".length))

http://is.gd/hH3AaHhttp://is.gd/hH3AaH

1999 – Servlet API

override def doGet(req: HttpServletRequest, res: HttpServletResponse): Unit = {

var m: org.atmosphere.cpr.Meteor = org.atmosphere.cpr.Meteor.build(req)

m.addListener(new Console)

res.setContentType("text/html;charset=ISO-8859-1")

m.setBroadcaster(b)

if (req.getHeader(HeaderConfig.X_ATMOSPHERE_TRANSPORT).equalsIgnoreCase(HeaderConfig.LONG_POLLING_TRANSPORT)) {

req.setAttribute(ApplicationConfig.RESUME_ON_BROADCAST, true)

m.suspend(-1, false)

else {

m.suspend(-1)

override def doPost(req: HttpServletRequest, res: HttpServletResponse): Unit = {

var message: String = req.getReader.readLine

if (message != null && message.indexOf("message") != -1) {

b.broadcast(message.substring("message=".length))

http://is.gd/GcnG0Ahttp://is.gd/GcnG0A

2007 – REST API

@Path("/resource/{topic}")

@Produces(Array("text/html;charset=ISO-8859-1"))

class Resource {

@PathParam("topic") private var topic: Broadcaster = null

def subscribe: SuspendResponse[String] = {

return new SuspendResponse.SuspendResponseBuilder[String]()

.broadcaster(topic)

.outputComments(true)

.addListener(new Console)

.build

@Broadcast

def publish(@FormParam("message") message: String): Broadcastable = {

return new Broadcastable(message, "", topic)

http://is.gd/Df9Uvmhttp://is.gd/Df9Uvm

2011 – WebSocket API

http://is.gd/SEa4AKhttp://is.gd/SEa4AK

2011 – Client API

http://is.gd/9jumKthttp://is.gd/9jumKt

SwaggerSocket ProtocolSwaggerSocket Protocol

HTTP/REST Over

WebSocket

HTTP/REST Over

WebSocket

HTTP/REST Over

WebSocket

HTTP/REST Over

WebSocket

JSON based protocol

HTTP/REST Over

WebSocket

HTTP/REST Over

WebSocket

JSON based protocol

Support Pipelined Requests

HTTP/REST Over

WebSocket

HTTP/REST Over

WebSocket

JSON based protocol

Support Pipelined Requests

Fully ASYNCHRONOUS

HTTP/REST Over

WebSocket

HTTP/REST Over

WebSocket

JSON based protocol

Support Pipelined Request

Fully ASYNCHRONOUS

•Work with ANY existing technology, without any

changes

• No need to use Atmosphere API directly

• Protocol easily extensible

•Work with ANY existing technology, without any

changes

• No need to use Atmosphere API directly

• Protocol easily extensible

WebServer

Atmosphere

WebSocket

Protocol

WebSocket

Protocol

JerseyJerseyREST Resource

REST Resource

Benchmark

Comparing HTTP/keep-alive vs WebSocket

Conclusion

• Writing WebSocket doesn’t have to be complex

• Use technology/API that you know, don’t re-invent the wheel again!

• Twitter: @atmo_framework• Github: http://github.com/Atmosphere/atmosphere

• Wordnik: http://wordnik.com57

writing highly scalable websocket using the atmosphere framework and scala

websocket jetty

servlet api

support glassfish

x api changes

native comet api

compatibility jetty

api changes tomcat

uniform api

Technology

html5 websocket introduction

websocket protocol

scalable machine learning -...

websocket & html5

websocket com php

websocket bemutatás

scalable applications with scala

scalable solutions · real-world scala scalable solutions...

scala - a scalable language

scalable performance for scala message-passing concurrency...

messaging over the web with websocket & jms ·...

scalable generator: using scala in sier business...

websocket on rails

cs60021: scalable data mining...

websocket 1.0

scalable performance for scala message-passing...

scala - scalable language

scalable performance for scala message-passing...

java api for websocket -...

jsr 356: building html5 websocket apps in java ·...