symfony vs. message brokers

It’s all about eXperience

Gaetano Giunta

Symfony Live

Sept 2016

Symfony

vs.

Message Brokers

(tip: Symfony wins)

Message brokers in 1000 words

• RabbitMQ

• ActiveMQ

• Apollo

• Kafka

• Kestrel

• Amazon SQS

• ZeroMQ*

• And many more…

Can you name any broker?

• RabbitMQ

• ActiveMQ

• Apollo

• Kafka

• Kestrel

• Amazon SQS

• ZeroMQ*

• And many more…

Why should you use one? Which one?

A case study: generating M$Office docs

• Produce content in Microsoft Office formats

• Many formats for each document

• Both Word and Excel docs

• XML content generated by CMS

• LibreOffice used to generate MS Office and PDF

versions


Reality bites


Reality bites

• Slooow

• Rest assured that some of the docs will be pretty big

• Unreliable

• Depending on version, LO crashes from a-bit to almost-

always

• Race-prone

• Two conversion jobs in parallel might step on each other


…and the results are:


…and the results are:

• Ugly code: lots of polling, copying of files around,

manual locking

• Does not scale at all: only one conversion process

active at any given time

Web

serverPHP

Libre

Office

Waiting processes

TextBook scenario for introducing queues

Web

server

Worker

?

Rabbit

MQ

Libre

Office

PHP


Web

server

PHP

!

Rabbit

MQ

Libre

Office

PHP


Web

server

Symfony

!!!

Rabbit

MQ

Libre

Office

PHP

Is there a bundle for that ?

oldsound/rabbitmq-bundle

Is there a bundle for that ?

oldsound/rabbitmq-bundle

• Specific to RabbitMQ

• Consumers are long-lived php processes

• fatal errors

• mem leaks

• DB connections time out

• on your code or in a dependency?

A new hope

• kaliop/queueingbundle

• kaliop/queueingbundle-sqs

• kaliop/queueingbundle-stomp

Multiple protocol support

Multiple protocol support

Kaliop Queueing Bundles

fusesource/stomp-phpaws/aws-sdk-php oldsound/rabbitmq

ActiveMQ ApolloSQS RabbitMQ

Application

Easy to use

Easy to use

• Message encoding taken care of

• Has events your code can listen to

Message

received

Do stuff

Consump

tion

failed

Message

consumed

Exception

A design focusing on safety

A design focusing on safety

• The default consumer has been split in 2

• The listener is long lived

• The worker process is a Symfony console command

• It handles a single message then exits

Symfony

listenerSymfony

worker

Libre

OfficeQueue

I’llbe here all night

THANK YOU

https://github.com/kaliop-uk/kueueingbundle

• @gggeek

• www.kaliop.co.uk

symfony vs. message brokers

Internet