poolparty deployment

8/14/2019 Poolparty Deployment

1/77

Ari LernerMichael Fairchild

Monday, June 22, 2009


2/77

I have a great idea!

This site,its lets you post messages to your friends,

and they can follow you...



3/77

write an application...



4/77

write an application...instantiate servers...



5/77

write an application...

instantiate servers...configure servers...



6/77

write an application...instantiate servers...configure servers...

scale them up...



7/77


configure servers...scale them up...reconfigure...



8/77


configure servers...scale them up...

reconfigure..scale down...



9/77

and pay for it ?!?



10/77

Wouldnt it be nice if you could just

write one fileto do all that?



11/77

clouds.rb



12/77

cloud :twitterclonedo

end



13/77

cloud :twitterclonedoinstances 1..10000

end



14/77


instances 1..10000using :ec2

end



15/77

Its just Ruby



16/77


instances 1..1000using :ec2

has_file "/etc/motd"do

content "hello you"

endend



17/77

Lets go already!



18/77


configure servers...scale them up...

reconfigure..scale down...



19/77

Ew



20/77

cloud-start



21/77

cloud-start -s examples/fairchild.rb

*** Starting cloud pp1

0 running instances (1 - 3)

Adding default gem depdendencies

...

75.101.181.64 stderr => [Sat, 04 Apr 2009 16:46:01 +0000] INFO: Ran

execute[line_in_/etc/profile] successfully

[Sat, 04 Apr 2009 16:46:01 +0000] INFO: Chef Run complete in 29.883499

seconds

Your cloud has started. Your ip is 75.101.181.64



22/77

launching...



23/77

bootstrapping...



24/77

configuring...



25/77

cloud-list



26/77

$ cloud-list -s examples/fairchild.rb*** Listing cloud pp1****** Active instancesmaster 75.101.181.64 i-516f0f38



27/77

cloud-ssh

cloud-ssh -s examples/fairchild.rb

master 75.101.181.64 i-516f0f38Welcome to your PoolParty instanceroot@ip-10-251-201-157:~#



28/77

poolparty core resources

crondirectoryexecfile

hostmountpackageremote_file

symlinkuservariable



29/77

Puppet



30/77

Chef



31/77

Chef

Chef is a state based, declarative configurationmanagement engine.

You define recipes of how you want your system tolook and then chef makes it so.

~Ezra Zygmuntovich



32/77

chef doinclude_recipies "~/recipies/*"

has_git_repos :name => "/srv/paparazzi"do

source "git://github.com/auser/

paparazzi.git"at "/srv"

end



33/77

include_recipe "apache2"

include_recipe "passenger"

include_recipe "rails"

web_app "paparazzi"do

docroot "/var/www/paparazzi/public"

template "paparazzi.conf.erb"server_name "www.paparazzi.com"

server_aliases [node[:hostname],

node[:fqdn],

"paparazzi.com"]rails_env "production"

end



34/77


instances 1..1000

using :ec2

chef do

include_recipes "~/recipies/*"

has_git_repos :name => "/var/www/paparazzi"do

source "git://github.com/auser/paparazzi.git"

at "/var/www" end

end



35/77

cloud-configure



36/77

Pushes configuration

changes to the cloud



37/77



38/77

Idempotent



39/77

unchanged when

multiplied by itself



40/77

Run it more than onceand it wont change

things unless it should



41/77

cloud-configure



42/77

cloud-configure



43/77


44/77


45/77


46/77

OMG!Oprah mentioned

twitterclone!



47/77



48/77


49/77

collective metricsaveraged across the cloud



50/77

Unequal use of resources



51/77

My database server is overloaded,but my web server isnt



52/77

multiple clouds



53/77

pool :twitterclonedo

instances 1..4000

cloud :dbdo

expand_when "memory > 0.9"

end

cloud :webserverdo

maximum_instances 10

expand_when "load > 1.2"

end

end



54/77

:instances => 2..5

:using => :ec2:ami => 'alestic ubuntu 8.1'

:contract_when => "load < 0.65"

:expand_when => "load > 1.9"



55/77


end



56/77

Decentralized



57/77


58/77

Only cloud architecture



59/77

Ruby

(my)(postgre)sql(lite)

python

c

PHP



60/77


61/77

transcoding cloudemail blasting cloud

particle beam simulation cloud(getting girls) social networks

...


f


62/77

future



63/77

more remoter bases



64/77

using :ec2

using :vmware

using :gogrid

using :slicehostusing :vbox

using :ssh



65/77


66/77

launch_new_instance!terminate_instance(id)

describe_instance(id)describe_instances



67/77


68/77

Butterfly


69/77

Butterfly



70/77


71/77

tighter integration ofDNS

round robin load

balancing



72/77

quorum based actions

independent nodesnominate actions based

on local state



73/77

cloud-terminate


C it


74/77

Community

http://poolpartyrb.com

#poolpartyrb (@freenode)

[email protected]@atti.com

http://poolpartyrb.com/http://poolpartyrb.com/mailto:[email protected]:[email protected]:[email protected]:[email protected]://poolpartyrb.com/http://poolpartyrb.com/http://poolpartyrb.com/http://poolpartyrb.com/


75/77

Questions?



76/77

Thank you



77/77

Alternatives

Rightscale

Heroku

Scalr

poolparty deployment

Documents