official typo3.org infrastructure &the typo3 server admin team

TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012

Die offizielle typo3.org Infrastruktur &

das TYPO3 Server Admin Team

[slides in english]

Official typo3.org infrastructure &the TYPO3 Server Admin Team


Your Presenter

Hi,

I’m Steffen!

Please give me feedbackabout this presentation!

[email protected]

@StGebert on Twitter

mailto:[email protected]



I live in Würzburg

Studied Computer science there

Photo by Juergen Mangelsdorf (CC)http://www.flickr.com/photos/22084572@N07/2217991811/

http://www.flickr.com/photos/22084572@N07/2217991811/



Day-to-day Job

Now PhD student and researcher

• Future Internet research

Photo by Paul Soler-Moya (CC)http://www.flickr.com/photos/40351463@N00/3927504524/




TYPO3 Core Team Member


TYPO3.org Server Admin Team Member


Our Team


The team

Christian Trabold Fabien Udriot

Michael Stucki (Leader)

Steffen GebertPeter

Niederlag


Contacting the Team

• [email protected] (handled through OTRS)

• Forge projects (Other > Server Team)http://forge.typo3.org/projects/team-server-public

• Team-Page on typo3.orghttp://typo3.org/teams/server-team/



http://forge.typo3.org/projects/team-server-public

http://forge.typo3.org/projects/team-server-public

http://typo3.org/teams/server-team/

http://typo3.org/teams/server-team/


Responsibilities & Working Mode

• Maintenance of the official server infrastructure

• Not: Maintaining all the web sites (*)

• But, of course, we maintain also web sites

• Bi-weekly Skype-Meetings (Tuesdays 8:00 am)

• Private Mailing list

* my definition!


Public Sites and Services


typo3.org


wiki.typo3.org


lists.typo3.org

everybody subscribed?


lists.typo3.org


bugs.typo3.org


forge.typo3.org


forge.typo3.org

• Collaboration platform

• Project hosting for Core and Extensions

• Issue Tracker

• Wiki

• Connection to Version Control Systems (SVN/Git)


forge.typo3.org


bigbluebutton.typo3.org


api.typo3.org


notes.typo3.org


ci.typo3.org


metrics.typo3.org

• Code Metrics for Core and Extensions


translation.typo3.org


translation.typo3.org (2)

• suggestions for translations

• approval by team members

• more improvements upcoming


svn.typo3.org

• SVN Version Control System - svn://svn.typo3.org

• Used by 2043 extensions


git.typo3.org

• Git Version Control System - git://git.typo3.org


review.typo3.org


review.typo3.org

• Review process prior to merge

• Used for TYPO3 CMS Core, Flow, Neos, couple of Extensions

• Transparent development

• Everybody allowed to push new patches


get.typo3.org


(government.v4.)demo.typo3.org


status.typo3.org


forum.typo3.org


forum.typo3.org

Caution: Work in progress!

http://forum.typo3.org

User: t3crrPassword: unperfekt

Please test it!Report bugs to http://forge.typo3.org/projects/show/team-forum(Others > Server Team > forum.typo3.org)



http://forge.typo3.org/projects/show/team-forum

http://forge.typo3.org/projects/show/team-forum


Behind the Scenes


Infrastructure

• 100% sponsored

• Five servers

• Debian Linux

• OpenVZ virtualization


typo3.org

• Relaunched in April 2012

• Split into 5 VMs

• Proxy (running nginx)

• Web (running varnish, Apache, PHP)

• MySQL

• SOLR

• Jenkins


Single Sign-On

• One password to rule them all

• Based on DirectSSO (single-signon.com)

• Authentication against fe_users


Zabbix Monitoring


Chef

• Configuration Management Software

• “Infrastructure as Code”

• Configuration is under version control

• Packaged into “Cookbooks” containing “Recipes”

• Chef-Server as central hub


Chef: Cookbooks

• Dependencies between cookbooks

• e.g. TYPO3 cookbook uses Apache2 cookbook to create vHosts

• Notification triggers actions(config file changes -> service restarts)


Chef: Architecture

• Chef-client runs on every server

• Communicate with our Chef-Server

• Client registers once at the Chef-Server

• Authenticated data exchange (through certificates)

• Chef-Client retrieves roles, cookbooks and attributes

• Chef-Client executes the Ruby code and configures the Linux system


Chef: Attributes

• Per-host attributes are saved in Chef Server

• Examples for attributes

• Host name for Apache vHost

• Datacenter-specific smarthost for postfix

• Password of the MySQL user


Chef: Resources

Example: MySQL cookbook / Server recipe

• Install the Package

• Deploy the config file my.cnf


Chef: Resources

Example: MySQL cookbook / Server recipe

• Define the service mysql


Chef & Vagrant

• Vagrant provides API for VirtualBox

• `vagrant up` creates/starts VM

• Configures the VM as defined in Chef

• Great combination!

• Example

• git://git.typo3.org/Teams/Server/Vagrant/Typo3Org.git

• typo3.org in a box (or two..)


Chef: Cookbook Sharing

• Healthy community writing cookbooks

• Our cookbooks open-sourcedhttp://github.com/typo3-cookbooks

http://github.com/typo3-cookbooks

http://github.com/typo3-cookbooks


The Future


Future plans 2012

• Software upgrades of forge.typo3.org and review.typo3.org

• Central message queue

• Self-provisioned Git support for community extensions

• Centralized Syslog-Server based on Logstash, Greylog2 & Kibana(see Christian Trabold’s T3CON12-ASIA presentation)

• Improve Chef coverage

• Debian Wheezy updates

• Year 202x

• LDAP... would be nice..

contributions welcome!

official typo3.org infrastructure &the typo3 server admin team

Technology

typo3camp rheinruhr

typo3camp rheinruhressen

server team http

typo3 server admin team

server admin team member

team members

typo3 cookbook

recipes chefserver