server infrastructure of wikimedia · wikimedia server locations pmtpa – main site 285 servers...

2007 December 13th Manuel Schneider

Server Infrastructureof Wikimedia

Wikipedia – Wikibooks – Wikinews – Wiktionary – Wikiquote – Wikisource – Wikimedia Commons – Wikiversity – ...

2007 December 13th Manuel Schneider

Wikimedia Server Locations

● pmtpa – Main Site285 serversTampa, USA (Florida)hosted by Wikimedia Foundation

● knams – Europe Cluster28 serversAmsterdam, Netherlandshosted by kennisnet

● yaseo – Asian Cluster23 serversSeoul, Coreahosted by Yahoo

2007 December 13th Manuel Schneider

Maintenance

● 3 paid server technician

● 1 paid software developer

● several volunteers

● knams & yaseo sponsored hostingpmpta, servers, staff paid by donations

2007 December 13th Manuel Schneider

Server Infrastructure

● Apache as application server (pmtpa)LAMP

● MySQL clusters (pmtpa)3 master servers11 slavesdata replication to toolserver cluster (knams)

● eAccelerator as PHP encoder / cache (pmtpa)

● memcache for session data (pmtpa)

● NFS storage for files (pmtpa)

2007 December 13th Manuel Schneider

Server Infrastructure

● geographically distributed proxy serversreading access for anonymous usersstatic content (worldwide)

● poor-man geographical DNS (worldwide)

● loadbalancer distribute HTTP requestbased on URL hash value (worldwide)

● cache purging using HTCP (worldwide)UDP multicastrewritten HTCP extension for squid

2007 December 13th Manuel Schneider

Overview 2006

2007 December 13th Manuel Schneider

Overview 2004

2007 December 13th Manuel Schneider

Overview Toolserver Cluster