web scale computing - the endhiran way

11
© 2003-10, OrangeScape Technologies Limited. Confidential 1 Mani Doraisamy Chief Technology Officer, OrangeScape

Upload: mani-doraisamy

Post on 14-Jan-2015

2.235 views

Category:

Technology


3 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 1

Mani DoraisamyChief Technology Officer, OrangeScape

Page 2: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 2

What is Web scale computing?

A system which is Highly Available, Reliable, Transparent, High Performance, Scalable, Accessible, Secure, Usable, InexpensiveHas artificial intelligence And human emotions

Tech

nica

lly a

ccur

ate!X

Page 3: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 3

Download entire web onto a computer!

After a year, had some portion of it!(A healthy disregard for the impossible)

Page 4: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 4

Learning to count!

PR(A) = (1-d) + d (PR(T1)/C(T1) + ... + PR(Tn)/C(Tn))

Citations are important(How long does it take to go around web counting links?)

Page 5: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 5

BackRub to 10100

When it is free, we ask for more(How do we make it inexpensive for large user base?)

Page 6: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 6

Adding it up!

Download the entire web

Learning to count

Serving 10100 users

Total

= Storage (Massive)

= Performance (Massive)

= Scalability (Massive)

= Web scale

Page 7: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 7

Storage: When ACID becomes BASE

Distributed storage:Why cant we be more optimistic, instead of pessimistic?

Page 8: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 8

Performance: Divide and Conquer

8th standard math:One man can do a job in 2 days, and another can do it in 2 days. If they work together,in how many days will they finish the work?

Call it Burst compute/Fan out (with Map/reduce), if you want to be a Geek!

Page 9: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 9

Scalability: Creating an indestructible monster

Stateless - Highly Available with Transparent failoverIdempotency – Being a Ghazni!

Page 10: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 10

Summary

Chitti was right:You cant build one. We need many i.e. distributed systems.

Page 11: Web scale computing - the endhiran way

© 2003-10, OrangeScape Technologies Limited. Confidential 11

Shoot your questions!

Twitter: @manidoraisamyBlog: http://manidoraisamy.blogspot.com