[acm press the 1998 acm sigmod international conference - seattle, washington, united states...

1
The PointCast Network Satish Ramakrishnan Vibha Dayal PointCast Inc. PointCast Inc. 501 Macara Avenue 501 Macara Avenue Sunnyvale, CA 94086 Sunnyvale CA 94086 408.990.7000 408.990.7000 satish @I pointcast.com [email protected] ABSTRACT PointCastInc, the inventor and leader in broadcast news via the Internet and corporateintranets was founded in 1992 to deliver news asit happens from leading sources such as CNN, the New York Times, Wall StreetJournal Interactive Edition and more, directly to a viewer’s computerscreen. The PointCast Network is an integrated client/server system.The system give users control of selecting kinds of information the client retrieves and, within limits, the frequency of those retrievals. The systemis divided into client and server segments, referred to as “PointCast Client” and “the DataCenter” respectively. PointCastclient is a programthat runs on the user’s Internet-connected computer, and performs a number of functions in addition to retrieving information from the DataCenter. The server side of the system, known as the PointCast DataCenter, supportsthe client by providing compelling content in a timely fashion The Data Center is composed of multiple sites geographically distributed all over US, each carrying a number of industrial strength web servers called “PointServers”. The PointServers are highly customized and “infinitely” scalable to serve close to 200 million requests handled by the PointCastnetwork in a day. The PointCastnetwork receives content from over 100 different sources via satellite links or over the intemet. A cluster of servers in the Data Center run customizedprocesses round the clock which assimilatedata from various sources to index, format and store it in multiple content databases. This presentation will describe the basic plumbing of the PointCast Network and how some of the challenges of establishing one of the busiest data centers in the world were addressedand implemented. It will focus on following issues: . fault tolerance . load balancing . achieving scalability through pre-caching on servers . packaging information to optimize internet bandwidth usage . minimizing data latency. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies sra not made or distributed for profit or commercial sdvsn- tsge and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or tc redistribute to lists, requires prior specific permisrion and/or a fee. SIGMOD ‘98 Seattle, WA, USA 8 1998 ACM 0-89791-995.5/98/006...$5.00 520

Upload: vibha

Post on 15-Dec-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: [ACM Press the 1998 ACM SIGMOD international conference - Seattle, Washington, United States (1998.06.01-1998.06.04)] Proceedings of the 1998 ACM SIGMOD international conference on

The PointCast Network Satish Ramakrishnan Vibha Dayal

PointCast Inc. PointCast Inc. 501 Macara Avenue 501 Macara Avenue

Sunnyvale, CA 94086 Sunnyvale CA 94086 408.990.7000 408.990.7000

satish @I pointcast.com [email protected]

ABSTRACT

PointCast Inc, the inventor and leader in broadcast news via the Internet and corporate intranets was founded in 1992 to deliver news as it happens from leading sources such as CNN, the New York Times, Wall Street Journal Interactive Edition and more, directly to a viewer’s computer screen.

The PointCast Network is an integrated client/server system. The system give users control of selecting kinds of information the client retrieves and, within limits, the frequency of those retrievals.

The system is divided into client and server segments, referred to as “PointCast Client” and “the DataCenter” respectively. PointCast client is a program that runs on the user’s Internet-connected computer, and performs a number of functions in addition to retrieving information from the DataCenter.

The server side of the system, known as the PointCast DataCenter, supports the client by providing compelling content in a timely fashion The Data Center is composed of multiple sites geographically distributed all over US, each carrying a number of industrial strength web servers called “PointServers”. The PointServers are highly customized and “infinitely” scalable to serve close to 200 million requests handled by the PointCast network in a day.

The PointCast network receives content from over 100 different sources via satellite links or over the intemet. A cluster of servers in the Data Center run customized processes round the clock which assimilate data from various sources to index, format and store it in multiple content databases.

This presentation will describe the basic plumbing of the PointCast Network and how some of the challenges of establishing one of the busiest data centers in the world were addressed and implemented. It will focus on following issues:

. fault tolerance

. load balancing

. achieving scalability through pre-caching on servers

. packaging information to optimize internet bandwidth usage

. minimizing data latency.

Permission to make digital or hard copies of all or part of this work for

personal or classroom use is granted without fee provided that copies sra not made or distributed for profit or commercial sdvsn- tsge and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or tc redistribute to lists, requires prior specific permisrion and/or a fee. SIGMOD ‘98 Seattle, WA, USA 8 1998 ACM 0-89791-995.5/98/006...$5.00

520