SDSS Data Transfer

Jing-Jou YenDivision Manager

National Center for High-Performance Computing

(August 26, 2005)

22

OUTLINEOUTLINE

Project Background

Introduction to NCHC/TWAREN

Sloan Digital Sky Survey (SDSS) Overview

Network Architecture and Configuration

Network Performance Monitoring

Future Plan

33

SDSS Data Transfer Project It is a joint program NCHC with the Fermi Laboratories to mirro

r the SDSS data. The goal is to speed up the SDSS information sharing for phys

icists working in R&E institutes in Taiwan. NCHC computing, storage and networking resources enhance

functions in the astronomical research. NCHC uses TaiWan Advanced Research and Education Netwo

rk (TWAREN) for the SDSS data transfer. NCHC’s Operations teams

will ensure the quality for all efforts.

Computing Center

Network Operation Center

Knowledge Center

Taipei

Tainan

Hsinchu

Taichung

Core node equipment

44

NCHC is Taiwan’s only National Lab Dedicated to High-Performance Computing & Applications Storage, Networking & the Applications Development

NCHC Mission Provide resources and services Do research and development Offer education, training, and outreach

National Center for High-performance Computing NCHC

High-performance Computers

TANet2/TWARENPC Clusters

Storage/DatabasesApplication SW

Education, Trainingand Outreach

ConsultationTraining Workshops

LecturesExhibits

Industrial, Government, Academic Projects

International CollaborationsConferences

High-performanceComputing & Networking

Research and Development

Resources and Services

55

TaiWan Advanced Research and Education Network TWAREN

TWAREN - Successor of TANet2 TWAREN - One of the Most Advanced Networks/Operations in the World TWAREN Goals

• To provide a network infrastructure for academic and R&E community. • To stimulate creativity and foster talents

TWAREN Architecture • A hybrid network with 20G POS and DWDM technologies at its core.• Hierarchical topology: 3 layers (core, GigaPoPs, end nodes)• Eleven GigaPoPs - each links to the core

node at 20 Gbps and 1 dark fiber. • Highly scalable and flexible• Providing multiple services• International links to the USA• Integrated NMS Architecture

Taipei

NCU

NDHU

NCTU

NTHU

CCU

NCKU

NSYSU

NCNU

NCHU

SINICA NTU

Tainan

Hsinchu

Taichung

66

TWAREN Network topology

Taipei

Hsinchu

Taichung

Tainan

NTU

NSYSUNCKU

CCU

NCNU

NCHU

NTHU

NCTUNCU

SinicaNTU

StarLightStarLight CANARIECANARIE

CANARIECANARIEPacific WavePacific Wave

LALALANLALALAN

MAN LANMAN LAN

3*STM-4+2*STM-1

3*STM-4+3*STM-1 2.5G 2G

1.25G

1.25G

NETHERNETHERLandLand

1.25G

1.8G

2.5G

77

HP OpenView Network Node Manager (NNM) & CiscoWorks2000 for LAN/WAN & CTM

Cisco IP Solution Center

Cisco Secure ACS

HP OpenView Extend Topology & Multicast

NetworkElements

EMS

NMS

SMS

BMS

WAN/LAN

Cisco Info Center(Micromuse)

Remedy Help Desk(Trouble Ticket System)

NOC

IPv6

MPLS

IP TelephonyMulticast

Multimedia

HP OpenView Operation Manager

HP OpenView Performance Insight

&Report Pack for Cisc

o MPLS VPN / IP QoS

/ Cisco Ping / SA/Netflow / IPT / CAR / RMON

& Customize Report

Raw Data

HP OpenViewService Information Portal (SIP)

Apps

Apps

Apps

Service DeskApps

Apps

Apps

Apps

Apps

Apps

CarrierOSS/NMS

AlarmSLA

Reports

TWAREN NMS ArchitectureTWAREN NMS Architecture

88

Sloan Digital Sky Survey (SDSS) Overview

It is an very ambitious astronomical survey project.

The goal is to image one-half of the northern celestial hemisphere, and a smaller portion of the southern sky.

It determines the positions and absolute brightnesses of more than 100 million celestial objects.

The SDSS Southern Coadd project combines all images to detect very faint and distant astronomical objects.

Fermi National Accelerator Laboratory (FNAL) uses Grid3 to carry out a full coadd of all available data.

99

TWAREN Connections to Fermi Lab

Taipei

Hsinchu

Taichung

Tainan

NTU

NSYSUNCKU

CCU

NCNU

NCHU

NTHU

NCTUNCU

SinicaNTU

StarLightStarLight CANARIECANARIE

CANARIECANARIEPacific WavePacific Wave

LALALANLALALAN

MAN LANMAN LAN

3*STM-4+2*STM-1

3*STM-4+3*STM-1 2.5G 2G

1.25G

1.25G

NETHERNETHERLandLand

1.25G

1.8G

2.5G

1010211.79.59.252

140.110.240.10/24

HC-7609P(NCHC-SW2)

198.49.208.10 131.225.7.156

TWAREN International Optical Network

211.79.63.57/29

211.79.63.58/29

211.79.63.59/29NCHC-SW1FNAL-SW

[SDSS-server][SDSS client]

211.79.59.250[FNAL measurement client for CDF][NCHC measurement server]

ONS in Sartlight

NCHC ONS (HC)

[FNAL measurement server for CDF]

Network Topology

15454CH

15454SF

15600TP1

15454TP2

15600HC

1111211.79.59.252

140.110.240.10/24

HC-7609P(NCHC-SW2)

198.49.208.10 131.225.7.156

TWAREN International Optical Network

211.79.63.57/29

211.79.63.58/29

211.79.63.59/29NCHC-SW1FNAL-SW

[SDSS-server][SDSS client]

211.79.59.250[FNAL measurement client for CDF][NCHC measurement server]

ONS in Chicago SartlightHC NCHC ONS

[FNAL measurement server for CDF]

Network Connections

1212

Use Cisco 7609 & ONS (15454/15600) for connection

Use CTC, CTM or UCLP for lightpath set-up

Layer 1 international link for Hsin-Chu – Chicago

622 Mbps lightpath (Hsin-Chu – Taipei – S.F. – Chicago)

7 ONS’s included in the lightpath

Rsync: 2MB/s 8MB/s

Data Fragmentation

Policy Route

5.0 TB Storage

Network Set-ups

TWAREN International

NetworkONSONS

Starlight

FNAL

Hsin-chuNCHC

1313

• IPERF.MBPS: Max= 228.78 Mbps• Reverse IPERF.MBPS: Max= 213.27 Mbps • Available BW(Mbps): Max= 600.00 Mbps• RTT: 182 ms• No. of Hops: 3

Network Performance Monitoring

1414

Network Monitoring Topology at Fermilab

1515

Resources (Computing + Storage+ Network) Partnership with Universities and Institutes Production Certificate Authority Processing Functions Applications Definition International Collaborations

Future Plan