I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

YJanuary 2002

INGEN's advanced IT facilities

Craig A. Stewart

stewart@iu.edu

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

License terms

• Please cite as: Stewart, C.A. INGEN's advanced IT facilities. 2002. Presentation. Presented at: Department of Medical Genetics (IU School of Medicine, Indianapolis, IN, 8 Jan 2002). Available from: http://hdl.handle.net/2022/15222

• Note: The same basic presentation was given repeatedly in various departments at the IU School of Medicine. Rather than store the same slide deck repeatedly, this example from early in 2002 was uploaded to ScholarWorks, representative of the slide deck used throughout the year of 2002. Other presentations given with this slide deck include:

– Stewart, C.A. 2002. INGEN's advanced IT facilities. Presentation. 19 Mar, Department of Endocrinology, IU School of Medicine, Indianapolis, IN.

– Stewart, C.A. 2002. INGEN's advanced IT facilities. Presentation. 20 May, 2002. School of Informatics, Indianapolis, IN.– Stewart, C.A. 2002. INGEN's advanced IT facilities. Presentation. 18 Jun, Wells Center, IU School of Medicine, Indianapolis,

IN.– Stewart, C.A. 2002. INGEN's advanced IT facilities. Presentation. 15 Oct, Indiana Health Industry Forum meeting,

Indianapolis, IN. – Stewart, C.A. 2002. INGEN's advanced IT facilities. Presentation. Presented to Division of of Nephrology, IU School of

Medicine, Indianapolis, IN. 4 November, 2002.

• Except where otherwise noted, by inclusion of a source url or some other note, the contents of this presentation are © by the Trustees of Indiana University. This content is released under the Creative Commons Attribution 3.0 Unported license (http://creativecommons.org/licenses/by/3.0/). This license includes the following terms: You are free to share – to copy, distribute and transmit the work and to remix – to adapt the work under the following conditions: attribution – you must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). For any reuse or distribution, you must make clear to others the license terms of this work.

2

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

IT@IU in a nutshell

• Academic programs in IT through computer science, library and information sciences, engineering and technology, and most notably through new School of Informatics

• CIO: Vice President Michael A. McRobbie• ~$100M annual budget• Technology services offered university-

wide

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

IU School of Medicine in a nutshell

• Located primarily at IUPUI• 2nd largest School of Medicine in the US• History of accomplishment in identifying

genetic basis of disease (certain forms of alcoholism, Huntington’s, bipolar disorder)

• Key assetts:– Regenstrief Institute– Imaging

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Indiana Genomics Initiative

• Funded by a 3-year, $105M grant from the Lilly Endowment (a private charitable trust). Intended to be seed money that is heavily leveraged

• Goals:– Perform basic and applied research that will result in

improved human health and health care.

– Enhance central Indiana’s high-tech economy

• http://www.ingen.iu.edu/

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

INGEN

• Comprised of a mix of Programs (primary research areas) Cores (supportive functions, which may also be research areas in their own right).

• Direct oversight by President Brand; lead by Executive Committee (which includes VP McRobbie); general operational guidance by Operations Committee (Program & Core Directors)

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Major Accomplishments to date

• IU’s Teraflop SP

• Recruitment of Eric Meslin as Director, IU Center for Bioethics (and InGen Bioethics core)

• Genetics department head hire imminent

• Bioinformatics director hire close

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

New Initiatives

• Central Indiana Life Sciences Initiative– Central Indiana Corporate Partnership (CICP)– City of Indianapolis– Indiana University – Purdue University– Indiana Health Industry Forum (IHIF)– $1.5B total investment (this includes existing as well as

newly committed funds)

• $12M in new Indiana Proteomics Consortium, a commercial venture between Eli Lilly and Co., ARTI (IU), and the Purdue Research Foundation

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

IT and InGen

• InGen’s IT core is a critical part of the infrastructure for the initiative as a whole– Supercomputing– Massive Data Storage– Visualization

• IT is one of the paths by which InGen should enhance the Indiana Economy

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Oct 17 2001 IU/IBM announcement

• IU tripled the capacity of its IBM, to > 1 TFLOPS (a trillion mathematical operations per second).

• IU’s SP is the largest university-owned supercomputer in the US

• Large part of this acquisition made possible via funding from InGen

• IU and IBM also announced a partnership in developing new supercomputer applications for the life sciences

• “… The teraflop supercomputer is a key first component of INGEN's IT infrastructure and will provide a major boost to scientific progress at IU in this area.“ IU Vice President fpr Information Technology & CIO Michael A. McRobbie

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y Photo: Tyagan Miller. May be reused by IU for noncommercialpurposes. To license for commercial use, contact the photographer

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

IBM SP highlights

• 1.005 TFLOPS, currently 50th on Top500 list• 632 processors• 484 GB total memory• Mostly Power3+, but includes one 16-processor

Power4-based Regatta node• To be distributed across IUB and IUPUI campuses

using I-Light infrastructure

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Massive Data Storage

• IU has a large massive data storage system based on IBM and STK tape robotic systems. A new STK storage silo was just installed in Indianapolis.

• These will be expanded with 100s of TeraBytes (TBs) of tape storage in order to support INGEN

• IU’s massive data storage system is based on HPSS (High Performance Storage System) which provides for excellent security.

• Mirrored storage in Indianapolis and Bloomington should provide safety in data storage

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Photo: Tyagan Miller. May be reused by IU for noncommercialpurposes. To license for commercial use, contact the photographer

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Advanced Visualization

• UITS, IU School of Medicine, and IUPUI Computer & Information Science have already collaborated to create 3-DIVE (3-D Interactive Volume Explorer)

• InGen will add 3-D visualization environments to the IU School of Medicine to enable new ways of gaining insight in biomedical research

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

3-DIVE

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Sun E10000

• IU is a Sun “Center of Excellence” and plans to pursue collaborative research with Sun in the area of Chemical Informatics

Photo: Tyagan Miller. May be reused by IU for noncommercialpurposes. To license for commercial use, contact the photographer

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Example INGEN IT development projects

• Parallel techniques for rendering PET scan images• Protein Family Annotator (Possible IBM

partnership project)• Computational phylogenetics• Biologist’s Portal• DiscoveryLink as a means to interconnect IU

School of Medicine databases (Possible IBM partnership project)

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

AVIDD

• Distributed facility for management, Analysis, and Visualization of Instrument-Driven Data

• $1.8M grant from NSF

• Consists of computational, data storage, and visualization components

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Critical elements

• Distributed Linux cluster, initially IA32, later addition of McKinley-based nodes

• Distributed visualization environments, including small-scale devices placed in individual laboratories

• Capability to handle large data sets and do “pre-emptive processing”

• Educational component, especially at IUN

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

General HPC strategy thoughts

• Maintenance prepaid, bundled in with purchase

• Vendor partnerships large and small• Programming support and outreach area

critical component of expanding fields affected and number of users

• HPC systems become attractors for faculty hires

I

N

D

I

A

N

A

U

N

I

V

E

R

S

I

T

Y

Important URLs

• University Information Technology Services: www.indiana.edu/~uits/– InGen IT Core:

www.indiana.edu/~rac/bioinformatics/ingen.html

• IU Teraflop SP announcement: www.indiana.edu/~rac/outreach.html

• IT@IU: it.iu.edu