1

BUSINESS INTELLIGENCEFOR

DECISION SUPPORT SYSTEMS

P LENIN

TECHNICAL DIRECTOR

NATIONAL INFORMATICS CENTRE

MINISTRY OF COMMUNICATION & IT

NEW DELHI -110 003.

2

Why Now, Not Then?

DATA AVAILABILITY–MASSIVE AMOUNT /ELECTRONIC FORM–WIDESPREAD USE OF APPLN SYSTEMS–POWERFUL H/W, PARALLEL SYSTEMS–NEW S/W TECHNOLOGY

3

DEMAND FOR DATA

IS ability to deliverGrowth in

user demand

Growing gap

Source: Gartner Group

4

ER MODEL

P & V DB

Admin -I

District

States

Admin -II

Library

Appln Div.

Purchase

Projects A/CDiv

StoresDiv

Web Services

NICSI User Min.s

DG Office

ABCDiv.

XYZDiv.

LMNDivision

Contact

5

WHY BUSINESS INTELLIGENCE SOLUTIONS ?

BI SYSTEMS NOT A REPLACEMENT FOR RDBMS/OLTP TO COMPLEMENT RDBMS/OLTP SYSTEMS FOR PLANNERS AND DECISION MAKERS

* USE WHEREVER AND WHENEVER /WEB BASED* MINIMUM DEPENDENCY ON IT PROFESSIONAL* EXTRACT IMPLICIT KNOWLEDGE/PATTERN

6

WHY BI/ DATA WAREHOUSE?

-NEED OF INFORMATICS REQUIREMENT IS DYNAMIC

-ALSO NEED OF EVERY DEPTT VARIES [SECRETARY/COMMISSIONER/JT.COMM/DY.COMM.]

-INTEGRATED/SHARED INFORMATION•DESIGN NOT SUITABLE FOR BUSINESS ANALYSIS• LIMITED ANALYSIS• DATA CONTENT CHANGES• VIEWS BASED ON OBJECTIVES• REASONING [EX. PDS PUNJAB/ORISSA]

7

WHY BI TECHNOLOGY?

- TO HANDLE DATA FROM MUTI-SOURCE- TO HANDLE LARGE VOLUME OF DATA- MULTIDIMENSIONAL –DRILL THRU-ANALYSIS- PRESERVE AND USE THE HISTORICAL DATA- TO EXTRACT HIDDEN KNOWLEDGE/PATTERN- TO DO AD HOC QUERY

::

8

WHAT BENEFITS YOU GET OUT OF DW?

* EASIER FOR END USERS TO NAVIGATE, UNDERSTAND AND QUERY• ENABLE QUERIES THAT CUT ACROSS DIFFERENT SEGMENTS• COMPLEX QUERY IN NORMALIZED DB CAN BE BUILD EASILY• EFFICIENT WAY TO MANAGE AND REPORT• PROVIDES THE CAPABILITY TO ANALYZE LARGE AMOUNT OF HISTORICAL DATA

9

Data Warehouse

W H INMON, A DW IS A

SUBJECT ORIENTED (Vs APPLN. ORIENTED), INTEGRATED, TIME VARIANT (HISTORICAL vs. CURRENT), NONVOLATILE (STABLE vs. CONTINUOUS CHANGE) COLLECTION OF DATA IN SUPPORT OF MANAGEMENT‘S DECISION MAKING PROCESS.

Maintained separately from the organization’s operationaldatabase

10

A SAMPLE DATA CUBE /DIMENSION MODEL

Total annual salesby country and productDate

Produ

ct

Cou

ntr

ysum

sum TV

DVDPC

1Qtr 2Qtr 3Qtr 4Qtr

U.S.A

CHINA

INDIA

sum

Total of all product sales

by country and quarter

Total of all product sales in all countries by quarter

Total of all item sales in all countries by product

Total annual sales of all items by Country

Total annual sales.

11

CARS SOLD

SANTRO MARUTIDATE

ORDERNO

08/08/04

09/08/04

1

23

45

1

2

3

3

2

4

7

1

0

5

3

2

2

3

2

0

6

2

3

12

  CARS SOLD

Date Santro Maruti

08/08/04 15 13

09/08/04 9 8

NO OF RECORDS REDUCED BY AGGREGATION

13

Transformation of Data

Transaction processing

Cleansing / normalization

Warehouse

SQL reporting

Exploration / analysis

Data

Information

14

Basic elements of Data warehouse

Services:

Clean, combine, and standardizeConform DimensionsNo user query services

Data Store:

Flat files and relational tables

Processing:

Sorting and sequential processing

DATASTAGING

AREA

Data Mart #1

DimensionalAtomic and summary dataBased on a single business process

Data Mart #2

Similar design

DW Bus:Conformed facts and dimensions

Ad hoc query tools

Report Writers

Analytical Applications

Modeling:

Forecasting

Scoring

Data MiningExtract

Extract

Extract

Load

Load Access

Access

OPERATIONAL SOURCE SYSTEM

DATAPRESENTATION

AREA

DATAACCESSTOOLS

15

METADATAMETADATA

16

THE OLAP SOLUTION

A PROCESS OF FAST ANALYSIS OF SHARED MULTIDIMENSIONAL INFORMATION --ENTERPRISE-WIDE DATA ANALYSIS

17

OLAP

- FAST ? - WHAT ANALYSIS? - SHARED - MULTIDIMENSIONALON ENTERPRISE-WIDE DATA

VIEW FROM DIFFERENT ANGLE

18

# Drill-down Process (Browsing)

Time

Year

Quarter

Month

Week

LOCATION

REGION

STATE

District

City

SOURCE

SALES TAX

CEN.EX

VAT

XYZ

** What all with OLAP?

19

BI SYSTEMS DEVELOPMENT IN NIC

• SOCIO ECONOMIC DATA OF UP• BHOOMI LAND RECORDS• IRRIGATION SURVEY DATA• SPECIAL FRAUD INVESTIGATION• FERTILIZER PROD/MOVT/CONSUMPTION• EXPORT/IMPORT OF MAJOR COMM+INDEXES FOR RIS/COMMERCE MIN.* CUSTOMS IMPORT --- ALL AT NIC HQR.

20

BI SYSTEMS DEVELOPMENT IN NIC

STATE UNITS:

• KERALATreasury ExpenditureSub-Reg Office Stamp Duty CollectionCivil Supplies Office ExpenseDisease survelliance

• TAMIL NADUChild Labour Education

• MAHARASHTRA/PUNE• ANDHRA PRADESH• GUJARAT

21

CUSTOMS IMPORT DATA

LIMITED INPUTCUSTOMS IMPORT DATA

ITEM LEVEL DATA[Bill of Entry, Assessment value, Duty, Duty Foregone, CTH, CETH, BCD NOTFN, ….]

20 SITES ONLYTIME RANGE: APRIL 2003 TO DEC. 2004

DATA SIZE = 1.45 Cr RECORDS = 5GB

22

NIC DW ARCHITECTURE

DATA SERVER (ORACLE 9i/10G)

STORAGE AREA

NETWORK (SAN)

ETL(DECISION STREAM)

COGNOS SERVER

POWERPLAY REPORTNET

CLEMENTINE

WINDOWS 2000 SERVER(OS)

CLIENT

To access & change the layout of Powerplay and ReportNet reports…

RETRIEVE

Store

Extract

Load

Response

RequestDATA SOURCE

23

BI FOR BHOOMI LAND RECORDS

- TO DEMONSTRATE THE POWER OF BI TECH

- JOINT EFFORT BY A&M DIV AND NIC-KSU- NIC KSU …DOMAIN EXPERT- A&M DIV AS BI TECH EXPERT- FOR KANNADA LANGUAGE TOOK ASSISTANCE

FROM KEYSOFT

24

BI SYSTEM PLAN FOR KSU STATE

• USE THE HW/SW FACILITIES AT THE HQRS.

• KEEP THE DATA AT KSU SERVER AND USE HQR FACILITIES FOR SW

• HAVE BOTH HW AND SW IN THE KSU SERVER