using sql server as a data integration platform

2008 GIS & Data Management Conference

National Park ServiceU.S. Department of the Interior

Resource Information Management DivisionNational Information Services CenterOffice of the Chief Information Officer

Using SQL Server as a Data Integration Platform

Allen Sparks

Enterprise GIS ProgramResource Information Management Division

National Information Services CenterOffice of the Chief Information Officer




Overview

• Islands of Data & Applications• SQL Server Integration Services• How the EGIS Program Currently

Leverages SQL Server • Integration with GeoDatabases• Accessing SQL Server Data from

Clients




Islands of Data and Applications

FMSS

LCS

ASMIS

NPS Org Codes

ActiveDirectory Lotus

Domino

NPS FocusNRIS

…




We Need Bridges (or a boat)

FMSS

LCS

ASMIS

NPS Org Codes

ActiveDirectory

…

NPS FocusNRIS

My FavoriteApplication




The Ideal (Future) Solution

FMSS LCS ASMIS

NPS Org Codes

… …

NPS Focus

NRIS


“Enterprise Service Bus”SOA … Web Services

IRMA




An Interim “Bridge” Solution

FMSS LCS ASMIS

NPS Org Codes …

NPS Focus

NRIS


SQL Server Integration Services

…

Web Services




SQL Server Architecture• Database Engine

– core service for storing, processing, and securing data

• Analysis Services– supports data analysis, online analytical

processing (OLAP) and data mining• Reporting Services

– comprehensive data reporting • Integration Services

– a platform for building enterprise-level data integration and data transformations solutions




SQL Server Integration Services (SSIS)

• a rich set of built-in tasks and transformations;

• tools for constructing packages; • Integration Services service

– running and managing packages.

• Graphical tools & Wizards– No code writing required;

• Object Model API – custom tasks & other package objects.




SSIS Architecture

Project

Package(s)

Connections

Tasks

Dataflow

ControlFlow

EventHandlers




Visual Studio




• Merging Data from Heterogeneous Data Stores

• Populating Data Warehouses and Data Marts

• Cleaning and Standardizing Data

• Automating Administrative Functions and Data Loading

Typical Uses of SSIS




EGIS Use of SQL Server• FMSS Data Access

–FMSS Data Replication• Oracle SQLNet Client• ODBC• SQL Server Import/Export Wizard

–Synonyms

–Views




• Oracle SQLNetTNSNames.ora

FMSS=(DESCRIPTION = (ADDRESS_LIST =

(ADDRESS=(PROTOCOL=TCP)(HOST=__)(PORT=1521)))

(CONNECT_DATA = (SID = MAXREPT)))

• ODBC– Oracle Driver references SQLNet Service

Name FMSS

• SQL Server Import / Emport Wizard– DTSWizard.exe

FMSS Data Access




FMSS Data Access




FMSS Data AccessDefine Query - select * from <table>




FMSS Data Access




SSIS Package




• Geodatabase Replication– NPSView

• Simple (non-versioned)• One-way Replication

FMSS Data Access




• Theme Table

FMSS Data Access




FMSS Data Access• Buildings View




FMSS Data Access• Synonyms (in Geodatabase)

CREATE SYNONYM [dbo].[FMSS_Export_syn] FOR [FMSS].[dbo].[V_FMSS_Buildings]




FMSS Data Access• Views using Synonyms (in Geodatabase)




FMSS Data Access• View - Joined using Synonyms (in GDB)




NPS Buildings Statistics




Access to SQL Server Data from ArcGIS




Access to SQL Server Data from MSAccess

The ODBC Data Source Administrator is used to create and manage ODBC connections.




Access to SQL Server Data from MSAccess1

2

3

4




5


6

7




Questions?

using sql server as a data integration platform

Documents