project portfolio
TRANSCRIPT
Table of Contents
• Project Overview• T-SQL• Integration Services (SSIS)• Analysis Services (SSAS)• MDX Samples• KPIs and Excel Services• Reporting Services (SSRS)• PerformancePoint and SharePoint (MOSS / PPS)
SetFocus Business Intelligence Master Program
Introduction
This portfolio contains relevant samples of my Business Intelligence Master program at SetFocus. The selections reflect my past experience in extracting and cleansing data to support both operations and management decision-making process. Both the intensity of the course and the projects are the equivalent of two years of practical, hands-on experience.
Core Technologies Covered
Microsoft SQL Server 2005 and 2008 Database Engine SQL Server 2005 T-SQL SQL Server Integration Services (SSIS) SQL Server Analysis Services (SSAS) SQL Server 2005 MDX SQL Server Reporting Services (SSRS) Microsoft Office Performance Point Server (PPS) Microsoft Office SharePoint Server 2007 (MOSS)
Target Audience
Business executives I.T. managers Information workers
Project Goals
Using Visio, create a logical data model to support business requirements Create a staging database for assembling data from other data sources Design and create an ETL solution to update the staging database Write MDX queries to create graphs and tables Create calculated members and key performance indicators (KPIs) in SSAS Produce detailed and summary reports using SSRS, then export to Performance Point Create Scorecards using Microsoft Office Performance Points (MOSS) Implement Business Intelligence solution using PPS DashBoard
T-SQL SamplesManipulating dates is important when creating reports!
T-SQL SamplesMath using T-SQL
T-SQL SamplesInner Joins and Outer Joins
T-SQL SamplesUsing Union to Combine Sets of Outputs
Use SSIS to extract, transform and load (ETL) data from external data sources to a staging area. It involves a number of fairly complex steps.
The objective is to have one clean database of conformed, reliable data from which we can generate reports or conduct further business analysis
• Create SSIS packages to connect to and import from external, raw data sources such as .CSV and .XLS files
• Validate data for logic error e.g. time sheet entries for closed projects• Cleanse and load data into staging database in MS SQL Server 2005• Flush errors to flat files for review and follow-up• Send emails to administrator on results of the ETL process, along with
brief detail of number of raw rows inserted, updated or flushed to error files
• Create a master package to shrink, re-index and backup database.
SSIS – Integration ServicesExtract, Transform and Load Data from External Sources
SSIS – Integration ServicesFirst, set up the control flow, we need the container to loop through all the timesheets and email notification
alerts when the SSIS packages have completed the batch job
SSIS – Integration ServicesThe data flow steps through the detail of the actual ETL process
SSIS – Integration ServicesTwo more packages, one for loading clients grouped by franchise and the other to load employee data
• Design and create an OLAP model from the staging database
• Using SSAS, set up a CUBE with dimensions, fact tables, calculated members and key performance indicators.– Verify the dimensions and fact tables are correctly identified as such– Modify the AllWorksCalendar dimension to create a hierarchy
• Slice and dice data using SSAS and Multi-Dimension Expressions (MDX)
SSAS – Analysis ServicesA Multi-dimensional Database enables Business Intelligence Gathering
SSAS – Analysis ServicesUse Business Intelligence Design Studio(BIDS) to create an OLAP-database and a Data Source View
• When creating the CUBE, SSAS sometimes cannot tell the difference between a dimension and a fact, the B.I. Analyst will have to resolve that in order for SSAS to move ahead.
• Facts can be accessed by dimensions directly, through a reference table or in a many-to-many relationship.
SSAS – Analysis ServicesAccess Fact Tables by Dimensions
SSAS – Analysis ServicesSet up Calculated Members and Key Performance Indicators (KPIs)
This KPI calculates the increase in overhead cost with a goal of 10% as neutral. Anything above that would generate a red status indicator; below that would generate a green status indicator and any increase between 10% and 15% would generate am amber indicator.
SSAS – Analysis ServicesSet up Calculated Members and Key Performance Indicators (KPIs)
• Excel Services was used to connect to the CUBE and a pivot table was used to create the reports with embedded KPIs
• In this screen shot for increase in overhead by categories, the red indicates an increase of over 15% over last quarter, amber indicates an acceptable goal of between 10% and 15% and green indicates an increase of less than 10%.
Using Excel Service to Report on KPIs
• This screenshot shows the increase or decrease of profit by clients and relative to the previous quarter. • If the increase is greater than the goal of 15% it shows a green indicator, if it is between 5% and 15% an
amber indicator and if it is below 5% a red indicator
Using Excel Service to Report on KPIs
• Reports created in Excel Services, SSRS or Performance Point were deployed to Performance Point and Share Point servers.• Once deployed to MOSS, authorized users can view the reports using a browser such as Internet Explorer.• Some dual Y-Axis line charts were exported from Excel Services to Share Point, then imported into PPS for dashboards.
Following is my Dashboard design page containing the DashBoards, KPIs, Scorecards and Reports.
Share Point (MOSS) and Performance Point (PPS)
Following screenshot shows an SSRS report deployed to a Share Point server and viewed using Internet Explorer
Share Point (MOSS) and Performance Point (PPS)
• Screenshot for Basic Overhead by Dates, created using Excel Services and deployed to MOSS
Share Point (MOSS) and Performance Point (PPS)
• This Scorecard was created using PPS and deployed to MOSS. It uses KPIs to indicate the variations in percentage of overheads and other financials.
• It allows drill down analysis by categories and sub categories.
Share Point (MOSS) and Performance Point (PPS)
• This Job Profitability Chart was created using Excel Services, then deployed to MOSS. • It shows the profit by county and financial quarter and allows drill downs by counties.
Share Point (MOSS) and Performance Point (PPS)
• This combined report was created in PPS, the table shows the total labor by an employee vs total labor input by all employees for a project that the employee worked on.
• The line-chart was challenging because it is an average for all projects that the employee has worked on, and the denominator is the total input for all employees for the same projects and for the financial year quarter.
/* **************Objective: Determine the total labor cost for all jobs that the current employee has worked on.Solution: Filter all the jobs that the currentmember has worked on, ie with Total_labor>0, then cross-join the short list with
list of all employees who worked on same jobs.Shane's assistance duly acknowledged!**************** */WITHMEMBER [Employees].[Full Name].[ Aggregation] AS 'AGGREGATE( EXISTING { [Employees].[Full Name].
[FullName].ALLMEMBERS } )', SOLVE_ORDER = 0
MEMBER [Measures].[All Employee Labor] ASSUM (( FILTER ( [Job Master].[Job Master].Children, [Measures].[Total Labor] > 0 )
, [Employees].[Full Name].Siblings) , [Measures].[Total Labor] )
MEMBER [MEASURES].[PctTotal] AS( [Measures].[Total Labor] / [Measures].[All Employee Labor] ), FORMAT_STRING = "percent"
SELECTnon empty { [LaborQuarters]} ON COLUMNS,{ [Measures].[Total Labor], [MEASURES].[PctTotal] } ON ROWS
FROM [Project Labor Cube]WHERE <<EmployeeFilter>> /* ( [Employees].[Full Name].[ Aggregation] ) */
MDX Code in PPS
Dual Y-Axis Graph Generated by MDX in PPS
• The MDX codes generated the following chart