data cleansing with ssis brian knight pragmatic works [email protected]
TRANSCRIPT
ABOUT BRIAN
Wasn’t very good with girls
Even Kermit the Frog founded a company
All 13 still awaiting a publisher.
BI Savvy or BI Curious?
• SQL Server MVP
• Founder of Pragmatic Works
• Author of 13 books
• Blogs at BIDN.com
Twitter: @BrianKnight
TAKEAWAYS
Profiling the data
Cleansing and validating with scripts
Fuzzy techniques
DATA PROFILING
Retrieves metadata about your data
Help identify data issues
Uses an SSIS Data Profiling Task
Data Profiling Task
Demo
SCRIPTING IN SSIS
Tasks
Data Flow
• Source• Transform• Destination
CLEANSING USES IN SCRIPTING
Advanced data cleansing
Complex data validation
Unusual data sources
Script Transform Demo
Demo
FUZZY TECHNIQUES
De-duplicating data
Fuzzy catches misspelt words or variants
Fuzzy Grouping and Fuzzy Lookup
FUZZY GROUPING DEMO
THE END ALREADY?Questions
http://www.bidn.com/people/brianknight
@BrianKnight
http://www.youtube.com/pragmaticworks