dmdw 3. student presentation - silverlight to mssql
DESCRIPTION
3. ETL Project by Sebastian Burkart & Patrick ReichertTRANSCRIPT
DMDW Practical Task
E = ExcelT = SilverlightL = MS SQL
Sebastian Burkart & Patrick Reichert
Agenda
1. General course of events
2. Detailed plan
3. Development process
4. Presentation of running application
5. Questions & End
Sebastian Burkart & Patrick Reichert
General course of events
1. Load file in Silverlight Project
2. Store data in memory
3. Run transformations on data
4. Store data in database
But that’s the general flow…. Now in details…
Sebastian Burkart & Patrick Reichert
Detailed plan 1/2
Sebastian Burkart & Patrick Reichert
1. Search document for entered errors- ö oe, ä ae, ü ue, ß ss- some lines are not filled completely- some words are mistyped- blanks at end of entries
2. Save document in unicode-text-format
3. Extract, Analyze & Normalize the document structure - original table structure (excel) - one table structure - normalized table structure
4. Create database
Detailed plan 2/2
Sebastian Burkart & Patrick Reichert
5. create & code- create silverlight navigation application- create a new web service- add web service as service reference- create user-interface
- complete UI- features of the UI
- code the functionalities- run “Create Tables” feature- run SQLMetal.exe- implement class file from SQLMetal.exe- finish coding
Search document for errors
Sebastian Burkart & Patrick Reichert
Save document in unicode-format 1/3
Sebastian Burkart & Patrick Reichert
Save document in unicode-format 2/3
Sebastian Burkart & Patrick Reichert
Save document in unicode-format 3/3
Sebastian Burkart & Patrick Reichert
Extract & Normalize the document structure 1/5
Sebastian Burkart & Patrick Reichert
original table structure (excel)
Tag StringDatum DateAnfang TimeEnde TimeRaum StringVeranstaltungsname StringDozent StringKommentar StringUnknown String
Extract & Normalize the document structure 2/5
Sebastian Burkart & Patrick Reichert
one table structure
table: originalid int, Primary Keyevent varchar(200), not NULLday not in db get from datedate date, not NULLstart varchar(10), not NULLfinish varchar(10), not NULLroom varchar(50), not NULLlecturer varchar(200), not NULLcomment varchar(200)unknown varchar(200)
Extract & Normalize the document structure 3/5
Sebastian Burkart & Patrick Reichert
normalized table structure 1/3
main table: eventsid int, Primary Keyeventname int, not NULL table: eventnamesstart int, not NULL table: timesfinish int, not NULL table: timesdate int, not NULL table: datesroom int, not NULL table: roomslecturer int, not NULL table: lecturerscomment varchar(200)unknown varchar(200)
Extract & Normalize the document structure 4/5
Sebastian Burkart & Patrick Reichert
normalized table structure 2/3
table: eventnamesid int, Primary Keyeventname varchar(200), unique, not NULLtable: timesid int, Primary KeyTime varchar(10), unique, not NULL
table: datesid int, Primary Keydate date, unique, not NULL
Extract & Normalize the document structure 5/5
Sebastian Burkart & Patrick Reichert
normalized table structure 3/3
table: roomsid int, Primary Keyroom varchar(50), unique, not NULLtable: lecturersid int, Primary Keylecturer varchar(50), unique, not NULL
Create database 1/2
Sebastian Burkart & Patrick Reichert
Create database 2/2
Sebastian Burkart & Patrick Reichert
Create & Code 1/11
Sebastian Burkart & Patrick Reichert
create a silverlight navigation application
Create & Code 2/11
Sebastian Burkart & Patrick Reichert
create a new web service 1/2
Create & Code 3/11
Sebastian Burkart & Patrick Reichert
create a new web service 2/2
Create & Code 4/11
Sebastian Burkart & Patrick Reichert
Add web service as service reference 1/2
Create & Code 5/11
Sebastian Burkart & Patrick Reichert
Add web service as service reference 2/2
Create & Code 6/11
Sebastian Burkart & Patrick Reichert
create user-interface
Create & Code 7/11
Sebastian Burkart & Patrick Reichert
use SQLMetal.exe
Create & Code 8/11
Sebastian Burkart & Patrick Reichert
Code the functionality
Code will be live presented in Visual Studio
Create & Code 9/11
Sebastian Burkart & Patrick Reichert
run “Create Tables” feature
Create & Code 10/11
Sebastian Burkart & Patrick Reichert
implement class file from SQLMetal.exe 1/2
Create & Code 11/11
Sebastian Burkart & Patrick Reichert
implement class file from SQLMetal.exe 2/2
Thanks for your attention!!
Questions?
Sebastian Burkart & Patrick Reichert