keuze semester big data. who am i? peter odenhoven [email protected] amsterdam university of...
TRANSCRIPT
![Page 1: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/1.jpg)
KEUZE SEMESTER BIG DATA
![Page 2: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/2.jpg)
WHO AM I?
• Peter Odenhoven• [email protected]
• Amsterdam University of Applied Sciences• Background: Mathematics / Statistics• Teaching at this moment:
• Programming: Java, C# , Python, R• Databases: SQL and NOSQL• Data warehousing / Business Intelligence • Big Data
![Page 3: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/3.jpg)
IT’S ALL ABOUT FINDING STUFF …
![Page 4: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/4.jpg)
PROJECT ASSIGNMENTS
1. HvA CHIEF: charging electrical cars
2. AFC AJAX : monotoring physics of player
3. CURVE FEVER: toxic behaviour in a multiplayer game
4. Digital Life Centre: sensor data
5. NIKHEF:CERN information use
![Page 5: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/5.jpg)
10 REASONS WHY DATA SCIENTIST IS THE SEXIEST JOB OF THE 21ST CENTURY (OR NOT)
![Page 6: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/6.jpg)
WHAT YOU SHOULD BRING,WHAT YOU SHOULD GET
![Page 7: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/7.jpg)
NOT ALL PROBLEMS ARE BIG DATA PROBLEMS
![Page 8: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/8.jpg)
OLD AND NEW FRIENDS: SQL AND NOSQL
![Page 9: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/9.jpg)
module description ecProject Big data applications 61 Business Studio 42 Data analysis/mining 4 Business skills 1
total 15Project Big data applications 53 Data processing and storage 44 Information visualization 4 Professional skills 2
total 15
“… DO I LOOK LIKE A MAN WITH A PLAN…”
![Page 10: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/10.jpg)
BUSINESS STUDIO
• Business opportunities• Data warehousing• Reporting• Ethics• Legal issues
![Page 11: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/11.jpg)
DATA ANALYSIS AND DATA MINING
• Some mathematics, MAPLE• More theory on algoritms• A lot of practice:
• Rapid miner• R• Python
![Page 12: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/12.jpg)
INFORMATION VISUALIZATION
The best data visualizations are ones that expose something new about the underlying patterns and relationships contained within the data.
Understanding those relationships — and being able to observe them — is key to good decision making
![Page 13: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/13.jpg)
MORE DETAILS: DATA PROCESSING
• Read and write different data types from different data sources
• Process (filter, clean, filter, combine, etc) Data
• Understand Map Reduce concept• Read and Write data from distributed
file system• Work with tools such as R and Hadoop
![Page 14: KEUZE SEMESTER BIG DATA. WHO AM I? Peter Odenhoven p.j.odenhoven@hva.nl Amsterdam University of Applied Sciences Background: Mathematics / Statistics](https://reader031.vdocuments.mx/reader031/viewer/2022032015/56649f435503460f94c635f2/html5/thumbnails/14.jpg)
GROUPING
• Individual preferences 1,2 and 3• We decided, based upon …o Interesto Ambitiono Background
• Not necessarily groups bounded to classes…