sentiment analysis with sap hana - business analytics · pdf filesentiment analysis with sap...
TRANSCRIPT
![Page 1: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/1.jpg)
Sentiment Analysis with SAP HANA
Hochschule Ludwigshafen am RheinProf. Dr. Klaus Freyburger
3/7/2013
![Page 2: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/2.jpg)
2
Prof. Dr. Klaus Freyburger
1982 - 1989 studying mathematics and business administration at the University of Mannheim and University of Massachusetts at Amherst
1991 PhD in mathematics
1991 - 2002 working at SAP AG in WalldorfMain activities: Development of software for business planning
since 2002 professor of Business Information Technology at the University of Ludwigshafen
Teaching and research:
● Programming
● Business Intelligence with SAP, Microsoft and Open Source
personal
![Page 3: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/3.jpg)
3
4.200 students
72 full professors
140 part time lecturers
Wide selection of courses with business administration and social work
Bachelor Business Information Technology
Master Business Information Technology (Information Management & Consulting)
Dualer Studies Bachelor International Business Administration and Information Technology (IBAIT)
Application and practice-oriented, innovative and internationally
Some figures…
![Page 4: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/4.jpg)
4
Beginning 1994 R/2 as one of the first universities
First, own R/3 System
HCC Passau
UCC Magdeburg
Products used:
ERP
SCM
BI
SAP in classroom teaching…
![Page 5: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/5.jpg)
5
Students as student workers at SAP
Thesiswork (Bachelor/Master)
At SAP or SAP customers
Many graduates at SAP and SAP customers
Former SAP employees as professors
… and beyond
![Page 6: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/6.jpg)
6
Leading in the development of the SAP BI curriculum…
… and assist in the rollout
UA Community
![Page 7: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/7.jpg)
The ProjectSentiment Analysis
![Page 8: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/8.jpg)
Goal
Data harvesting from social media
Using SAP BOE Data Services text data processing capabilities for
making sense out of unstructured data
SAP HANA data persistence for data mining, rapid retrieval and
analysis
Topic: „US Presidential Elections 2012“
8
![Page 9: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/9.jpg)
9
Overview
1.) Extract 2.) Sentiment Analysis
3.) Modeling 4.) Analysis
TwitterIn-
Memory
BusinessObjects Dashboards
Advanced Analysis for Office
SAPBusinessObjectsData Services
SAPHANA
![Page 10: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/10.jpg)
The Project1.) Data Extraction
![Page 11: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/11.jpg)
11
Extraction
Extraction
1.500.000 posts per day average
> 18 posts per second
![Page 12: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/12.jpg)
4122
1
4121
9
4121
7
4121
5
4121
3
4121
1
4120
9
4120
7
4120
5
4120
3
4120
1
4119
9
4119
7
4119
5
4119
30
1.000.000
2.000.000
3.000.000
4.000.000
5.000.000
6.000.000
7.000.000
12
Number of posts
3rd debate2nd debate
election day
![Page 13: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/13.jpg)
The Project2.) Sentiment Analysis
![Page 14: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/14.jpg)
Sentiment Analysis
Extraction
HANA HANA
SAP BusinessObjects Data Services
Sentiment analysis
14
time to HANA< 2 min
time to extraction< 1sec (Twitter)
![Page 15: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/15.jpg)
Sentiment Analysis
15
SAP BusinessObjects Data Services Workflow
HANA HANA
![Page 16: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/16.jpg)
Sentiment Analysis
16
Incoming posts
find opinions about a person / topic
Extraction of entities
Linguistic analysis
![Page 17: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/17.jpg)
Homogenization
17
Obama is great. Barack is great.
![Page 18: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/18.jpg)
Candidates● Barack Obama● Mr. President● Barack● Obama● …● Mitt● Mr. President● Barack● Obama● …● …● Mr. President● Barack● Obama● …
18
Homogenization
Obama is great.Barack is great.
Dictionary
![Page 19: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/19.jpg)
Sentiment Analysis
19
Incoming posts
find opinions about a person / topic
Extraction of entities
Linguistic analysis
![Page 20: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/20.jpg)
sentiment●strong positive ● weak positive● neutral● weak negative●strong negative
20
Linguistic analysis
negativepositive
Obama is great Obama is terrible
Obama is ok
![Page 21: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/21.jpg)
Example:
I really like Obama. He seems like somebody that I can trust.
21
Linguistic analysis
like
Positive Sentiment
Barack Obama
Candidate
![Page 22: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/22.jpg)
The Project3.) Modeling
![Page 23: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/23.jpg)
23
Modeling
TwitterIn-
Memory
BusinessObjects Dashboards
Advanced Analysis for Office
SAPBusinessObjectsData Services
SAPHANA
1.) Extract 2.) Sentiment Analysis
3.) Modeling 4.) Analysis
![Page 24: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/24.jpg)
24
Modeling in SAP HANA Studio
Attribute Views
– give master data tables context
– subset of columns and rows from a data table
Analytic Views
– build data foundation based on transactional tables
– contain normal attributes and measures
– measures are aggregated key figures
Calculation Views
– provide composites of other views
– join or union two or more analytic views or tables
![Page 25: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/25.jpg)
25
Modeling Tasks
HANA
Create different SAP HANA Views for different purposes– provide fast data access for frontend tools
– aggregate information
– filter ambiguous sentiments within post content
![Page 26: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/26.jpg)
26
Modeling Example
500ms
~45.mio
![Page 27: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/27.jpg)
The Project4.) Analysis
![Page 28: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/28.jpg)
28
Interfaces frontend tools – SAP HANA
BusinessObjects Dashboards
Advanced Analysis for Office
universe
BICS
JDBC
ODBC
In-Memory
SAPHANA
![Page 29: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/29.jpg)
Dashboards: Start View
BusinessObjects Dashboards 29
![Page 30: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/30.jpg)
Dashboards: overview
BusinessObjects Dashboards 30
![Page 31: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/31.jpg)
Dashboards: Time Line
BusinessObjects Dashboards 31
![Page 32: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/32.jpg)
Dashboards: Live Posts
BusinessObjects Dashboards 32
![Page 33: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/33.jpg)
Dashboards: TV Debate
BusinessObjects Dashboards 33
![Page 34: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/34.jpg)
Dashboards: topics
BusinessObjects Dashboards 34
![Page 35: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/35.jpg)
Dashboards: geographical distribution
BusinessObjects Dashboards 35
![Page 36: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/36.jpg)
Dashboards: devices
BusinessObjects Dashboards 36
![Page 37: Sentiment Analysis with SAP HANA - Business Analytics · PDF fileSentiment Analysis with SAP HANA ... Leading in the development of the SAP BI ... Extraction HANA HANA SAP BusinessObjects](https://reader031.vdocuments.mx/reader031/viewer/2022013110/5a9e28317f8b9a21488c88f5/html5/thumbnails/37.jpg)
37
Project resumé
great experience in a interesting real life example
exceptional opportunity to work with the innovative In-Memory DB SAP HANA and SAP BusinessObjects tools
result and performance of developed set-up is above all expectations