Breakthrough BI:

Analyzing All the Data

Benjamin De Boe Product Specialist

InterSystems Symposium 2012

Overview

• Introduction: “All the Data”

• What is iKnow?

• iKnow and DeepSee

• Added value

• Feature overview

• Demo

“All the Data”

Introduction

What is “All the Data”?

• Job interview

• Years experience

• Relevant references

• Test scores

• All of the above

4

Why were you hired?

What is “All the Data”?

• The amount of money claimed

• The premium you pay each month

• The rating of your insurer

• What you paid your lawyer for filing it

• The claim itself

• All of the above 5

What makes your insurance claim successful?

What is “All the Data”?

• Decisions based on structured data:

• “Buy any book categorized “fiction” in this month’s best-selling top 10, costing less than 20$”

• Decisions based on all the data:

• “Buy the book categorized “fiction” in this month’s best-selling top 10, costing less than 20$, that is most different from the books I already own.”

What is “All the Data”?

• Business decisions are based on “All the Data”

• Ignoring or neglecting parts of what you know is not an option

• Most of today’s software stores “All the Data”

• A breakthrough application uses “All the Data”

Competing on Unstructured Data

lack of useful insight

Structured

Data

Unstructured

Data

What today’s Business Intelligence is based on

What today’s Business Decisions are based on

What Analysts are saying...

• Gartner BI Summit, April 2 – 4

• New in 2012: “Why big data and unstructured content require special handling”

• Gartner Magic Quadrant for BI: Trends

• “Data Discovery momentum continues to accelerate”

• “An avalanche of new use cases and content types”

• Forrester: “Faceted search” is on the rise

9

About search-based BI

• Search helps you find what you know:

• All service requests by customer X for period Y containing the word “outlook”

• Content Insight will tell you what you don’t know yet:

• Which were the common problems for all service requests by customer X in period Y?

10

What is iKnow?

What is iKnow?

• Generic text analysis technology

• Domain-independent

• Multi-purpose and multi-lingual

• Built into the core of Caché

• Enables applications to do something with text

iKnow and DeepSee deliver Active Analytics

to your breakthrough applications

iKnow and DeepSee deliver Active Analytics

to your breakthrough applications

• Core functionality:

• Identifies meaningful word groups (“entities”) in sentences based on semantics

• Entities and their context are the basis of all further analysis, such as:

• Queries within or across bodies of text

• Relevance calculations & summarization

• Matching against existing knowledge

What is iKnow?

13

What iKnow isn’t

• iKnow is not search

• iKnow is not an application

• iKnow is not content management

• iKnow is not a medical coding tool

• iKnow is not a solution on its own

iKnow Use Cases

Note: these are use cases, not features or functions

Content Creation

Content Insight

Content Consumption

Content Linking

Content Insight

• Combines text with its structured context to generate a broader understanding of 100% of your data

• Provides both structured and unstructured outputs

• ... based on both structured an unstructured inputs

• Implemented through integration with DeepSee

The InterSystems Platform

Insight Connectivity

Information

Capture, store and

share all of your data

Real-time

quantitative

and qualitative

analysis

Connect to

applications,

users and

communities

iKnow in the InterSystems Platform

Smarter end-user

Applications

Advanced

Analysis of

100% of your

Data

Automating

labour-intensive

Business

Processes

iKnow &

DeepSee

What is DeepSee?

• DeepSee delivers Active Analytics, enhancing transactional applications with embedded, real-time Business Intelligence capabilities

• Key Components:

• Architect: Define data model

• Analyzer: Explore and display data

• User Portal: Create dashboards, extend apps

20

iKnow in DeepSee

• What people like about DeepSee:

• Performance

• Ability to handle complex data

• Ease of use

• Thin client

Transparently embeds

BI in your application

iKnow in DeepSee

• Focus of iKnow integration:

• Performance

• Ability to handle complex data

• Ease of use

• Thin client

Transparently embeds

text analysis in your BI

What’s Changed?

Data

Model

Query

Engine Portal

Added Value

Added Value

Content insight

Analytics

Reporting

Added Value

• Support structured data findings with proof from the unstructured context

• Explain structured data findings with summaries of unstructured context

• Extend structured data findings with unstructured data findings

29

Supporting Structured Data Findings

• Structured data does not necessarily mean it’s exact science

• Manual input is vulnerable to human error

• Textual context can be mined for confirmation

• Examples

• Customer service: text-based category detection

• Healthcare: code / diagnosis verification

30

Explaining Structured Data Findings

• Richness of natural language adds much detail and context to measured facts

• Complement figures with their most relevant context using summaries and semantics

• Examples

• Customer service: show dominant terms and trends for a particular customer and time period

• Healthcare: read only the most typical and breaking patient episodes for a given time period

31

Extending Structured Data Findings

• Add new information not captured previously in structured properties and dimensions

• True text analysis generates new insights

• Examples

• Customer service: prioritize and act based on mood detection and information scoring

• Healthcare: populate empty or inexistent EHR fields

32

Demo

Conclusion

Conclusion

• The combination of iKnow and DeepSee enables complete, seamless and transparent content insight

• Complete: unlocks 100% of your data

• Seamless: no separate tools or training required

• Transparent: adheres to strict APIs and default MDX

Conclusion

• The main BI question:

• ... now gets an appendix:

“Which figures and diagrams do I need to get an insight

into my business performance?”

“And what textual content can I use to support, explain

or extend this insight?”

Questions

Developer Connection

developer.intersystems.com

Your Global Summit Every Day

51

Thank you!