Creating a Unified View of Business Critical Information with SharePoint and SearchJeff FriedCTOBA Insight

Guy Mounier

CEOBA Insight

The world of informationat your Fingertips

The right information at the right moment to make

decisions

Deliver relevant information

Unified View

SharePoint is a platform meant to be extended…

PresentationData

Search Makes

the Connection!

Who We Are - The SpeakersJeff Fried, CTO, BA Insight• Previously VP Advanced

Solutions for FAST, then Search Product Manager for Microsoft

Based in Boston, MA, USA• Technet Column: “A View from the Crawlspace”• Twitter: @jefffried

Guy Mounier, Founder & CEO, BA InsightConsulting background in ERP and BI. CTO at Fortune 100 Company prior to co-founding BA Insight.

Based in New York City, USA

Blog: BAinsight.com/BlogTwitter: @BAinsight

Demo

Unified View Example

The Value of a Unified View• The problem: information and application silos• Unified View - Examples in action

Unified View – Data Layer• Creating a single unified index via crawling & connectors• Using Federation across 2010 and 2013; O365 and on-

prem

Unified View – Presentation Layer• Rapid Assembly of Search-Based Applications• Patterns and Practices

Outline

Top business challenges we hear about

Information Explosion Data in Silos Diverse User Requirements

Unstructured Data Un-Organized Un-Categorized Exponential Growth

Discrete Roles Diverse Systems Varied functions Lack 360° view of info

100+ Systems No Interconnect Difficult to find info Frustration

BigData

Unified View feeds many Search-Based Applications

CRMECM

Web

ERP

Email

Data Bases

CloudUnified Index

Expertise Finder

Customer 360

Asset Tracker

Research Portal Analyst Workbench

• Any Data Source• Any Data Type• Any Device• Intuitive• Interactive• Targeted• Dynamic

Search Driven Unified View

Demo

Unified View at BA Insight:Across O365, TFS, Web Site, SharePoint, ….

Information and application silos

Marketing Sales ProcurementConsulting Research HR / LegalSupportProduction

ContentSilos

Siloed UI Applications

Receive customer call

Search in CRM

system(s)

Search in contract system

Verify customer

data

Search in issues DB

Search KM and experts

Search in discussions and blogs

Analyze Answer customer

Introducing "Paul" from SupportCustomer support – the hard way

CRM DB

Time

7 minutes

CMS

10 minutes

Agreements

5 minutes

Issue DB

15 minutes

Intranet

20 minutes

Wikis and blogs

15 minutes

10 minutes

82 minutes

Receive customer call

Search in CRM

system(s)

Search in contract system

Verify customer

data

Search in issues DB

Search KM and experts

Search in discussions and blogs

Analyze Answer customer

Introducing "Paul" from SupportCustomer support – the hard way

Time

Challenges;• Time to resolution = Cost• Quality on solution and cost of reworking information• Customer satisfaction• Frustration

7 minutes10

minutes5 minutes

15 minutes

20 minutes

15 minutes

10 minutes

82 minutes

Receive customer call

Find all relevant informati

on

Analyze Answer customer

With Unified ViewCustomer support – the new way

Time

CRM DB CMSAgreement

sIssue DB Intranet

Wikis and blogs

1 minute 2 minutes 3 minutes

Search platform

Demos

Example Search Based Applications Based on a Unified View

Unified View App for Legal

It is a General App Pattern across Industries

Customer Service 360 Client Matter 360 Sales Manager View

Analyst Workbench Research Portal Intelligence Dashboard

Click this link to see Screenshot Details

New Class of Enterprise Apps, Powered by SearchTotalView for Customer Service

New Class of Enterprise Apps, Powered by SearchTotalView for Sales

New Class of Enterprise Apps, Powered by SearchTotalView for Professional Services

New Class of Enterprise Apps, Powered by Search

21

TotalView for Research

New Class of Enterprise Apps, Powered by Search

22

TotalView for Intelligence

The Value of a Unified View• The problem: information and application silos• Unified View - Examples in action

Unified View – Data Layer• Creating a single unified index via crawling & connectors• Using Federation across 2010 and 2013; O365 and on-

prem

Unified View – Presentation Layer• Rapid Assembly of Search-Based Applications• Patterns and Practices

Outline

Data

Silo

s

Email & Messaging Search enginesCRM/ERP

ECM, Social Streams

DatabasesUnstructured , Big Data

External Web Sites

SaaS/Office 365

Data Layer

Presentation Layer

Indexing Connectors

Auto-Classification

Unified View Architecture

Entity and Relationship Extraction

Federating Connectors

Visual Refiners and Dynamic Dashboards

Alerting & Trending Query & Result Orchestration

Search Makes the Connection!

Preview / Action on Documents + Data

• Indexing• Crawl content from an on-premise search farm+ Provides uniform content processing, relevance, and latency‒ Requires higher bandwidth and footprint

• Federation• Send queries to multiple search instances and combine the results+ Lower bandwidth, small footprint, sometimes the only way possible‒ Only as good as the weakest link, tricky to combine results well

2 ways of creating a unified data layer

What is an indexing connector?

Web Content

File shares

Databases

Email

SharePoint

Enterprise Repositories

Search Engine

Connector

Connect Securely1

Map Content2

Feed Engine3

Find any changes4

• Heterogeneous Data Models and System characteristics• Every system is different• Mapping to common metadata is essential for findability

• Heterogeneous Security• Every system has different security and authentication models• User must see ONLY information they are entitled to, across all

systems• Bandwidth and Performance

• Lots of content!!!• Cross-site Bandwidth can still be expensive or limited• Source systems can be the limiting factor and need a ‘light touch’

• Usually MANY systems, not just a couple

Why is this hard?

Demo

Unified View at BA Insight:Across O365, TFS, Web Site, SharePoint, ….

Indexing Connectors

SharePoint / FASTMetadata

Enrichment

Change LogSecurity Mapping

Search Optimized

API

Targets

SharePoint Libraries & Lists

Unified Search Index

Most organizations have MANY enterprise systems; you can surface all these in SharePoint

• Aderant Practice Management

• Autonomy EAS / (Zantaz) • Autonomy Worksite

(iManage)• Elite Prolaw • EMC Documentum• EMC eRoom• HP Trim Context

(TowerSoft)• IBM Lotus Notes • IBM Filenet P8• IBM Content Manager• IBM DB2• IBM Filenet Content

Services

IBM WebSphere KnowledgeMill OnePlace LexisNexis Interaction CRM Microsoft Dynamics CRM Microsoft Exchange Microsoft Exchange Online Microsoft SharePoint Online Microsoft SQL Server NetDocuments Objective DMS OpenText Hummingbird / eDocs DM OpenText LegalKEY / eDocs RM

Oracle Databases Oracle CMS/Stellent Oracle WebCenter Interactive

(PlumTree) Practical Law Real Practice Salesforce.com/Force.com SAP Business Suite SAP DMS Symantex EVault Thomson Reuters West KM Xerox DocuShare

What is Federation? “Scatter-Gather” across multiple search engines

Combined Result SetOOB in SharePoint 2013: Result Blocks

With Partner Products: interleaved by

relevance order Unified refiners for

streamlined navigation and filtering

Auto-generated refiners based on identity of source systems

Cross-version Federation to SharePoint 2013Scenario 1: Enabling operations across mixed farms

Unified view (and refinement) of all enterprise content

Get the SP 2013 Search Experience enterprise-wide as soon as first farm deploys

Demo

Federating across FAST Search for SharePoint and SharePoint 2013

Hybrid Cross-Version Federation

Scenario 2: Bridging SharePoint 2010 & SharePoint Online 2013 Adopt SharePoint 2013

Online rapidly, without having to immediately upgrade on-premise

Get the SP 2013 Online search experience enterprise-wide as soon as Office 365 subscription commences

Demo

Federating across O365 (running SharePoint 2013) and SharePoint 2010

How does the Federator combine results?

• Intelligent unification of the Search Results

• Interleaved results• Merged refiners• Augmented metadata

Interleaves result sets across sources by relevance order

Creates new source refiner on

the fly

Combines refiners (adding ones with the same value)

The Value of a Unified View• The problem: information and application silos• Unified View - Examples in action

Unified View – Data Layer• Creating a single unified index via crawling & connectors• Using Federation across 2010 and 2013; O365 and on-

prem

Unified View – Presentation Layer• Rapid Assembly of Search-Based Applications• Patterns and Practices

Outline

Data

Silo

s

Email & Messaging Search enginesCRM/ERP

ECM, Social Streams

DatabasesUnstructured , Big Data

External Web Sites

SaaS/Office 365

Data Layer

Presentation Layer

Indexing Connectors

Auto-Classification

Unified View Architecture

Entity and Relationship Extraction

Federating Connectors

Visual Refiners and Dynamic Dashboards

Alerting & Trending Query & Result Orchestration

Search Makes the Connection!

Preview / Action on Documents + Data

1 Topicmight be multiple sources

360° Viewresults, apps, widgets

Relevanttuned to the user community

Userleverage your knowledge

Graphical Navigation

Results

Map

Advertising

Search

Ratings

Widget

ZAGAT

The Key is Search-Driven Presentation

Demo

Search-Driven Presentation

42

Medical Research Portal

Site Navigation

Tag Cloud

Technical Documents External Sources

Welcome User | TitleLogo

Product Marketing Documents

Document Histogram

Keywords, Taxonomy, Synonyms, Definitions

Search

Welcome Matteo Di Tomasso | Vice President, Research Informatics

heart disease lipitor

Products Symptoms Compounds Research 360° My Lab Notebook

Source: Research Documentum

1997 2001 2006 2011

Atorvastatin: FDA Submission DocumentsHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost::8571/Webtop/FDA/Submissions/Lipitor

Atorvastatin: MSDS – Data SheetHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor

Lipitor: Dosing, Side Effects and IndicationsHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor

Technical Documents Product Marketing

Lipitor – Physician Fact SheetHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor

Atorvastatin: End of Patent StatementHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor

Lipitor: Common QuestionsHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor

MeSH Cloud

Carcinoid Heart Disease Cardiac Tamponade Cardiomegaly Cardiomyopathies

Endocarditis Heart Aneurysm

Heart Arrest Heart Defects,

Congenital Heart Failure Heart Neoplasms Heart Rupture

Heart Valve Diseases Myocardial Ischemia

Pericardial Effusion Pericarditis Pneumopericardium

Pulmonary Heart Disease Rheumatic

Heart Disease

Ventricular Dysfunction Ventricular Outflow Obstruction

All Scientific Journals NIH Medline Scirus FDA

Series1

Document Histogram

Source: Marketing SharePoint 2010

Triad of Metabolic Syndrome, Chronic Kidney Disease, and Coronary Heart Disease with a Focus on MicroalbuminuriaMicroalbuminuria develops in many patients with metabolic syndrome and may be an important correlate of chronic kidney disease and coronary heart disease. Journal Article, J Am Coll Cardiol, June 2011

Mortality in Adult Congenital Heart DiseaseLearn more about the causes of death for adults with congenital heart disease. ... in adults with congenital heart disease is known to be ... Journal Article, European Heart Journal, June 2010

Heart Disease in Patients with Pulmonary EmbolismSome specific heart diseases in older patients could themselves be a possible source of pulmonary emboli. ... of review Several heart diseases are ... Journal Article, Curr Opin Pulm Med, September 2010

Medline Journals

Source: Medline via BA Insight Federator

Heart DiseaseScope Note: Pathological conditions involving the HEART including its structural and functional abnormalities.

See Also: Neurocirculatory Asthenia, Myocardial Infarction

Keywords: angina, high blood pressure, hypertension, ischemic heart disease, acute myocardial infarction, atherosclerosis, hypercholesterolemia, lipoprotein, low-density lipoprotein, LDLTaxonomy: Diseases (1,442,487)

Cardiovascular Diseases (8,322)

Heart Diseases (1,387)

Demo

SearchParts

Longitude Search Parts – Information Orchestrated

Refiner Tiles• Locate refiners on multiple areas on page

Search Templates• Refinement, Query, Result components • Panels, Apps, & Sites

Widgets • ‘Search Within’ List• Multi-select (OR) • Dynamic List• Date Slider • Scalar Range Slider• Pie Chart • Path Tree • Search Bread Crumbs• Multi-field Search Box • Property-specific search in Search Box• Saved Query / History• ….and more …..

Rapid, Model-Driven Application DeliveryConfigurable and Reusable Components for a Compressed Time-to-Value

4 to 12 Weeks Total Time-to-Value

SBA Platform Unified View Apps

Data

Silo

s

Email & Messaging Search enginesCRM/ERP

ECM, Social Streams

DatabasesUnstructured , Big Data

External Web Sites

SaaS/Office 365

Data Layer

Presentation Layer

Longitude Connectors

Longitude AutoClassifier

BA Insight & Unified View Architecture

Entity and Relationship Extraction

Longitude Federator

Longitude SearchParts

Alerting & Trending Longitude Federator

Search Makes the Connection!

Longitude Search

The Demand for Unified View is Accelerating;Driven by two big underlying trends

Structured AND Unstructured BIG DATA

Technology Expectations

End-User Expectations

Consumerization of IT

& Intuitive User Experience

201520102006

Sta

te o

f th

e E

nte

rpri

se

Source: IDC

(1 Exabyte = 1 Million Terabytes)

60% Unstructured

Data

30% Unstructured

Data

Technology Trend: Big Data

161 Exabytes10+ Data Silos 988 Exabytes

80+ Data Silos

8,000 Exabytes500+ Data Silos

90% Unstructured Data

Every two days now we create as much information as we did from the dawn of civilization up until 2003Eric Schmidt (Former CEO of Google)

End-User Trend: Consumerization of ITConsumer AppsSearch for Product, Restaurant, Travel

Enterprise AppsSearch for Experts, Projects, Customers, Vendors, Parts,

Intuitive Unified View Intuitive Targeted Context-aware Device-independent Actionable

The world of informationat your Fingertips

The right information at the right moment to make

decisions

Deliver relevant information

Unified View = POWER

Want to Know More About SharePoint 2013 Search?

The Essential Guide to Enterprise Search in SharePoint 2013

Everything You Need to Know to Get the Most Out of Search and Search-based Applications

Available at BA Insight Booth #234 & downloadable free from

www.SharePointSearch2013.com A one stop shop for e-books, videos and

more about SharePoint 2013 Search100+ page, in-depth guide to SharePoint 2013 search. 22 easy to digest chapters that can be read on their own or

together