Intelligent Information Discovery

André de Oliveira

#LSNA17

The explosion of content

#LSNA17

#LSNA17

What is your

information discovery strategy?

#LSNA17

▪ 1st Generation: BrowseWhat is your discovery strategy?

#LSNA17

▪▪▪▪

1st Generation: Browsing for content

#LSNA17

▪▪ 2nd Generation: Search

What is your discovery strategy?

#LSNA17

▪▪▪▪

2nd Generation: Searching for content

#LSNA17

▪▪▪ Next Generation: Predict

What is your discovery strategy?

#LSNA17

▪▪

▪▪▪

Next Generation: Predicting relevant content

#LSNA17

Intelligent

information discovery

#LSNA17

▪▪▪▪▪

It all starts with Search...

#LSNA17

Predicting with a search engine

Autocomplete

Did you mean…?

Suggest as you type

More like this

Percolators

#LSNA17

▪▪

▪▪

▪▪

▪

Rise of the machines

#LSNA17

The essential challenge in Machine Learning

Picture?

Voice?

Search query?

User indication of

interest?

Scored prediction

Scored prediction

#LSNA17

⇒ ⇒

Image classification

#LSNA17

⇒ ⇒

Speech recognition

#LSNA17

⇒ ⇒

Face detection

#LSNA17

⇒ ⇒ ⇒

Predicting with Deep Learning: Confidence

Picture?

Voice?

Search query?

User indication of

interest?

Scored prediction

Scored prediction

Carlos Hernandez: Image classification with Liferayhttps://youtu.be/ShAUafF2yfw

https://web.liferay.com/web/carlos.hernandez/blog/-/blogs/liferay-dxp-and-machine-learning-liferay-as-an-integration-platform

#LSNA17

▪▪

▪▪▪▪

▪▪

▪

Predicting with Search: Similarity

#LSNA17

▪▪▪▪▪

Textual analysis

Term Term Countthis 1is 1a 2sample 1

Document 1

Term Term Countthis 1is 1another 2example 3

Document 2

#LSNA17

TF–IDF (Term Frequency–Inverse Document Frequency)

In question form... Score increases...

Term Frequency How often does a term appear in a field? + When the term pops up a lot of times along the text

Inverse Document Frequency

How rare is the term in the whole index? + When the term is found in this document and not many others

Field-length Norm How short is the field where the term is? + When there isn't much else in the same field (like, a title)

See the math in: https://www.elastic.co/guide/en/elasticsearch/guide/current/scoring-theory.html

#LSNA17

▪▪

▪▪

▪▪

▪▪

▪▪

Improving textual analysis for better predictions

#LSNA17

Machine driven search

#LSNA17

▪▪▪▪▪

▪▪▪

Machine Driven Search

#LSNA17

▪▪▪▪

▪▪

▪▪

▪▪

Predict with Search: Instant results in search bar

#LSNA17

▪▪▪

▪▪

▪▪▪▪▪

Predict with Search: More Like This

#LSNA17

▪▪

▪▪

▪▪

Predict with Search: Percolate

Jan Verweij: Autotagging Liferay with Elasticsearch Percolatehttps://youtu.be/Pxu06zgiNLc

https://github.com/jverweijL/ElasticAutoTagger

#LSNA17

▪▪▪

▪▪

▪▪▪

Predict with Search: Recommended for YOU

#LSNA17 Highlight

"Single Customer View Demystified"Jonathan Lee, Product Manager, Liferay

#LSNA17

▪▪▪▪▪▪

▪▪

▪▪

Smart Content Delivery

#LSNA17

What’s next for Liferay Search

#LSNA17

Elasticsearch 6

#LSNA17

▪▪▪▪▪▪

Modular Search infrastructure

#LSNA17

▪▪▪▪▪▪▪▪▪

New Search Components

#LSNA17

▪▪▪▪

Liferay Commerce

#LSNA17 Highlight

"Liferay Commerce: A Preview of Our Upcoming Features"Marco Leo, Software Architect, Liferay

#LSNA17

Intelligent Information Discovery

LiferayDXP

Search engine (Elasticsearch 6)

AIaaS(APIs)

- Autocomplete- Did you mean…?

- Suggest as you type- More like this- Percolators- Similarity

- Image classification- Speech recognition

- Face detection

Data Drivenapplication infrastructure

(WeDeploy)

- Search classification- Customer interest prediction

- Machine learning trained models- Recommendation engines

Thank you

#LSNA17