recomendação de ponta a ponta na globo.com
TRANSCRIPT
![Page 1: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/1.jpg)
Recomendação
![Page 2: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/2.jpg)
Recomendação de conteúdo
![Page 3: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/3.jpg)
Em 2010...
![Page 4: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/4.jpg)
Por dentro
![Page 5: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/5.jpg)
Coleta de atividades antes
página visitada Papalog
página visitada Papalog
página visitada Papalog
![Page 6: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/6.jpg)
Coleta de atividades atual
página visitada
tempo assistindo video
compartilhamento
comentário
tempo lendo matéria
HorizonGateway
porcentagem de scroll
![Page 7: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/7.jpg)
Parquet e Spark SQL
df.groupBy(df("user"), df("object")) .agg(first("user"), first("object"), max("scroll")) .where(df("scroll") > 50)
![Page 8: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/8.jpg)
Processamento paralelo
yarn
![Page 9: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/9.jpg)
Tipos de algoritmos
● Content based
● User based
● Cold start
![Page 10: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/10.jpg)
Content based
![Page 11: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/11.jpg)
Preferências do usuário
![Page 12: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/12.jpg)
TF-IDF
Importância do termo no documento
Quão incomum é o termo no acervo
![Page 13: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/13.jpg)
Entidades semânticas
![Page 14: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/14.jpg)
Encontrando a notícia certa
+BBB
+Edredon
Notícia c
Notícia B
Notícia AUsuário
![Page 15: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/15.jpg)
User based
![Page 16: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/16.jpg)
Collaborative filtering
![Page 17: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/17.jpg)
Matriz de preferências
![Page 18: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/18.jpg)
Preferências implícitas
Porcentagem de scroll
Temo de página visivel
![Page 19: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/19.jpg)
Matriz de preferências implícitas
0,9 0,8
0,8
![Page 20: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/20.jpg)
Fatores latentes
![Page 21: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/21.jpg)
Previsão n-dimensional
Duas dimensões:f(x) = a + bx
Três dimensões:f(x) = a + bx'1 + cx'2
N dimensões:f(x) = a + bx'1 + cx'1 + … nx'n
![Page 22: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/22.jpg)
Validação
![Page 23: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/23.jpg)
Cross validation
![Page 24: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/24.jpg)
K-fold cross validation
![Page 25: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/25.jpg)
Força bruta
for (maxIter <- Array(5, 10, 15, 20)) { for (feature <- Array(10, 20, 30, 40)) { for (alpha <- Array(0.01, 0.1, 0, 1, 10, 100)) { for (regParam <- Array(0.01, 0.1, 0, 1, 10, 100)) {
![Page 26: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/26.jpg)
Root mean square error
![Page 27: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/27.jpg)
Precision and recallQuanto dos documentos recomendados acertamos
Quanto dos documentos relevantes acertamos
![Page 28: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/28.jpg)
F-measure
![Page 29: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/29.jpg)
Métricas por algoritmo
![Page 30: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/30.jpg)
Baseada em testes AB
![Page 31: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/31.jpg)
Resultados
![Page 32: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/32.jpg)
Globo Esporte
![Page 33: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/33.jpg)
BUG :(
Globo Esporte
![Page 34: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/34.jpg)
GShow
![Page 35: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/35.jpg)
75% a mais de conversão em mobile que outras ofertas automáticas
173% a mais de conversão em desktop que outras ofertas automáticas
GShow
![Page 36: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/36.jpg)
TechTudo
![Page 37: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/37.jpg)
TechTudo
+195%
na partipação na retenção do usuárioem 2014
![Page 38: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/38.jpg)
TechTudo: Home
![Page 39: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/39.jpg)
TechTudo: Home50% a mais de conversão em mobile que outras ofertas automáticas
32% a mais de conversão em desktop que outras ofertas automáticas
![Page 40: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/40.jpg)
Globosatplay
![Page 41: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/41.jpg)
GlobosatPlay
45% de melhoria de conversão
![Page 42: Recomendação de ponta a ponta na Globo.com](https://reader034.vdocuments.mx/reader034/viewer/2022052308/58f31a7d1a28ab0c318b458d/html5/thumbnails/42.jpg)
@timotta