konark: a rfid based system for enhancing in-store ......wpa 2017, mobisys ‘17 june 19, 2017...

35
June 19, 2017 WPA 2017, MobiSys ‘17 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan 1 , Eugene Chai 2 , Karthik Sundaresan 2 , Sampath Rangarajan 2 , and Lili Qiu 1 . 1 UT Austin 2 NEC Labs America

Upload: others

Post on 27-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

June 19, 2017WPA 2017, MobiSys ‘17

Konark: A RFID based system for enhancing in-store shopping experience

Swadhin Pradhan1, Eugene Chai2, Karthik Sundaresan2, Sampath Rangarajan2, and Lili Qiu1.

1UT Austin 2NEC Labs America

Page 2: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20172

Motivation

RetailerConsumer

Page 3: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20172

Motivation

RetailerConsumer

• Immersive • Personalized • Faster …

• More Insights • Fine-grained ..

Page 4: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20173

Overview

Page 5: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20173

Overview• Creating a RFID based system to provide ▫ Better consumer shopping experience ▫ Richer retail analytics

Page 6: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20173

Overview• Creating a RFID based system to provide ▫ Better consumer shopping experience ▫ Richer retail analytics

Which items customers put in the cart at a particular time window ?

Queue-free checkout

Page 7: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20173

Overview• Creating a RFID based system to provide ▫ Better consumer shopping experience ▫ Richer retail analytics

Which items customers put in the cart at a particular time window ?

Queue-free checkout

Items bought? Items interested ?

Detecting which items users are browsing

Page 8: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20174

Our Work

Page 9: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20174

Our Work

Building a RFID reader and antenna equipped shopping cart and

developing algorithms to detect items inside the cart, and to detect users’

browsing interests on-the-go.

Page 10: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20175

Detecting Items Inside the Cart

Page 11: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20175

Detecting Items Inside the CartKey idea

Page 12: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20175

Detecting Items Inside the CartKey idea

Page 13: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20175

Detecting Items Inside the CartKey idea

Page 14: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20175

Detecting Items Inside the CartKey idea

Page 15: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20175

Detecting Items Inside the CartKey idea

Page 16: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20175

Detecting Items Inside the CartKey idea

Reference Tags

Page 17: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20175

Detecting Items Inside the Cart

Hi-dimensional Feature SpaceTimeTag IDs

Feature Values

K-Means Clustering

Key idea

Cart is Mobile ?Yes

Algorithm sketch:

Reference Tags

Page 18: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20176

User’s Item Browsing Detection• Key idea :

Page 19: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20176

User’s Item Browsing Detection• Key idea :

The phase variation of the tags of interacted items is higher.

Page 20: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20176

User’s Item Browsing Detection• Key idea :

The phase variation of the tags of interacted items is higher.

Cart is Mobile ?

No

Filter tags according to nearest reference tags

Track phase variation across tags

Algorithm sketch:

Find the tags with highest phase variation

Page 21: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20177

Setup• Impinj Speedway Revolution RFID Reader ▫ Reads phase, RSSI, doppler of RFID tags ▫ 300 tags/second ▫ 50 channels, 902.75-927.75 (25 MHz bandwidth)

• 6 dBi gain circular polarized Antennas

• Dogbone Monza 6 RFID tags (Suited for 866-928 MHz reading)

Page 22: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20178

Experimental Setup

Reference Tags

The Cart

Antennas

RFID Reader

Laptop

Page 23: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20179

Evaluation metrics

Page 24: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 20179

Evaluation metrics▪ Modules : ▪Detecting items inside the cart. ▪Detecting user interest in a particular item.

▪ Metrics : ➢ Accuracy (What percentage of items predicted correctly ?)

oFalse Positive % (What percentage of items are outside but tagged inside ?) oFalse Negative % (What percentage of items are inside but tagged outside ?)

➢ Detection Latency (How much time it takes to detect ?)

Page 25: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201710

In-cart item Detection Accuracy

Page 26: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201710

In-cart item Detection Accuracy

Page 27: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201710

In-cart item Detection Accuracy

Accuracy remains good even after putting many items in the cart

Accuracy reaches ~100% after Detection latency of 60 seconds

Page 28: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201711

Detection Latency vs Accuracy

Page 29: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201711

Detection Latency vs Accuracy

Page 30: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201711

Detection Latency vs Accuracy

False positive rate is not too high even in low detection latency

and high number of items

Page 31: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201712

Item Browsing Detection

Page 32: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201712

Item Browsing Detection

For number of items ~ 200, to achieve ~100% accuracy,

we need only ~20 sec latency.

Page 33: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201713

Key takeaways

▪Trade-off between detection latency and accuracy.

▪Speed and benefits compared to traditional self-checkout system or vision based system (Amazon Go). (NLOS/Occlusion).

▪ Infrastructure RFID solutions (ShopMiner [SenSys ‘15] or CBID [Infocom ‘14]) which work with smaller number of tags, and lacks user level information.

Page 34: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,

WPA 2017, MobiSys ‘17 June 19, 201714

Future Works

▪Making the retail analytics richer.

▪Testing with multiple carts at different mobility.

▪Collaboration among shopping carts etc.

▪Field-testing the system in real shopping malls.

Page 35: Konark: A RFID based system for enhancing in-store ......WPA 2017, MobiSys ‘17 June 19, 2017 Konark: A RFID based system for enhancing in-store shopping experience Swadhin Pradhan1,