dr. avidan akerib, vp associative computing bu · 12. netflix. uses similarity search to figure out...
TRANSCRIPT
![Page 2: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/2.jpg)
2
![Page 3: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/3.jpg)
3
HIGH PERFORMANCE
Leader in supplying high performance memories to demanding industries suchas aerospace, defense and high performance datacenters.Acqu MikaMonu and its Associative Computing IP in 2015.
1 FOUNDED IN 1995
2 Consistent profitability & zero debt
PUBLIC COMPANY
3 Design / R&D in Sunnyvale, CA & Israel; Operations in Taiwan
~150 EMPLOYEES WORLDWIDE.
CORPORATE SUMMARY
APU
Developed the APU, Massively Parallel Processor for big data similarity search, based on Computational Memory technology.
![Page 4: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/4.jpg)
4
![Page 5: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/5.jpg)
5
Can someone recommend a…
I recommend this or that or….maybe
nothing…
![Page 6: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/6.jpg)
6
For doing that, Machine Learning is not enough.
LETS UNDERSTAND THE CONCEPT FIRST
![Page 7: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/7.jpg)
7
Ask Fingerprint
covert to feature vector(AI translates Question to
meaningful fingerprint
010101
Fingerprint
convert to feature vector(AI translates DB to
meaningful fingerprints
010110
111010
100101
011010
Similarity Search Engine
Answer
Storage(DRAM)
Cloud ServerClient
SpeechText
PhotoSketchVideo
SpeechText
PhotoSketchVideo
![Page 8: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/8.jpg)
010101
010110
111010
100101
011010
Similarity Search Engine
In-Memory Storage
< 1 TByte
CPUAPU
Associative Computing UnitDRAM
Embedding
OFF LINE COMPUTING
convert to feature vector
ON LINE COMPUTING
Ask
Answer
Cloud ServerClient
![Page 9: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/9.jpg)
9
Computes in-place, directly in the memory array, removing the I/O bottleneck
Significantly increases performance
Reduces power consumption
Data compression (Binary Reduction)
Query parallelism for production system
CPU APUAssociative Processing
Question
Answer
Simple & Narrow Bus
![Page 10: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/10.jpg)
10
Associative Computing fundamentals
The current state is that storage simply holds the data. The need for intelligent cache that preprocesses for the main processor (CPU or GPGPU) tedious tasks and replace the main processor with an associative processor
Calculations within the memory unit with lower latency and lower voltage is making it an essential part of any architecture of any datacenter
![Page 11: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/11.jpg)
11
As it becomes common large scale similarity search
Similarity is in Visual Search, Voice, Text apps
Across applications in all industries –consumer, bioinformatics, cyber, automotive
The future of online product
research: visuals and voice.
The rise of voice searches fueled
by technology like Google Home
and Amazon’s Alexa has been
well-documented.
But visual searches are also on
the rise. Products like Pinterest
Lens use machine learning to
aid in brand and product
discovery”
CRITICAL COMPONENT ACROSS APPS
“
![Page 12: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/12.jpg)
12
NetflixUses similarity search to figure out our taste in TV to retain us by offering personal content
FacebookTries to tailor our newsfeed to our interests
SpotifyBuilds our playlists according to what we listen to
PinterestLets us upload a picture and offer us similar products
WERE EXPERIENCING SIMILARITY AND VISUAL SEARCH
GoogleTries to constantly improve its visual search to be more relevant in search results
![Page 13: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/13.jpg)
13
![Page 14: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/14.jpg)
14
0101
1000
1100
1001
Ad
dre
ss De
cod
er
Sense Amp /IO Drivers
ALU
RE/WE
![Page 15: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/15.jpg)
15
1101
1001
1100
1001
RE
RE
WE?0011NAND
1110
RE
RE
WE
Bus Contention is not an error !!!It’s a simple NOR/NAND satisfying De-Morgan’s law
![Page 16: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/16.jpg)
A B C
0 0 0
0 0 1
0 1 0
0 1 1
1 0 0
1 0 1
1 1 0
1 1 1
D
1
0
1
1
0
0
0
1
AB
C00 01 11 10
1 1 0 0
0 1 1 0
0
1
!A!C + BC =!!( !A!C + BC ) = ! (!(!A!C)!(BC))
= NAND( NAND(!A,!C),NAND(B,C))
Read (B,C) ; WRITE T2Read (!A,!C) ; WRITE T1
Read (T1,T2) ; WRITE D
1 CLOCK
1 CLOCK
• Every minterm takesone clock
• All bit lines executeKarnaugh tables in-parallel
![Page 17: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/17.jpg)
17
A[ ] + B[ ] = C[ ]
No. Of Clocks = 4 * 8 = 32
Clocks/byte= 32/32M=1/1M
OPS = 1Ghz X 1M
= 1 PetaOPS
vector A(8,32M)vector B(8,32M)Vector C(9,32M)C = A + B
Single APU chip has 2M Bit Line
Processors –64 TOPS
or >> 2 TOPS/Watt
![Page 18: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/18.jpg)
Vector A
Vector B
Each bit line becomes a processor and storage
Millions of bit lines = millions of processors
C=f(A,B)
![Page 19: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/19.jpg)
Parallel shift of bit lines @ 1 cycle sections
Enables neighborhood operations such as convolutions
C=f((A,shift(B,1))
Shift vector
![Page 20: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/20.jpg)
4 6 7 -3 -1 4 8 2 8 2 -1
3 -3 7 4 -2 -1 -1 -2 6 6 -2
-1 0 0 5 -2 2 -3 3 -1 7 4
4 2 1 0 2 -2 3 -3 2 4 -2
0 1 1 8 6 4 5 5 1 1 -3
-1 1 6 0 5 1 -1 2 0 -1 0
Query Associative Memory DB
22 47 -5 -5 2 45 -15 59 36 -22In Memory Compute
Cosine Distance TOP K=3
> 100,000 Quires/sec , any K size, 128K Records, Sigle chip@10Watts
![Page 21: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/21.jpg)
Low precision/Binary OPS
In-Memory BW
SP Floating Point
SoftMax, Non Linear
Top-K, Search
Scalability
10
00
X
10
0X
1
0X
1
10
X
10
0X
10
00
X
1
![Page 22: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/22.jpg)
CPU/GPGPU vs APUCPU/GPGPU
(Current Solution)
(In-Place Computing (APU
Send an address to memory Search by content
Fetch the data from memory and send it tothe processor
Mark in place
Compute serially per core(thousands of cores at most)
Compute in place on millions of processors (the memory itself becomes
millions of processors
Write the data back to memory, furtherwasting IO resources
No need to write data back—the result isalready in the memory
Send data to each location that needs it If needed, distribute or broadcast at once
![Page 23: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/23.jpg)
23
.
![Page 24: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/24.jpg)
256Mbit line processors
ARC Serial processor
256Mbit line processors
256Mbit line processors
ARC Serial processor
256Mbit line processors
256Mbit line processors
ARC Serial processor
256Mbit line processors
256Mbit line processors
ARC Serial processor
256Mbit line processors
FPGA including
ARMP
CIe
Peripherals
PC
Ie
DRAM
CORE 0 CORE 1
CORE 2 CORE 3
2M bit processors or 128K vector processors
runs at 1G Hz From 2 Tera
Flops to 2 Peta Ops
24
![Page 25: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/25.jpg)
Multi-Functional, Programmable Blocks
Acceleration of FP operation Blocks
25
![Page 26: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/26.jpg)
![Page 27: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/27.jpg)
FPGA/ARM
16GB DDR4
PC
Ie
PeripheralsAPU FPGA/
ARM
16GB DDR4
PC
Ie
PeripheralsAPU FPGA/
ARM
16GB DDR4
PC
Ie
PeripheralsAPU FPGA/
ARM
16GB DDR4
PC
Ie
PeripheralsAPU
![Page 28: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/28.jpg)
28
![Page 29: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/29.jpg)
Simple example:
N = 36, 3 Groups
2 dimensions (D = 2 ) for X and Y
K = 4Group Green selected as the majority.
For actual applications:
N = Billions
D = Tens
K = Tens of thousands
![Page 30: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/30.jpg)
Q
4 1 3 2
Majority Calculation
Item features and label storage
Computing Area
Compute cosine distances for all N in parallel (≤ 10μs, assuming D=50 features)
K Mins at O(1) complexity (≤ 3μs)
Distribute data – 2 ns (to all)
In-Place ranking
Fe
ature
s of ite
m
1
Item 1
Item 2
Item 3
Item N
Fe
ature
s of ite
m
2 Fe
ature
s of ite
m
N
With the data base in an APU, computation for all N items done in
≤ 0.05 ms, independent of K (1000X Improvement over current solutions)
![Page 31: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/31.jpg)
31
![Page 32: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/32.jpg)
.
Combination of Edges
Pattern of Local Contrast / Edges
Pixel Values
FeaturesCombination of Features
95% Human Face
1% Cat
3% Mask
1% Dog
Deep Learning Can classify up to
thousands clusters but what if we have
millions or Billions?
![Page 33: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/33.jpg)
??
carsdogs
horses?
Updates unlabeled images requires new training – that consume latency, power, performance
DEEP LEARNING IN NOT ENOUGH
![Page 34: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/34.jpg)
Gradient-Based Optimization has achieved impressive results on supervised tasks such as image classification
These models need a lot of data
People can learn efficiently from few examples
ASSOCIATIVE COMPUTING
Like people, can measure similarity to features stored in memoryCan also create a new label for similar features in the future
Visual search, Face recognition and NLP are some of used cases showing on next slides
![Page 35: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/35.jpg)
Combination of Edges
Pattern of Local Contrast / Edges
Pixel Values
Features
95% Human Face
1% Cat
3% Mask
1% DogSharon
Tom
Mary
John
⮚ Need to Identify people rather than object categories
Chris
Michael
Jerry
Guy
Laura
Nathan
Rachel
Jenifer
Brittney
Dianna
Hannah
Bob
Kelly
Ross
featu
res
featu
res
Min(dist)
! Thousands to millions of different identities! Classes may frequently change (avoid
retraining for every added identity)! Identification should occur from as much as
one previously seen image – One/Low ShotLearning Problem
! Based on Pre-Trained Network
Ideal for Similarity Search
![Page 36: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/36.jpg)
12
8flo
at3
2
FaceDetection(MTCNN)
FaceAlignment
DeepFeature
Extraction
Hashing(LSH)
Similarity Search(Hamming Distance + TopK)
n-b
it bin
ary
ve
ctor
Query Image
Identification/Retrieval
Database faces pass the same procedure (offline) and stored in the APU APU
![Page 37: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/37.jpg)
12
8flo
at3
2
Features ExtractorPre-Trained Network
Hashing(LSH)
SimilaritySearch
( Distance Measure + TopK)
n-b
it bin
ary
ve
ctor
Identification/Retrieval
Database pass the same procedure (offline) and stored in the APU APU
![Page 38: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/38.jpg)
Query Images
Face Feature Extraction
Sim
ila
rity
Se
arc
h
Database: • 13247 images of 5755 identities• Between 1 to 500 images per person
![Page 39: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/39.jpg)
010101
010110
111010
100101
011010
Similarity Search Engine
In-Memory Storage
< 1 TByte
CPUAPU
Associative Computing UnitDRAM
Embedding
OFF LINE COMPUTING
convert to feature vector
ON LINE COMPUTING
Answer
Cloud Server
Query
![Page 40: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/40.jpg)
Core 0Core 1
256Mbit line processors
ARC Serial processor
256Mbit line processors
256Mbit line processors
ARC Serial processor
256Mbit line processors
256Mbit line processors
ARC Serial processor
256Mbit line processors
256Mbit line processors
ARC Serial processor
256Mbit line processors
40
DRAM to store fingerprint database
Indices Output top K of
Centroids
Query
Pre Loaded 64K Centroids Into cores 0 and 1
(each connected to 1K records)
Load K * 1000Records from L4 to L1 of cores 2 and 3
Output Final Top KFrom all DB
Example: 64 M records = 64 K Centroids X 1000 records eachUp to 100,000 queries/sec
![Page 41: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/41.jpg)
41
HW: 1 Sever with 4 APU Boards (One APU 1.1 ASIC Per Board)
Data Base:
256 Million Images
256M Binary Vectors with nBit=512 ---🡪Total: 16GB
Pre Search Preparation:
DB Clustering
256K Clusters x 1000 Records in each Cluster
Cluster Size: 16MB
Total Records size: 16GB
2 APU’s will be use for TOP-K clusters and 2 APU’s will be use for TOP-K Records
![Page 42: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/42.jpg)
42
![Page 43: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/43.jpg)
43
System Management Execution
GNL
Driver
APU Board
System Management Execution
GNL
Driver
APU Board
System Management Execution
GNL
Driver
APU Board
System Management Execution
GNL
Driver
APU Board
System Management APIs (C++, Python)
Resource Management Service Search Service Numerical Service
APU Config Tool
APU Search Applications
3rd Party Applications
FAISSTensorFlow
![Page 44: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/44.jpg)
44
Comprehensive list of numericalfunction algorithms supported
Wide range of algorithms
Multiple clustering techniques
Interfacing supported
Range of interfaces
In memory DB
GSI API
GSI Numeric Library
GSI APU Driver
GSI APU
![Page 45: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/45.jpg)
45
![Page 46: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/46.jpg)
46
DB Size for the Pilot: 38M Compounds
Vector Size: 512 Bits, Search time 12 sec.
Instead of 6 Minutes 1024 Bits, Search Time 24 Sec.
Instead of endless time The performance based on GSI
prototype chip. For commercial search time is 0.4 sec for 512 bits per 100 queries , or 0.8 sec
for 1K bits per 100 queries.
Solution is scalable for any size of DB any size of fingerint and any type of search algorithm.
Search: Algorithm: Tanimoto Support Threshold
Search K- Nearest Neighbors
(KNN) K=1,10,100,1000
![Page 47: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/47.jpg)
47
Visual Search
Facial Recognition
Molecules Search
Documents
![Page 48: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/48.jpg)
Recommendations
Video Search
![Page 49: Dr. Avidan Akerib, VP Associative Computing BU · 12. Netflix. Uses similarity search to figure out our taste in TV to retain us by offering personal content . Facebook. Tries to](https://reader034.vdocuments.mx/reader034/viewer/2022051512/6038087f8a991b574a319bd1/html5/thumbnails/49.jpg)
QUESTIONS?