Welcome

1

Presentation byHong Yan

CIMDA DirectorChair Professor, EE CityU

June 2021

Cutting-Edge R&D Topics

AI; Big data analysisTensor and hypergraph theoriesMachine learning; Neural nets; Co-clusteringGPU / FPGA / ASIC; Parallel computingHardware and software developmentSignal / image / video analysis and recognitionData analysis applications in biology and medicineComputer graphics and animationMultimedia systems; Digital entertainment

2

3

Example: Facial Expression Recognition

Face tracking Wavelet features Co-clustering Recognition

References: H Yan, IEEE SMC Magazine, 3(2):23-30, 2017.S Khan, G Xu, R Chan, H Yan, Expert Systems With Applications, 90:427-438, 2017.S Khan, L Chen, and H Yan, IEEE Trans Affective Computing, 11(2):348-360, 2020.

Our contributions:* Online tensor learning * Low rank representation * Real-time face tracking* Feature selection based onco-clustering

* Expression recognition

4

Example: Vehicle Tracking and Identification

References: H Kung, KF Yang, L Chen, YJ Li, LLH Chan, and H Yan, IEEE Trans Intelligent Transportation Systems, 19(3):814-825, 2018.H Kuang, C Liu, L Chen, LLH Chan, RCC Cheung, and H Yan, IEEE Trans SMC: Systems, 49(1):71-80, 2019.

5

Example: Pattern Matching and RecognitionOur contributions:

* Tensor and hypergraph models* Optimization based on nonmonotone spectral

projected gradients* Global convergence of solution is proven

Spectral Matching(SM)Max-Pooling Matching (MPM)Integer Projected Fixed Point (IPFP)Probabilistic Graph Matching (HGM)Tensor Matching (TM)Reweighted Random Walk Hypergraph Matching (RRWHM)Block Coordinate Ascent Graph Matching (BCAGM)Alternating Direction Graph Matching (ADGM)

Collaborations:CityUCUHKHKBUHKUPolyU

References: C Cui, Q Li, L Qi, and H Yan, J Global Optimization, 70(1):237-259, 2018.H Zhu C Cui, L Deng, RCC Cheung, and H Yan, IEEE Trans Cybernetics, 51(8):4062-4074, 2021.

6

Example: Sports Video Analysis and Recognition

References: S Khan, M Nawaz, G Xu, and H Yan, IEEE TCSVT, 30(9):3054-3067, 2020.

Example: Cell Imaging and Lineage AnalysisImage from www.wormatlas.org/ver1/handbook/anatomyintro/anatomyintro.htm

Our contributions:* Cell tracking and matching* Cell-cell contact analysis* Biological network inference

7

References:VW S Ho, MK Wong, X An1, D Guan, J Shao, HCK Ng, X Ren, K He, J Liao, Y Ang, L Chen, X Huang, B Yan, Y Xia, LLH Chan, KL Chow, H Yan, and Z Zhao, Molecular Systems Biology,11:814, 2015.XT Huang, Y Zhu, LLH Chan, Z Zhao, and H Yan, Molecular BioSystems, 12:85-92, 2016.L Chen, Z Zhao, and H Yan, IEEE J. Selected Topics in Signal Processing, 10(1):185-192, 2016.L Chen, Z Zhao, and H Yan, US Patent 10,255,692, 2019.L Chen, VWS Ho, MK Wong, X Huang, LY Chan, HCK Ng, X Ren, H Yan, and Z Zhao, Genetics, 209(1):36-49, 2019.J Cao, G Guan, VWS Ho, MK Wong, LY Chan, C Tang, ZY Zhao, and H Yan, Nature Communications, 1:6254:1-14, 2020.

Collaborations:HKBUHKUSTPeking UCityU

> 20 TB data

Top cancer mortalities in 2018:Lung 1.760 M (~18%)Colorectal 0.862 MStomach 0.783 MLiver 0.782 MBreast 0.627 M

All 9.60 M

Lung Carcinoid Tumor: 5%Small Cell Lung Cancer: 10~15%Non-Small Cell Lung Cancer: 85%

Example: Lung Cancer Drug Resistance Analysis

References: www.cancer.org/cancer/lungcancer/www.who.int/mediacentre/factsheets/fs297/en/www.uniprot.org/uniprot/P00533bcc.ee.cityu.edu.hk/med/D Wang, W Zhou, H Yan, M Wong, and V Lee, Scientific Reports, 3:2855, 2013.L Ma, D Wang, Y Huang, M Wong, V Lee, and H Yan, Computers in Biology and Medicine, 2014.B Zou, VHF Lee, and H Yan, BMC Bioinformatics, 19:88:1-13, 2018.WQ Zhou and H Yan, US Patent 10,475,528, 2019.DD Wang, M Zhu, and H Yan, Briefings in Bioinformatics, 2020.

Our contributions:* EGFR mutant modeling* EGFR-drug complex analysis* Prediction of anti-EGFR drug resistance 8

EGFR-gefitinib(PDB: 2ity)

EGFR-erlotinib(PDB: 1m17)

Collaborations:CityUHKU

9

Example: FPGA based Hardware Accelerators

References:W Ding, Y Wei, Theory and Computation of Tensors: Multi-Dimensional Arrays, Academic Press, 2016.WP Huang, PY Kwan, W Ding, B Min, RCC Cheung, L Qi, and H Yan, Microprocessors and Microsystems, 64:120-127, 2019.WP Huang, RCC Cheung, and H Yan, IEEE TVLSI, 29(7):1335-1347, 2021.

+MUX

MUX

MUX

Our contributions:* Hardware accelerators for

Hankel tensor decomposition* Significant reduction in

storage* Significant reduction in

computational time

Example: Mobile Devices for Motion Detection

Our contributions:* Hardware design* Motion data classification* Small and fast* Low-cost healthcare

10

Reference: H Yan, L Chan, H Chim, H Ching, and C Choi, US Patent 10,347,108, 2019.

11

Hong Kong Science & Technology Park

12

CIMDA Office: Entrance

13

CIMDA Office: RA Area

Opportunities – Realize Your Dreams

Interactions with top researchers in the worldLearning solid mathematical theoriesWorking on emerging technologiesBeing part of ambitious and innovative R&D teamsCreating new products and servicesStartups; Unicorns; IPOs …You imaginations; Many opportunities …

Realizing your dreams… Sky is the limit!

14

R&D Positions Available

15

Good publication record (for postdocs)Good programming skills (C++, Python, etc. for desktops & mobiles)Hardware design skills (FPGA, ASIC)Ambitious; Highly motivated; Good communication skillsAble to work under pressure

Research assistants; ProgrammersPostdoctoral fellows; Engineers / Scientists / VisitorsIT professionals; Multimedia designers

Send CV and salary requirement to: cimda@cityu.edu.hk

End of Presentation

E-mail: cimda@cityu.edu.hkWebsites: www.innocimda.com

www.ee.cityu.edu.hk/~hpyanbcc.ee.cityu.edu.hk/tensor/w_links.html

for16