prostate lesion delineation from multiparametric magnetic...

12
Prostate lesion delineation from multiparametric magnetic resonance imaging based on locality alignment discriminant analysis Mingquan Lin Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China Weifu Chen School of Mathematics, Sun Yat-sen University, Guangzhou, Guangdong, China Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China Mingbo Zhao School of Information Science and Technology, Donghua University, Shanghai, China Eli Gibson Biomedical Engineering, University of Western Ontario, London, Ontario, Canada Centre for Medical Image Computing, University College London, London, UK Matthew Bastian-Jordan and Derek W. Cool Department of Medical Imaging, University of Western Ontario, London, Ontario, Canada Zahra Kassam Department of Medical Imaging, University of Western Ontario, London, Ontario, Canada Lawson Health Research Institute, London, Ontario, Canada Huageng Liang Department of Urology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China Tommy W.S. Chow Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China Aaron D. Ward Department of Medical Biophysics, University of Western Ontario, London, Ontario, Canada Lawson Health Research Institute, London, Ontario, Canada Bernard Chiu a) Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China (Received 26 January 2018;revised 7 June 2018; accepted for publication 17 August2018; published 19 September 2018) Purpose: Multiparametric MRI (mpMRI) has shown promise in the detection and localization of prostate cancer foci. Although techniques have been previously introduced to delineate lesions from mpMRI, these techniques were evaluated in datasets with T2 maps available. The generation of T2 map is not included in the clinical prostate mpMRI consensus guidelines; the acquisition of which requires repeated T2-weighted (T2W) scans and would significantly lengthen the scan time currently required for the clinically recommended acquisition protocol, which includes T2W, diffusion- weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study is to develop and evaluate an algorithm that provides pixel-accurate lesion delineation from images acquired based on the clinical protocol. Methods: Twenty-five pixel-based features were extracted from the T2-weighted (T2W), appar- ent diffusion coefficient (ADC), and dynamic contrast-enhanced (DCE) images. The pixel-wise classification was performed on the reduced space generated by locality alignment discriminant analysis (LADA), a version of linear discriminant analysis (LDA) localized to patches in the feature space. Postprocessing procedures, including the removal of isolated points identified and filling of holes inside detected regions, were performed to improve delineation accuracy. The segmentation result was evaluated against the lesions manually delineated by four expert observers according to the Prostate Imaging-Reporting and Data System (PI-RADS) detection guideline. Results: The LADA-based classifier (60 11%) achieved a higher sensitivity than the LDA-based classifier (51 10%), thereby demonstrating, for the first time, that higher classification perfor- mance was attained on the reduced space generated by LADA than by LDA. Further sensitivity improvement (75 14%) was obtained after postprocessing, approaching the sensitivities attained by previous mpMRI lesion delineation studies in which nonclinical T2 maps were available. 4607 Med. Phys. 45 (10), October 2018 0094-2405/2018/45(10)/4607/12 © 2018 American Association of Physicists in Medicine 4607

Upload: others

Post on 04-Nov-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

Prostate lesion delineation from multiparametric magnetic resonanceimaging based on locality alignment discriminant analysis

Mingquan LinDepartment of Electronic Engineering, City University of Hong Kong, Hong Kong, China

Weifu ChenSchool of Mathematics, Sun Yat-sen University, Guangzhou, Guangdong, ChinaDepartment of Electronic Engineering, City University of Hong Kong, Hong Kong, China

Mingbo ZhaoSchool of Information Science and Technology, Donghua University, Shanghai, China

Eli GibsonBiomedical Engineering, University of Western Ontario, London, Ontario, CanadaCentre for Medical Image Computing, University College London, London, UK

Matthew Bastian-Jordan and Derek W. CoolDepartment of Medical Imaging, University of Western Ontario, London, Ontario, Canada

Zahra KassamDepartment of Medical Imaging, University of Western Ontario, London, Ontario, CanadaLawson Health Research Institute, London, Ontario, Canada

Huageng LiangDepartment of Urology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei,China

Tommy W.S. ChowDepartment of Electronic Engineering, City University of Hong Kong, Hong Kong, China

Aaron D. WardDepartment of Medical Biophysics, University of Western Ontario, London, Ontario, CanadaLawson Health Research Institute, London, Ontario, Canada

Bernard Chiua)

Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China

(Received 26 January 2018; revised 7 June 2018; accepted for publication 17 August 2018;published 19 September 2018)

Purpose: Multiparametric MRI (mpMRI) has shown promise in the detection and localization of

prostate cancer foci. Although techniques have been previously introduced to delineate lesions from

mpMRI, these techniques were evaluated in datasets with T2 maps available. The generation of T2

map is not included in the clinical prostate mpMRI consensus guidelines; the acquisition of which

requires repeated T2-weighted (T2W) scans and would significantly lengthen the scan time currently

required for the clinically recommended acquisition protocol, which includes T2W, diffusion-

weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study is to develop

and evaluate an algorithm that provides pixel-accurate lesion delineation from images acquired based

on the clinical protocol.

Methods: Twenty-five pixel-based features were extracted from the T2-weighted (T2W), appar-

ent diffusion coefficient (ADC), and dynamic contrast-enhanced (DCE) images. The pixel-wise

classification was performed on the reduced space generated by locality alignment discriminant

analysis (LADA), a version of linear discriminant analysis (LDA) localized to patches in the

feature space. Postprocessing procedures, including the removal of isolated points identified

and filling of holes inside detected regions, were performed to improve delineation accuracy.

The segmentation result was evaluated against the lesions manually delineated by four expert

observers according to the Prostate Imaging-Reporting and Data System (PI-RADS) detection

guideline.

Results: The LADA-based classifier (60 � 11%) achieved a higher sensitivity than the LDA-based

classifier (51 � 10%), thereby demonstrating, for the first time, that higher classification perfor-

mance was attained on the reduced space generated by LADA than by LDA. Further sensitivity

improvement (75 � 14%) was obtained after postprocessing, approaching the sensitivities attained

by previous mpMRI lesion delineation studies in which nonclinical T2 maps were available.

4607 Med. Phys. 45 (10), October 2018 0094-2405/2018/45(10)/4607/12 © 2018 American Association of Physicists in Medicine 4607

Page 2: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

Conclusion: The proposed algorithm delineated lesions accurately and efficiently from images

acquired following the clinical protocol. The development of this framework may potentially acceler-

ate the clinical uses of mpMRI in prostate cancer diagnosis and treatment planning. © 2018 American

Association of Physicists in Medicine [https://doi.org/10.1002/mp.13155]

Key words: cancer lesion delineation, locality alignment discriminant analysis (LADA), multipara-

metric MRI (mpMRI), prostate cancer

1. INTRODUCTION

Prostate cancer is one of the most commonly diagnosed can-

cers and a leading cause of mortality worldwide. Prostate

cancer is the most common nonskin cancer in North Amer-

ica.1,2 In Hong Kong, prostate cancer accounted for 11.3% of

all new cancer cases in male and was the third most common

cancer in men in 2014.3 The first-line screening tests include

digital rectal examination (DRE) and serum prostate-specific

antigen (PSA) tests. If either result is suspicious for cancer,

transrectal ultrasound-guided (TRUS-guided) prostate biopsy

is performed to evaluate the presence of cancerous lesions.

Although the prostate gland can be delineated from TRUS

images,4,5 cancer lesions cannot usually be seen by ultra-

sound and locations where biopsy is performed are deter-

mined by protocols established based on previous clinical

observations.6 Due to the inability of TRUS in targeting

lesions, up to 35% of the lesions are missed in the first

TRUS-guided biopsy.7 Repeated biopsies are needed, leading

to increased emotional stress for patients. Thus, sensitive

image-based tools allowing precise lesion localization are

required to increase the yield of the biopsy procedure. In

addition, the advent of prostate cancer focal therapy has pro-

vided options for localized tumors to be treated with a lower

risk of morbidity in the urinary and reproductive systems.

Delivering these therapies while minimizing collateral dam-

ages to surrounding healthy tissues requires accurate lesion

localization.

MRI has been used to detect prostate cancer for over three

decades.8 Early diagnosis techniques focused on imaging the

morphological or anatomical irregularities based on the sig-

nal contrast displayed in T2W images. Although T2W images

have high tissue contrast and high spatial resolution for visu-

alization of zonal anatomy and tumor, it has limited sensitiv-

ity and specificity for prostate cancer detection. Some lesions

are isointense to neighbouring healthy tissues, resulting in

the relatively poor sensitivity. The specificity is also limited

because benign abnormalities, such as postbiopsy hemor-

rhage and prostatitis, may mimic lesions in T2W images.

Multiparametric MRI (mpMRI) combines anatomic T2W and

functional techniques, including diffusion-weighted imaging

(DWI) and dynamic contrast-enhanced (DCE) MRI to

enhance detection and localization accuracy. Lesions are

associated with reduced water diffusion due to higher cellular

density. The restricted diffusion can be measured by DWI.

The apparent diffusion coefficients (ADC) characterizing the

amount of diffusion calculated from multiple DW images are

typically displayed as a parametric map to facilitate

assessment. DCE MRI depicts the vascularity of tissues by

following the temporal signal variations after injection of a

contrast agent. Lesions can be detected by DCE MRI as they

are associated with increased vascularity, which leads to early

hyperenhancement and rapid washout of the contrast agent.

Although studies in prostate cancer detection and localiza-

tion research based on mpMRI have been performed,9–17

most studies focus on the localization of lesions in coarse

regions instead of tumor delineation. The prostate was

divided into 6–30 regions in these studies. Radiologists then

visually identified regions on which lesions lie by reviewing

a subset or all of T2W, ADC and DCE MR images. Studies

have suggested that when combined with T2W, DCE MRI

increases the sensitivity of lesion detection,14,16 whereas DWI

improves specificity,9,11,15 with optimal localization accuracy

obtained when all three sequences were used.10,12,14,17 Since

these studies applied different schemes to define prostate

regions, there is a large variation in the results obtained

across studies; for example, sensitivity and specificity of

T2W images were reported to range from 54 to 91% and 27

to 91%, respectively.9,10,18 Another limitation of these studies

is that they all required radiologists to identify lesions by

working through many transverse MR images, and manual

identification is time-consuming and subject to observer vari-

ability. The lack of standardization in mpMRI acquisition

protocol as well as in interpreting and reporting mpMRI

results further lead to the discrepancy in the conclusions

made by different investigations.19 For this reason, consensus

guidelines on interpreting mpMRI have been developed by

experts from the European Society of Urogenital Radiology

(ESUR) and the American College of Radiology (ACR).20,21

However, as the mpMRI assessment was performed by

human observers in previous studies, a substantial interob-

server variability still exists.22,23,24 As the consensus guideli-

nes are expected to be more commonly adopted in clinical

practice, a major motivation of this study is to develop an

automated technique that can delineate lesions from the con-

sensus acquisition protocol reproducibly after trained by a

number of expert observers.

Although pixel-based prostate cancer classification

techniques based on mpMRI have been previously

described,25–29 these techniques were not designed to analyze

the MR images obtained in standard protocols described in

the consensus guidelines. In particular, quantitative T2 maps

were available for the pixel-based lesion localization algo-

rithms reported in Refs. [25–29]. Although T2 maps are

superior to the T2W images in that T2 maps are not con-

founded by acquisition parameters, such as TR, and the

Medical Physics, 45 (10), October 2018

4608 Lin et al.: Prostate lesion delineation from mpMRI 4608

Page 3: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

variation in the signal intensity as a function of the distance

from the endorectal coil, computation of the T2 map required

the acquisition of the T2W fast spin-echo images for ten echo

times. The significant lengthening of the scanning time

required for the generation of T2 maps is ill-afforded in clini-

cal practice considering that standard protocols described in

the consensus guidelines, which include T2W, ADC, and

DCE imaging, but not T2 maps, have already taken

30–45 min.20

Lesion delineation from mpMRI requires the classifica-

tion of each pixel to either a part of a cancer lesion or the

background. Classification is commonly achieved by finding

the nearest neighbour in the feature space. Euclidean dis-

tance, however, becomes less meaningful in a high-dimen-

sional feature space as the Euclidean distance to a point’s

furthest neighbour approaches that to its closest neighbour

when the dimension increases to as few as 15 as shown in

Beyer et al.30 The poor contrast in distances to different data

points would render the use of nearest neighbour classifier

questionable. For this reason, there was a need to reduce the

dimensionality of the feature space before a nearest neigh-

bour classifier was applied in this study as more than 20 fea-

tures were extracted for each pixel. Linear discriminant

analysis (LDA) is among the most widely used dimensional-

ity reduction approaches in which a projection matrix is

found to maximize the trace of the between-class scatter

matrix and minimize the trace of the within-class scatter

matrix simultaneously. A widely used formulation of LDA is

to maximize the trace ratio of the between- and within-class

scatter matrices. However, distribution of data points in dif-

ferent regions of the feature space may be highly inhomoge-

neous; in this situation, minimization of trace ratio of the

between- and within-class scatter matrices constructed from

the entire dataset compromises the discrimination perfor-

mance of LDA. To address this issue, Tang et al.31 developed

the locality alignment discriminant analysis (LADA) frame-

work that divided the whole feature space into local patches.

Instead of maximizing the trace ratio of the global scatter

matrices, a projection matrix was found to maximize the

ratio between the traces of the sum of scatter matrices com-

puted for all local patches [Eq. (11)], thereby capturing

essential patterns exhibited locally in the feature space. This

algorithm was applied to characterize English writing styles

in different geographical regions,31 but the use of this tech-

nique in classification has not been thoroughly validated.

The focus of this paper is to develop a LADA-based near-

est neighbour classifier for lesion delineation from mpMRI

obtained using the imaging protocol specified in the consen-

sus guideline.20 The results generated by this classifier were

subsequently optimized by a number of postprocessing steps

that removed isolated regions identified as cancerous and

filled holes inside detected regions. These steps essentially

incorporated prior information on the lesion size and topol-

ogy into the localization framework. Preliminary results from

this study have been previously published in a conference

paper.32 The current paper substantially extends the confer-

ence paper, with a postprocessing algorithm introduced to

improve the delineation results generated based on LADA,

several additional subjects for evaluation and additional

experiments to evaluate the improvement in delineation

accuracy attributable to DCE and the proposed postprocess-

ing techniques as well as the sensitivity of delineation

accuracy to the prostates used in tuning model parameters.

2. MATERIALS AND METHODS

2.A. Image acquisition and preprocessing

Thirteen subjects with prostate cancer histologically con-

firmed on previous biopsies were imaged by a 3T GE Discov-

ery MR750 (GE Healthcare, Waukesha, WI, USA) with an

endorectal coil (Prostate eCoil, Medrad Inc., Warrendale, PA,

USA). Clinical T2W, DW, and DCE MR images were

acquired as previously described33 for each patient with the

following acquisition parameters. T2W 2D fast spin-echo:

TR: 4–9 s, TE: 158–163 ms, slice thickness: 2.2 mm. DCE

spoiled gradient-recalled echo: TR: 5.6–5.9 ms, TE: 2.1–

2.2 ms, flip angle: 15∘ , 90-s intervals, slice thickness:

2.8 mm. DW 2D echo-planar: TR: 4 s, TE: 70–77 ms, slice

thickness: 3.3–3.6 mm, b-value: 600–800. ADC images were

generated from DW images on the MR750 console. Images

were assessed using ClearCanvas Workstation 7.1 (ClearCan-

vas Inc., Toronto, Canada) and interpreted by four observers

(one radiology resident and three radiologists with 5, 6, 2.5,

and 2.5 yr of experiences in prostate MRI assessment) fol-

lowing the Prostate Imaging-Reporting and Data System

(PI-RADS) detection guidelines (Version 1).20 Each observer

delineated lesions that were equivocally, likely, and highly

likely to be clinically significant (PI-RADS of 3–5, respec-

tively) and assigned a PI-RADS score to each delineated

lesion on T2W, DW, and DCE MR images separately.

Images for each patient were then registered by an expert

observer and resampled to standardize the in-plane resolution

and slice thickness. The in-plane pixel size is 0.5 9 0.5 mm

and the slice thickness is 3 mm after resampling, with the

peripheral zone of each gland represented by approximately

20,000 pixels. In this study, regions with PI-RADS ≥ 3

marked by any radiologist on any of the three images were

considered cancerous, resulting in a binary classification

available on a pixel-by-pixel basis. Our proposed pixel-based

cancer localization technique was trained and validated using

this pixel-based expert classification.

2.B. Pixel-based feature extraction

We extracted the following features for each pixel. The

parentheses show the number of features associated with each

pixel:

(1) Grayscale values (9): As prostate lesions typically

appear as homogeneous low-intensity regions in T2W

images and are associated with low ADC values, gray

levels in T2W and DCE images were extracted to train

and validate the proposed algorithm. As DCE MR

Medical Physics, 45 (10), October 2018

4609 Lin et al.: Prostate lesion delineation from mpMRI 4609

Page 4: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

images were generated in sequence, each pixel is

equipped with multiple grayscale values representing

temporal signal variation after the injection of a contrast

agent.

(2) Sorted grayscale values in the neighborhood (16): For

the T2W and ADC images, grayscale values in the eight

neighbouring pixels were obtained and sorted in the

ascending order. The reason that we chose to sort

the grayscale values here was to make the feature and

the lesion localization result rotation invariant (i.e., the

same region should be detected as cancerous even

though the images are rotated).

2.C. Linear discriminant analysis (LDA)

Linear discriminant analysis (LDA) separates two or more

classes of high-dimensional data points by finding a projec-

tion matrix to maximize a cost function quantifying the inter-

class difference in relation to the intraclass variability. A

commonly used cost function is the trace ratio cost func-

tion,34 and the development of the current algorithm was

based on this function. Mathematically, the N D-dimensional

data points in the training set are represented by a D 9 N

matrix X = [x1, x2, ⋯, xN]. Each data point is represented by

a D-dimensional column vector in X and belongs to a class ciwith i 2 {1, 2, ⋯, c}. Our application is a two-class prob-

lem (i.e., c = 2). We define Ni to be the total number of data

points in ci, li to be the mean of all data points in ci, and l to

be the mean of all data points. The D 9 D within- and

between-class scatter matrices, Sw and Sb, respectively, are

defined as follows:

Sw ¼Xc

i¼1

X

x2ci

ðx� liÞðx� liÞT ; (1)

Sb ¼Xc

i¼1

Niðli � lÞðli � lÞT ; (2)

For later development of the LADA algorithm, Sw and Sbare expressed in terms of X:

Sw ¼ XLwXT ; (3)

Sb ¼ XLbXT ; (4)

where Lw and Lb are N 9 N matrices with:

Lw ¼ I� Aw: (5)

Aw and Lb are defined as follows: If xm and xn are in same

class, Awjmn ¼ 1=Ni and Lbjmn ¼ 1=Ni � 1=N. Otherwise,Awjmn ¼ 0 and Lbjmn ¼ �1=N. The (d1,d2)

th component of

Sw are the within-class covariances ðP

xk2cixk;d1xk;d2Þ

�Nili;d1li;d2 summed across all classes, where xk,d and li,d

are the dth component of the data point xk and the class mean

li, respectively. The identity matrix in Eq. (5) accounts for

the first term and Aw accounts for the second term. In the def-

inition of Lb, the terms associated with 1/Ni accounts for the

group means and those associated with 1/N accounts for the

mean of the entire dataset.

LDA finds a D 9 d matrix W that projects each D-dimen-

sional data point to a corresponding d-dimensional data point

withD >> d that maximizes the trace ratio cost function. Math-

ematically, Y = WTX, with the columns of the d 9 N matrix

Y representing the projected d-dimensional data points. The

optimalW* is represented by the following equation:

W� ¼ arg maxWTW¼I

TrðWTSbWÞ

TrðWTSwWÞ

¼ arg maxWTW¼I

TrðWTXLbXTWÞ

TrðWTXLwXTWÞ

¼ arg maxY

TrðYLbYTÞ

TrðYLwYTÞ;

(6)

in which we used Eqs. (3), (4), and Y = WTX. The last term

in Eq. (6) was associated with a constraint of WTW = I to

ensure uniqueness of the solution. This equation serves as a

building block of the LADA algorithm as will be shown in

the next section.

2.D. Locality alignment discriminant analysis(LADA)

A disadvantage of LDA is that Sw and Sb are built globally

based on the entire training set. The model would better cap-

ture the local structure of the training data if the whole feature

space is divided into local patches. LADA consists of the

patch-by-patch optimization and the global alignment steps,

which are described in detail below. A generalization of this

scheme to a number of dimensionality reduction algorithms

was presented by Ref. [35].

2.D.1. Patch-by-patch optimization

This step establishes a patch for each of the l data points

and its K � 1 nearest neighbours, thereby forming l patches

with K data points. For each data point xi, we denote its

K � 1 nearest neighbours by xi1 ; xi2 ; � � � ; xiK � 1. The K data

points within the patch associated with xi are represented as

columns in the D 9 K matrix Xi ¼ ½xi; xi1 ; xi2 ; � � � ; xiK�1�.

Using the results established in Eq. (6), the cost function to

be minimized in this patch-by-patch optimization is:

TrðYiLb;iYTi Þ

TrðYiLw;iYTi Þ

; (7)

where the definitions of Yi, Lb,i, Lw,i are described in detail

in Section 2.C, but now the application of the LDA algorithm

is limited to the patch represented by Xi. The number of

points in each patch K was required to be tuned as described

in Section 2.G.

2.D.2. Global alignment

This step optimizes the sum of the cost function [Eq.

(7)] associated with the l patches available. The solution

can be expressed in the similar format as Eq. (6), except

Medical Physics, 45 (10), October 2018

4610 Lin et al.: Prostate lesion delineation from mpMRI 4610

Page 5: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

that now the matrices Lb and Lw depend on the group-

ings of the l patches. Expressing the sum of the l cost

functions in the format of Eq. (6) would not only provide

a better comparison between LDA and LADA, but would

allow the same procedure used for maximizing the trace

ratio in Eq. (6) to be directly applied to optimize the cost

function associated with LADA. A major challenge is to

find a way to express Yi associated with each patch in

terms of the low-dimensional representation of the entire

set of data points, denoted by Y as described in Section 3.

Zhang et al.35 defined a l 9 K selection matrix for each

patch i, denoted by Si, in order to pick out the K data

points in Yi from Y:

Yi ¼ YSi; (8)

with the pq entry of Si defined by:

ðSiÞpq ¼1 if p ¼ Fifqg0 otherwise

�; (9)

where Fi ¼ fi; i1; i2; � � � ; iK�1g are the indices of the data

points within the patch Xi.

With these definitions established, Eq. (7) can be written

in terms of Y:

TrðYSiLb;iSTi Y

TrðYSiLw;iSTi Y

TÞ; (10)

Summation of Eq. (10) for all patches results in the

following cost function:

Pli¼1 TrðYSiLb;iS

Ti Y

TÞPl

i¼1 TrðYSiLw;iSTi Y

TÞ¼

Tr YPl

i¼1 SiLb;iSTi

� �YT

� �

Tr YPl

i¼1 SiLw;iSTi

� �YT

� �

¼Tr YfLbY

T� �

Tr YfLwYT

� �

;

(11)

where fLb ¼Pl

i¼1 SiLb;iSTi and fLw ¼

Pli¼1 SiLw;iS

Ti . The

optimal W* can be written in the same form as for LDA in

Eq. (6) and can be efficiently solved:36

W� ¼ arg maxWTW¼I

TrðWTfSbWÞ

TrðWTfSwWÞ; (12)

where fSb ¼ XfLbXT and fSw ¼ XfLwX

T .

2.E. Classification based on discriminant analyses

LDA and LADA were used to find projection matrices to

optimally project data points onto a reduced feature space

based on the training data. The training set will be described

in detail in Section 2.H. In the classification stage, data points

were projected onto the reduced feature space using the

projection matrices obtained in training. On the reduced

feature space, a data point was classified as either cancerous

or noncancerous based on the labels of its nearest neighbour

in the training set.

2.F. Postprocessing to optimize classificationaccuracy based on LADA

Prior information about lesion size and shape can be

applied to increase the specificity and sensitivity in lesion

localization. A lesion with a volume smaller than 0.2 cm3 is

not considered as clinically significant by Epstein’s criteria.37

For this reason, isolated pixels or a small cluster of pixels that

are not “large enough” can be removed to reduce false posi-

tives and thereby increase specificity. In the current study, we

developed an approach to extract isolated pixels identified as

cancerous by LADA. Figure 1 shows an example T2W axial

prostate image with cancerous pixels identified by LADA

shaded in red. For each point identified as cancerous with

coordinates denoted as pi, such as the pixel shown in the inset

of Fig. 1(a), a circular ROI centred at pi with radius r was

evaluated, and the point was classified as an isolated point if

the percentage of pixels inside this ROI was smaller than

Pisolated. The two parameters involved, r and Pisolated, were

optimized for classification accuracy as described in Sec-

tion 2.G. Figure 1(b) shows the results after the removal of all

isolated points.

Secondly, considering a lesion is likely to appear as a

solid mass, holes in the detected regions were filled as

shown in Fig. 1(c). Finally, the 3 9 3 neighbourhood of all

detected pixels were filled as an attempt to smoothen the

lesion boundary and connect the isolated pixels around the

boundary of the lesions. Note that the isolated clusters

remained at this stage had not been removed in the previ-

ous step because they were close to the main body of the

lesion; these lesions should be merged with the main body

(a) (b)

(c) (d)

FIG. 1. Illustration of steps involved in the postprocessing procedure. (a) It

shows the cancerous region identified by LADA. The inset at the left top cor-

ner illustrates the ROI with radius r considered when determining whether or

not a point is an “isolated points”. (b) It shows the results after isolated points

were removed. (c) It shows the results after filling holes inside the detected

ROI. (d) It shows the results after the 3 9 3 neighbourhood of all detected

pixels were filled. [Color figure can be viewed at wileyonlinelibrary.com]

Medical Physics, 45 (10), October 2018

4611 Lin et al.: Prostate lesion delineation from mpMRI 4611

Page 6: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

of the lesion to maintain the connectedness of the lesion.

The final result of the postprocessing procedure is shown

in Fig. 1(d).

2.G. Parameter tuning

The segmentation results generated by the proposed

LADA algorithm and subsequent postprocessing procedure

depend on the following parameters:

(1) K, the number of data points in each patch for LADA

projection matrix optimization as described in Sec-

tion 2.D.1.

(2) d, the number of dimensions in the reduced feature

space onto which LADA projects original data points.

(3) r, the radius of the circular ROI considered in the

removal of isolated points as described in Section 2.F.

(4) Pisolated, the minimum percentage of pixels identified as

cancerous by LADA inside a circular ROI for the center

of the ROI to be classified as cancerous as described in

Section 2.F.

One prostate in the dataset was chosen for parameter tun-

ing and this prostate was excluded in the subsequent valida-

tion. One transverse slice in this prostate was used to

optimize the LADA projection matrix and classification was

subsequently performed for the remaining image slices as

described in Section 2.E. The parameters described in the

above list were initialized empirically as K = 50, d = 2,

r = 0.3 mm and Pisolated = 0.3. These parameters were opti-

mized sequentially by changing a single parameter each time

while holding the remaining parameters constant. The param-

eter associated with the minimum sum of false-negative and

false-positive rates (FNR and FPR, respectively) was consid-

ered optimal. In the current study, K varied from 50 to 300

with an increment of 50, d from 2 to 10 with an increment of

2, r from 0.5 to 5 mm with a 0.5 mm increment, and Pisolated

from 0.3 to 0.7 with a 0.1 increment.

2.H. Experimental settings

Multiparametric MR images of 13 patients were involved

in this study. Histograms of mpMRI for the 13 patients were

standardized according to the algorithm described in Ref.

[38]. One prostate was randomly chosen for parameter tuning

described in Section 2.G. The optimized parameters were

used to localize lesions for the remaining 12 patients using

leave-one-out cross-validation. The number of training points

in each of the leave-one-out trial is more than 200,000, and

the computation and storage requirement for such a huge

training set are not supportable by most PCs. To address this

issue, training and evaluation for each prostate were per-

formed repeatedly for ten times. The training set in each of

the ten trials was randomly chosen that included 25% of

pixels located at lesions on each training image slice and pix-

els located at noncancerous regions that were twice the num-

ber of cancerous pixels. A pixel was deemed to be cancerous

if it was classified as so in more than or equal to five of ten

trials.

To evaluate the sensitivity of the choice of the prostate

used for parameter tuning, LADA and the subsequent post-

processing procedure were executed twice, with two different

prostates used for parameter tuning. The contribution of the

postprocessing techniques described in Section 2.F was quanti-

fied by comparing the sensitivity, specificity, and accuracy of

lesion segmentation before and after postprocessing. Although

DCE is an essential part in the prostate mpMRI protocol,20 its

inclusion leads to serious allergic reactions at a rate of 7/

5,000,000. The cost of DCE acquisition is high as patients were

required to be monitored for this reaction by a doctor through-

out the MRI scanning session. To evaluate how much DCE

contributes to the lesion delineation performance of the pro-

posed algorithm, sensitivity, specificity, and accuracy of lesion

delineation obtained with and without DCE features were com-

pared. In summary, lesion segmentation was performed in ten

settings, which we denote as LDA-woDCE, LDA-wDCE,

LADA-P1-woProc-woDCE, LADA-P2-woProc-woDCE,

LADA-P1-woProc-wDCE, LADA-P2-woProc-wDCE, LADA-

P1-wProc-woDCE, LADA-P2-wProc-woDCE, LADA-P1-

wProc-wDCE, and LADA-P2-wProc-wDCE. P1 and P2 refer

to the two prostates used for parameter tuning, wProc and

woProc refer to with and without postprocessing, respectively,

and wDCE and woDCE refer to with and without DCE fea-

tures, respectively.

The benefits of lesion-targeted prostate cancer therapies

are dependent on the lesion delineation performance in MRI,

which has been shown to underestimate prostate lesions sub-

stantially.39 To improve the efficacy of treatments, a treatment

margin was applied to fully cover a high percentage of lesions

(e.g., 95% in Refs. [40, 41]). Overcontouring could increase

the damage to surrounding organs at risk in focal boosting

therapies. In this study, we investigated how adding a margin

from 1 to 10 mm would improve the lesion detection sensitiv-

ity. The result can help determine a treatment margin required

to attain a sufficient, but not more than sufficient, coverage of

the lesion.

3. RESULTS

Parameters tuning for LADA was performed twice using

different prostates as described in Section 2.H. d = 4,

K = 200, r = 3 mm and Pisolated = 0.4 in the first trial and

d = 4, K = 250, r = 3.5 mm and Pisolated = 0.4 in the second

trial.

Table I lists the sensitivity, specificity, and accuracy

attained by the two LDA-based settings and the eight LADA-

based settings described in Section 2.H. For each of the

LADA settings, leave-one-out cross-validation was performed

on 12 prostates with the prostate involved in parameter tuning

excluded from validation. The average performance metrics

in delineating lesions in 12 prostates based on each of the

experimental settings were reported in the right panel of

Table I. As these LADA experiments were tuned either by P1

or P2, the validation subgroup varies with experiment

Medical Physics, 45 (10), October 2018

4612 Lin et al.: Prostate lesion delineation from mpMRI 4612

Page 7: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

settings. To make a fair comparison among settings, the per-

formance metrics were averaged over a common subset of

prostates that excluded both P1 and P2 and reported in the

left panel. Inclusion of DCE features increased the sensitivity

by 14–30% and applications of the postprocessing techniques

described in Section 2.F increased the sensitivity by 9–16%,

whereas the algorithm tuned by different prostates produced

sensitivities within a 3% range in four experimental setting

pairs, each of which corresponded to the same postprocessing

and DCE settings. However, the specificities were within a

� 10%-range for all settings and the distribution of accura-

cies was even tighter. These results were mainly attributable

to the fact that 92% of pixels were labeled noncancerous.

LDA-woDCE attained a higher specificity than all other set-

tings mainly because the number of pixels identified as

cancerous was small. In fact, if no pixels were identified as

cancerous, specificity would reach 100%, but sensitivity

would be 0%. Therefore, specificity should be interpreted

together will sensitivity when evaluating classification perfor-

mance.

The first, second, and third columns of Fig. 2 show exam-

ple cases for which the proposed algorithm generated good,

average, and lower than average sensitivity, respectively. The

first row shows the T2W images, the second row shows

the manually delineated regions with PI-RADS score ≥3, the

third row shows the region delineated in Setting LADA-P1-

wProc-wDCE, and the fourth row shows true-positive detec-

tion in red, false-negative region in green, and false-positive

regions in blue. The sensitivities for the good, average, and

lower than average cases are 95%, 77%, and 58%, respec-

tively. For these three cases, adding a 3-mm, 3-mm, and

7-mm margin, respectively, will achieve 100% coverage.

There are 91 two-dimensional cancerous regions in all

transverse prostate image slices involved in this study, of

which six regions from four lesions were missed by the pro-

posed algorithm. For this reason, 100% sensitivity was not

achieved even after adding margins. Figure 3 shows the mean

sensitivity (i.e., % coverage of lesions) attained in Setting

LADA-P1-wProc-wDCE for margin sizes from 0 to 10 mm.

The volumes of the four missed lesions were estimated by

first summing the manually delineated cross-sectional areas

across transverse slices and then multiplied by the interslice

distance (i.e., 3 mm). Judging from this volume estimation, a

lesion was smaller than 0.2 cm3 and was not considered as

clinically significant lesions according to the Epstein’s crite-

ria.37 The remaining three missed lesions were discussed

below.

Two of the missed lesion shared similar characteristics,

and one of which is illustrated in Fig. 4. This lesion spanned

four imaging slices and had an estimated volume of 0.75 cm3

based on the experts’ delineation. Because of the missed

detection in one slice, the volume estimated from the algo-

rithm delineation was 0.32 cm3. Although still considered

clinically significant according to the algorithm delineation,

the algorithm would have concluded that the risk associated

with the lesion was minimal (0.2 to 0.5 cm3) instead of mod-

erate (≥0.5 cm3). It is important to note that the margin

expansion in this study was done on a slice-by-slice basis; the

missing slice would have been covered if the expansion was

done in three-dimensional space. However, due to the large

interslice spacing in mpMRI (3 mm), the tumor regions

changed sharply along the inferosuperior direction. A 3D

margin was difficult to define without first having a reliable

estimation of the 3D tumor surface, which would require a

3D interpolation technique to achieve. The development and

validation of this technique would necessitate a new investi-

gation. For this reason, the margin expansion analysis was

performed on a slice-by-slice basis in this study. The second

and third rows in Fig. 4 show regions identified by observers’

delineation and the algorithm, respectively. The missed

region was located at the most superior slice (i.e., the first

column of Fig. 4) and the regions identified by the proposed

TABLE I. Sensitivity, specificity, and accuracy for LDA- and LADA-based classifiers. Experiments were performed in ten settings as described in Section 2.H.

P1 and P2 denote the two different prostates used for parameter tuning as described in Section 2.G. wDCE and woDCE denote settings in which DCE features

were and were not used, respectively. wProc and woProc denote settings in which the postprocessing steps described in Section 2.F were and were not applied,

respectively. The right panel shows the average metrics computed over all prostates involved in evaluation, whereas the left panel shows those computed over a

common set of 11 prostates with P1 and P2 excluded to allow fair comparison among settings.

Settings

Same set of 11 prostates excluding P1 and P2

Set of evaluation prostates with the prostate

used for parameter tuning excluded

Sensitivity Specificity Accuracy Sensitivity Specificity Accuracy

LDA-woDCE 0.21 � 0.07 0.86 � 0.03 0.73 � 0.05 0.21 � 0.07 0.86 � 0.03 0.74 � 0.05

LDA-wDCE 0.51 � 0.10 0.79 � 0.03 0.73 � 0.04 0.51 � 0.10 0.79 � 0.04 0.74 � 0.04

LADA-P1-woPro-woDCE 0.43 � 0.12 0.80 � 0.06 0.72 � 0.05 0.43 � 0.11 0.80 � 0.06 0.73 � 0.05

LADA-P2-woPro-woDCE 0.45 � 0.10 0.79 � 0.06 0.73 � 0.06 0.46 � 0.10 0.80 � 0.06 0.73 � 0.05

LADA-P1-woPro-wDCE 0.57 � 0.11 0.79 � 0.04 0.75 � 0.04 0.58 � 0.11 0.78 � 0.04 0.74 � 0.04

LADA-P2-woPro-wDCE 0.60 � 0.12 0.77 � 0.04 0.74 � 0.04 0.60 � 0.11 0.78 � 0.05 0.74 � 0.04

LADA-P1-wPro-woDCE 0.52 � 0.20 0.81 � 0.11 0.75 � 0.08 0.52 � 0.18 0.81 � 0.10 0.75 � 0.08

LADA-P2-wPro-woDCE 0.53 � 0.16 0.81 � 0.10 0.76 � 0.08 0.55 � 0.16 0.81 � 0.09 0.76 � 0.08

LADA-P1-wPro-wDCE 0.73 � 0.14 0.76 � 0.08 0.75 � 0.07 0.74 � 0.14 0.75 � 0.07 0.75 � 0.06

LADA-P2-wPro-wDCE 0.76 � 0.15 0.74 � 0.08 0.74 � 0.07 0.75 � 0.14 0.75 � 0.08 0.75 � 0.07

Medical Physics, 45 (10), October 2018

4613 Lin et al.: Prostate lesion delineation from mpMRI 4613

Page 8: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

algorithm matched the surrogate ground truth in the remain-

ing three consecutive slices shown in Fig. 4. Figure 5 shows

the T2W, ADC, and DCE images acquired at the imaging

plane in which the lesion was missed by the algorithm. The

missed lesion was delineated by only one of four observers

and only on the T2W image. This ROI was considered as an

identified lesion in the surrogate ground truth because an

ROI delineated by any observer in any modality with PI-

RADS score ≥3 was considered an identified lesion, and the

lesion in question was scored 4 by the observer who delin-

eated it on the T2W image. In other words, the proposed

algorithm agreed with 3 of the 4 observers or 11 of 12 delin-

eations (4 observers/modality 9 3 modalities; the observer

delineated the missed lesion only in T2W, but not ADC and

DCE) in that the missed ROI is not a part of the identified

lesion. In essence, the fourth observer disagreed on the extent

of the detected lesion along the inferosuperior direction but

only on the T2W image. Figure 5(b) shows the T2W image

with the area identified by the single observer imposed. The

DCE image displayed in Fig. 5(d) is the one that shows the

FIG. 2. The first, second, and third columns show three example cases for which the proposed algorithm generated good (95%), average (80%), and lower than

average (58%) sensitivity, respectively. The first row shows the T2W images, the second row shows the manually delineated regions with PI-RADS score ≥3, the

third row shows the region delineated by the LADA-based classifier, and the fourth row shows true-positive detection in red, false-negative region in green, and

false-positive regions in blue.

FIG. 3. Lesion detection sensitivity vs margin widths. [Color figure can be

viewed at wileyonlinelibrary.com]

Medical Physics, 45 (10), October 2018

4614 Lin et al.: Prostate lesion delineation from mpMRI 4614

Page 9: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

maximum enhancement in the missed region. All the above

observations applied to the second missed lesion. Similar to

the first case, an observer disagreed on the inferosuperior

extension of the lesion and the disagreement occurred only

on his observation of the T2W image.

Another missed lesion spanned three imaging slices as

shown in Fig. 6 and the algorithm missed the region on

the middle slice, which would have been covered with a

three-dimensional margin expansion. Figure 7 shows the

three image sequences on this slice. The volume esti-

mated from experts’ and algorithm delineation were 0.5

and 0.21 cm3, respectively. The missed lesion was delin-

eated by only one of four observers, but on all three

image sequences.

The proposed algorithm was implemented in Matlab

2017a and took approximately 1560 s for computing the pro-

jection matrix based on the training set consisting of 14,000–

16,000 data points with K = 200, 1.2 s for applying the pro-

jection matrix on all data points belonging to the testing set

and finding the nearest labelled neighbours, and 1 s for com-

pleting the postprocessing steps described in Section 2.F. The

time required for computing the LADA projection matrix was

highly dependent on K, the size of the local patch as

described in Section 2.G. This computational time increases

from 82 to 4367 s when K increases from K = 50 to 300.

All experiments were performed in an Intel(R) Xeon(R)

E5-2650 v4 CPU @ 2.2 GHz with 8 GB memory.

4. DISCUSSION

While the use of mpMRI was demonstrated to increase the

accuracy of tumor identification,13,15,42,43 the widespread

acceptance of this imaging technique has been hampered by

the lack of standardization on the acquisition and the interpre-

tation of the images.19 To address this issue, the ESUR and

ACR established consensus guidelines for the imaging proto-

cols and proposed a scoring system, PI-RADS, as an effort to

standardize the interpretation and reporting of mpMRI

results20 with a PI-RADS score of ≥3 in each image contrast

commonly considered to be the optimal cutoff for cancerous

tumors.44 However, previous studies based on this standard

were all performed by manual assignment of PI-RADS

score,22,44 which is time-consuming and prone to interob-

server variability.22 For this reason, there is a compelling

need for an automated tool for delineating prostate lesions

from images obtained according to the consensus clinical

protocol. The delineation sensitivity, specificity, and accu-

racy achieved by the proposed algorithm were 75%, 75%, and

75%, respectively. This performance is comparable to that

produced by previous mpMRI lesion delineation studies in

FIG. 4. This figure shows an example lesion with an estimated size of 0.75 cm3 spanning four consecutive image slices. The first row shows consecutive T2W

transverse images. The second and the third rows show the same images but with lesions detected by the expert observers and the algorithm superimposed. The

algorithm missed the lesion located at the image slice shown in the first column (pointed to by an arrow in the second row). More details related to the observers’

delineation of this image slice are provided in Fig. 5. [Color figure can be viewed at wileyonlinelibrary.com]

Medical Physics, 45 (10), October 2018

4615 Lin et al.: Prostate lesion delineation from mpMRI 4615

Page 10: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

which nonclinical T2 maps were available, which have sensi-

tivities ranging from 64% to 87% and specificities from 78%

to 90%.25–27,45

One of the manifestations of the curse of dimensionality

in machine learning is that data points can become uniformly

distributed when the number of dimensions increases. The

Euclidean distance from a point’s closest neighbour

approaches that from its furthest data point with a dimension

of 15 according to Ref. [30]. For this reason, the dimensional-

ity of the feature space was required to be reduced before the

application of the nearest neighbour classifiers. Inspired by

the patch alignment concept,35 LADAwas developed to max-

imize the ratio between the traces of the sum of the scatter

matrices computed for all local patches in the feature set.31

As the between- and within-class scatter matrices computed

in each patch did not consider data points far away from this

neighbourhood, LADA is expected to better adapt to the local

structure of the data. The algorithm was applied to character-

ize the difference between the English writing styles exhib-

ited in different geographical regions.31 However, since cross-

validation was not performed in the writing style study, it was

not clear whether LADA truly provides a better classification

of different regional English styles than LDA or whether it

was overtrained on the available data. The current study is the

first study demonstrating that the nearest neighbour classifier

provides higher classification performance on the reduced

space generated by LADA than that generated by LDA.

(a) (b)

(c) (d)

FIG. 5. The (a) T2W, (c) ADC, and (d) DCE images acquired at the

imaging plane in which the lesion shown in the first column of Fig. 4

was missed by the algorithm. Although the missed lesion [pointed to by

an arrow in (b)] was delineated by only one of four observers and only

on the T2W image as shown in (b), it was deemed cancerous since

regions marked by any of the observers were considered to be a lesion

according to the rule by which surrogate ground truth classification was

generated (Section 2.A). In other words, the proposed algorithm agreed

with 3 of the 4 observers or 11 of 12 delineations (4 observers/modal-

ity 93 modalities) in that the missed ROI was not a part of the identified

lesion. [Color figure can be viewed at wileyonlinelibrary.com]

FIG. 6. This figure shows a lesion with an estimated size of 0.50 cm3 spanning three consecutive image slices. The first row shows consecutive T2W transverse

images. The second and the third rows show the same images but with lesions detected by the expert observers and algorithm superimposed. The algorithm

missed the lesion located at the image slice shown in the second column (pointed to by an arrow in the second row). More details related to the observers’ delin-

eation of this image slice are provided in Fig. 7. [Color figure can be viewed at wileyonlinelibrary.com]

Medical Physics, 45 (10), October 2018

4616 Lin et al.: Prostate lesion delineation from mpMRI 4616

Page 11: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

Our study had a number of limitations. The first limitation

is related to the small sample sizes involved in this investiga-

tion in which we pilot this approach. As this study involved

four observers who segmented lesions and assigned PI-

RADS scores on each of the three MR images, evaluation of

13 prostates already took a considerable amount of time.

While we acknowledge that the intersubject variability may

not be sufficiently represented by the study population, it is

appropriate to evaluate the proposed algorithm in a pilot

study before an assessment is performed in a larger popula-

tion. In fact, previous lesion delineation algorithms were eval-

uated in patient populations of similar sample sizes.25,26

Another limitation of the study is that the evaluation was

performed only in the peripheral zone of the prostate.46,47

The evaluation was designed as such because a vast majority

(75%) of cancerous tumors develop in the peripheral

zone.46,47 In addition, it was a priority to evaluate the algo-

rithm on peripheral zone tumors in this pilot study as these

tumors are associated with a larger odds of pathologic

adverse outcomes, such as extracapsular extension, seminal

vesicle invasion, and lymphovascular invasion.48 Although

we expect that the proposed algorithm would also be able to

delineate lesions at the transition zone, lesion delineation

should be done separately in the peripheral and transition

zones as the mpMRI features associated with lesions at the

two zones would likely to be different. The capability of the

algorithm in delineating lesions in the transition zone is

required to be thoroughly validated in a future study.

Similar to previously described binary classifiers devel-

oped for lesion delineation from mpMRI,25,26 the proposed

algorithm is capable of localizing and providing size estima-

tions for cancer foci, but do not predict the PI-RADS score

that indicates the likelihood that these foci are clinically sig-

nificant. We are currently developing a regression model that

will predict the PI-RADS score distribution over the entire

prostate. The availability of the objectively predicted PI-

RADS score distribution will further optimize diagnosis

accuracy.

5. CONCLUSION

A classification framework was developed to localize and

delineate prostate lesions from mpMR images obtained in

standard clinical protocol specified in the consensus guide-

line.20 The delineation sensitivity, specificity, and accuracy

are 75%, 75%, and 75%, respectively, which are comparable

to those generated by previous mpMRI lesion delineation

algorithm in which nonclinical T2 maps were available. The

construction of T2 map requires the image acquisitions in ten

echo times, leading to long acquisition times that could not

be afforded in clinical practice. The ability to delineate

lesions based on standard clinical protocol efficiently

afforded by the proposed framework will potentially con-

tribute to the acceleration of the adoption of mpMRI in clini-

cal practice.

ACKNOWLEDGMENTS

Dr. Chiu is grateful for funding support from the Basic

Research Free Exploration Program of the Science Technol-

ogy and Innovation Committee of Shenzhen Municipality,

China (Project No. JCYJ20160428155118212), the Research

Grant Council of the HKSAR, China (Project No. CityU

11205917), and the City University of Hong Kong Strategic

Research Grants (Nos. 7004425 and 7004617).

CONFLICT OF INTEREST

None declared.

a)Author to whom correspondence should be addressed. Electronic mail:

[email protected].

REFERENCES

1. Brawley OW. Trends in prostate cancer in the United States. J Natl Can-

cer Inst Monogr. 2012;2012:152–156.

2. Fradet Y, Klotz L, Trachtenberg J, Zlotta A. The burden of prostate can-

cer in Canada. Can Urol Assoc J. 2009;3:S92–S100.

3. Centre for Health Protection, Department of Health, The Government of

Hong Kong. Prostate Cancer. http://www.chp.gov.hk/en/content/9/25/

5781.html. Accessed June 7, 2018.

4. Yu Y, Chen Y, Chiu B. Fully automatic prostate segmentation from tran-

srectal ultrasound images based on radial bas-relief initialization and

slice-based propagation. Comput Biol Med. 2016;74:74–90.

5. Singh RP, Gupta S, Acharya UR. Segmentation of prostate contours for

automated diagnosis using ultrasound images: a survey. J Comput Sci.

2017;21:223–231.

6. Hodge KK, McNeal JE, Terris MK, Stamey TA. Random systematic

versus directed ultrasound guided transrectal core biopsies of the pros-

tate. J Urol. 1989;142:71–74; discussion 74–75.

(a) (b)

(c) (d)

FIG. 7. The (a) T2W, (c) ADC and (d) DCE images acquired at the imaging

plane in which the lesion shown in the second column of Fig. 6 was missed

by the algorithm. The missed lesion [pointed to by an arrow in (b)] was delin-

eated by only one of four observers but on all three sequences. In other

words, the proposed algorithm agreed with 3 of the 4 observers or 9 of 12

delineations (4 observers/modality 9 3 modalities) in that the missed ROI

was not a part of the identified lesion. [Color figure can be viewed at wileyon

linelibrary.com]

Medical Physics, 45 (10), October 2018

4617 Lin et al.: Prostate lesion delineation from mpMRI 4617

Page 12: Prostate lesion delineation from multiparametric magnetic ...cychiu/Papers/LinChiuMedPhys2018.pdf · weighted (DW), and dynamic contrast-enhanced (DCE) imaging. The goal of this study

7. Durkan GC, Greene DR. Elevated serum prostate specific antigen levels

in conjunction with an initial prostatic biopsy negative for carcinoma:

who should undergo a repeat biopsy?. BJU Int. 1999;83:34–38.

8. Steyn J, Smith F. Nuclear magnetic resonance imaging of the prostate.

BJU Int. 1982;54:726–728.

9. Haider MA, Van Der Kwast TH, Tanguay J, et al. Combined T2-

weighted and diffusion-weighted MRI for localization of prostate can-

cer. Am J Roentgenol. 2007;189:323–328.

10. Turkbey B, Pinto PA, Mani H, et al. Prostate cancer: value of multipara-

metric MR imaging at 3 T for detection – histopathologic correlation.

Radiology. 2010;255:89–99.

11. Hambrock T, Somford DM, Huisman HJ, et al. Relationship between

apparent diffusion coefficients at 3.0-T MR imaging and Gleason grade

in peripheral zone prostate cancer. Radiology. 2011;259:453–461.

12. Delongchamps NB, Rouanne M, Flam T, et al. Multiparametric mag-

netic resonance imaging for the detection and localization of prostate

cancer: combination of T2-weighted, dynamic contrast-enhanced and

diffusion-weighted imaging. BJU Int. 2011;107:1411–1418.

13. Futterer JJ, Heijmink SW, Scheenen TW, et al. Prostate cancer localiza-

tion with dynamic contrast-enhanced MR imaging and proton MR spec-

troscopic imaging. Radiology. 2006;241:449–458.

14. Tanimoto A, Nakashima J, Kohno H, Shinmoto H, Kuribayashi S. Pros-

tate cancer screening: The clinical value of diffusion-weighted imaging

and dynamic MR imaging in combination with T2-weighted imaging. J

Mag Reson Imaging. 2007;25:146–152.

15. Lim HK, Kim JK, Kim KA, Cho KS. Prostate cancer: apparent diffusion

coefficient map with T2-weighted images for detection: a multireader

study. Radiology. 2009;250:145–151.

16. Girouin N, M�ege-Lechevallier F, Senes AT, et al. Prostate dynamic con-

trast-enhanced MRI with simple visual diagnostic criteria: is it reason-

able?. Eur Radiol. 2007;17:1498–1509.

17. Kitajima K, Kaji Y, Fukabori Y, Yoshida K-I, Suganuma N, Sugimura

K.$dummy$Prostate cancer detection with 3T MRI: comparison of diffu-

sion-weighted imaging and dynamic contrast-enhanced MRI in combina-

tion with T2-weighted imaging. J Magn Reson Imaging. 2010;31:625–

631.

18. Hricak H, White S, Vigneron D, et al. Carcinoma of the prostate gland:

MR imaging with pelvic phased-array coils versus integrated endorec-

tal–pelvic phased-array coils. Radiology. 1994;193:703–709.

19. Cornfeld D, Sprenkle P. Multiparametric MRI: standardizations needed.

Oncology. 2013;27:277–280.

20. Barentsz JO, Richenberg J, Clements R, et al. ESUR prostate MR

guidelines 2012. Eur Radiol. 2012;22:746–757.

21. Weinreb JC, Barentsz JO, Choyke PL, et al. PI-RADS prostate imaging

– reporting and data system: 2015, version 2. Europ Urol. 2016;69:16–

40.

22. Schimm€oller L, Quentin M, Arsov C, et al. Inter-reader agreement of

the ESUR score for prostate MRI using in-bore MRI-guided biopsies as

the reference standard. Eur Radiol. 2013;23:3185–3190.

23. Vache T, Bratan F, Mege-Lechevallier F, Roche S, Rabilloud M, Rou-

viere O. Characterization of prostate lesions as benign or malignant at

multiparametric MR imaging: comparison of three scoring systems in

patients treated with radical prostatectomy. Radiology. 2014;272:446–

455.

24. Renard-Penna R, Mozer P, Cornud F, et al. Prostate imaging reporting

and data system and Likert scoring system: multiparametric MR imag-

ing validation study to screen patients for initial biopsy. Radiology.

2015;275:458–468.

25. Artan Y, Haider MA, Langer DL, et al. Prostate cancer localization with

multispectral MRI using cost-sensitive support vector machines and

conditional random fields. IEEE Trans Image Process. 2010;19:2444–

2455.

26. Artan Y, Yetik IS. Prostate cancer localization using multiparametric

MRI based on semisupervised techniques with automated seed initial-

ization. IEEE Trans Inf Technol Biomed. 2012;16:1313–1323.

27. Liu X, Langer DL, Haider MA, Yang Y, Wernick MN, Yetik IS. Pros-

tate cancer segmentation with simultaneous estimation of Markov ran-

dom field parameters and class. IEEE Trans Med Imaging.

2009;28:906–915.

28. Ozer S, Langer DL, Liu X, et al. Supervised and unsupervised methods

for prostate cancer segmentation with multispectral MRI. Med Phys.

2010;37:1873–1883.

29. Chan I, Wells W, Mulkern RV, et al. Detection of prostate cancer by

integration of line-scan diffusion, T2-mapping and T2-weighted mag-

netic resonance imaging; a multichannel statistical classifier. Med Phys.

2003;30:2390–2398.

30. Beyer K, Goldstein J, Ramakrishnan R, Shaft U. When is “nearest

neighbor” meaningful?. In: Database Theory–ICDT’99. Vol. 1540. Ber-

lin: Springer; 1999:217–235.

31. Tang P, Zhao M, Chow TW. Locality alignment discriminant analysis for

visualizing regional English. Neural Process Lett. 2016;43:295–307.

32. Lin M, Chen W, Zhao M, et al. Prostate lesion detection and localization

based on locality alignment discriminant analysis. SPIE Medical Imag-

ing 101344A–101344A, International Society for Optics and Photonics;

2017.

33. Gibson E, Gaed M, Hrinivich T, et al. Multiparametric MR imaging of

prostate cancer foci: assessing the detectability and localizability of

Gleason 7 peripheral zone cancers based on image contrasts. SPIE Med-

ical Imaging 90410N; 2014.

34. Wang H, Yan S, Xu D, Tang X, Huang T. Trace ratio vs. ratio trace for

dimensionality reduction. 2007 IEEE Conference on Computer Vision

and Pattern Recognition; 2007:1–8.

35. Zhang T, Tao D, Li X, Yang J. Patch alignment for dimensionality

reduction. IEEE Trans Knowl Data Eng. 2009;21:1299–1313.

36. Zhao M, Zhang Z, Chow TW. Trace ratio criterion based generalized

discriminative learning for semi-supervised dimensionality reduction.

Pattern Recogn. 2012;45:1482–1499.

37. Epstein JI, Walsh PC, Carmichael M, Brendler CB. Pathologic and clini-

cal findings to predict tumor extent of nonpalpable (stage T1c) prostate

cancer. JAMA. 1994;271:368–374.

38. Nyul LG, Udupa JK. On standardizing the MR image intensity scale.

Magn Reson Med. 1999;42:1072–1081.

39. Le Nobin J, Orczyk C, Deng F-M, et al. Prostate tumour volumes: eval-

uation of the agreement between magnetic resonance imaging and his-

tology using novel co-registration software. BJU Int. 2014;114:E105–

E112.

40. Le Nobin J, Rosenkrantz AB, Villers A, et al. Image guided focal ther-

apy for magnetic resonance imaging visible prostate cancer: defining a

3-dimensional treatment margin based on magnetic resonance imaging

histology co-registration analysis. J Urol. 2015;194:364–370.

41. Gibson E, Bauman GS, Romagnoli C, et al. Toward prostate cancer con-

touring guidelines on magnetic resonance imaging: dominant lesion

gross and clinical target volume coverage via accurate histology fusion.

Int J Radiat Oncol. 2016;96:188–196.

42. Ogura K, Maekawa S, Okubo K, et al. Dynamic endorectal magnetic

resonance imaging for local staging and detection of neurovascular bun-

dle involvement of prostate cancer: correlation with histopathologic

results. Urology. 2001;57:721–726.

43. Kim CK, Park BK, Kim B. Localization of prostate cancer using 3T

MRi: comparison of T2-weighted and dynamic contrast-enhanced imag-

ing. J Comput Assist Tomogr. 2006;30:7–11.

44. Roethke M, Kuru T, Schultze S, et al. Evaluation of the ESUR PI-RADS

scoring system for multiparametric MRi of the prostate with targeted

MR/TRUS fusion-guided biopsy at 3.0 Tesla. Eur Radiol. 2014;24:344–

352.

45. Ocak I, Bernardo M, Metzger G, et al. Dynamic contrast-enhanced MRI

of prostate cancer at 3T: a study of pharmacokinetic parameters. Am J

Roentgenol. 2007;189:W192–W201.

46. McNeal JE, Redwine EA, Freiha FS, Stamey TA. Zonal distribution of

prostatic adenocarcinoma: correlation with histologic pattern and direc-

tion of spread. Am J Surg Pathol. 1988;12:897–906.

47. Greene DR, Wheeler TM, Egawa S, Dunn JK, Scardino PT. A com-

parison of the morphological features of cancer arising in the transi-

tion zone and in the peripheral zone of the prostate. J Urol. 1991;

146:1069–1076.

48. Lee JJ, Thomas I-C, Nolley R, Ferrari M, Brooks JD, Leppert JT, et al.

Biologic differences between peripheral and transition zone prostate

cancer. Prostate. 2015;75:183–190.

Medical Physics, 45 (10), October 2018

4618 Lin et al.: Prostate lesion delineation from mpMRI 4618