ilya molchanov theory of random sets - startseite · † set-valued analysis and multifunctions,...

30
Probability Theory and Stochastic Modelling 87 Ilya Molchanov Theory of Random Sets Second Edition

Upload: others

Post on 28-Jun-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Probability Theory and Stochastic Modelling 87

Ilya Molchanov

Theory of Random SetsSecond Edition

Page 2: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Probability Theory and Stochastic Modelling

Volume 87

Editors-in-chief

Peter W. Glynn, Stanford, CA, USAAndreas E. Kyprianou, Bath, UKYves Le Jan, Orsay, France

Advisory Board

Søren Asmussen, Aarhus, DenmarkMartin Hairer, Coventry, UKPeter Jagers, Gothenburg, SwedenIoannis Karatzas, New York, NY, USAFrank P. Kelly, Cambridge, UKBernt Øksendal, Oslo, NorwayGeorge Papanicolaou, Stanford, CA, USAEtienne Pardoux, Marseille, FranceEdwin Perkins, Vancouver, CanadaHalil Mete Soner, Zürich, Switzerland

Page 3: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

The Probability Theory and Stochastic Modelling series is a merger and contin-uation of Springer’s two well established series Stochastic Modelling and AppliedProbability and Probability and Its Applications series. It publishes research mono-graphs that make a significant contribution to probability theory or an applicationsdomain in which advanced probability methods are fundamental. Books in thisseries are expected to follow rigorous mathematical standards, while also displayingthe expository quality necessary to make them useful and accessible to advancedstudents as well as researchers. The series covers all aspects of modern probabilitytheory including

• Gaussian processes• Markov processes• Random fields, point processes and random sets• Random matrices• Statistical mechanics and random media• Stochastic analysis

as well as applications that include (but are not restricted to):

• Branching processes and other models of population growth• Communications and processing networks• Computational methods in probability and stochastic processes, including simu-

lation• Genetics and other stochastic models in biology and the life sciences• Information theory, signal processing, and image synthesis• Mathematical economics and finance• Statistical methods (e.g. empirical processes, MCMC)• Statistics for stochastic processes• Stochastic control• Stochastic models in operations research and stochastic optimization• Stochastic models in the physical sciences

More information about this series at http://www.springer.com/series/13205

Page 4: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Ilya Molchanov

Theory of Random Sets

Second Edition

123

Page 5: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Ilya MolchanovInstitute of Mathematical Statistics

and Actuarial ScienceUniversity of BernBern, Switzerland

ISSN 2199-3130 ISSN 2199-3149 (electronic)Probability Theory and Stochastic ModellingISBN 978-1-4471-7347-2 ISBN 978-1-4471-7349-6 (eBook)DOI 10.1007/978-1-4471-7349-6

Library of Congress Control Number: 2017949364

Mathematics Subject Classification (2010): Primary: 60D05; Secondary: 26E25, 28B20, 52A22, 49J53,54C65, 60B05, 60E07, 60F15, 60G55, 60G57, 62M30

Originally published in the series: Probability and Its Applications

© Springer-Verlag London Ltd. 2005, 2017This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part ofthe material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation,broadcasting, reproduction on microfilms or in any other physical way, and transmission or informationstorage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodologynow known or hereafter developed.The use of general descriptive names, registered names, trademarks, service marks, etc. in this publicationdoes not imply, even in the absence of a specific statement, that such names are exempt from the relevantprotective laws and regulations and therefore free for general use.The publisher, the authors and the editors are safe to assume that the advice and information in this bookare believed to be true and accurate at the date of publication. Neither the publisher nor the authors orthe editors give a warranty, express or implied, with respect to the material contained herein or for anyerrors or omissions that may have been made. The publisher remains neutral with regard to jurisdictionalclaims in published maps and institutional affiliations.

Printed on acid-free paper

This Springer imprint is published by Springer NatureThe registered company is Springer-Verlag London Ltd.The registered company address is: 236 Gray’s Inn Road, London WC1X 8HB, United Kingdom

Page 6: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

To my mother

Page 7: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Preface

Some History

The study of random geometrical objects goes back to the famous Buffon needleproblem. Similar to the ideas of Geometric Probability, which can be traced backto the very origins of probability, the concept of a random set was mentioned forthe first time together with the mathematical foundations of Probability Theory.A.N. Kolmogorov [493, p. 46] wrote in 1933 (translated from German):

Let G be a measurable region of the plane whose shape depends on chance; in other words,let us assign to every elementary event � of a field of probability a definite measurable planeregion G. We shall denote by J the area of the region G and by P.x; y/ the probability thatthe point .x; y/ belongs to the region G. Then

E.J/ D“

P.x; y/ dx dy :

One might observe that this is a formulation of Robbins’ theorem and P.x; y/ is thecoverage function of the random set G.

Further progress in the theory of random sets relied on developments in thefollowing areas:

• studies of random elements in general topological spaces, in groups and semi-groups, see, e.g., Grenander [326];

• the general theory of stochastic processes, see Dellacherie [220], and the theoryof capacities, see Choquet [172];

• set-valued analysis and multifunctions, see Castaing and Valadier [158];• advances in image analysis and microscopy that required a satisfactory

mathematical theory of distributions for binary images (or random sets), seeSerra [790].

The mathematical theory of random sets can be traced back to Matheron [581]and Kendall [454]. The principal new feature is that random sets may have differentshapes and the development of this idea is crucial in the study of random sets.

vii

Page 8: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

viii Preface

G. Matheron formulated the very definition of a random closed set and developedthe relevant probabilistic and geometric techniques. D.G. Kendall’s seminal paper[454] on random sets already contained the first steps into many further directionssuch as lattices, weak convergence, spectral representation, infinite divisibility. Mostof these aspects were elaborated later on in connection with relevant ideas in puremathematics and classical probability theory. This has made many of the conceptsand the notation used in [454] obsolete, so we will follow instead the modernterminology that fits better into the system developed by G. Matheron; most of hisnotation was taken as the basis for this monograph.

The relationship between random sets and convex geometry later on has beenthoroughly explored within the stochastic geometry literature, mostly in the sta-tionary setting, see, e.g., Schneider and Weil [780]. Within stochastic geometry,random sets represent one type of object along with point processes and randomtessellations, see Chiu, Stoyan, Kendall and Mecke [169]. The mathematicalmorphology part of G. Matheron’s book gave rise to numerous applications in imageprocessing (Dougherty [239] and Serra [790]) and abstract studies of operationswith sets, often in the framework of lattice theory (Heijmans [355]).

Since 1975, when G. Matheron’s book [581] was published, the theory of randomsets has enjoyed substantial developments concerning

• relationships to the theories of semigroups and continuous lattices;• properties of capacities;• limit theorems for Minkowski sums based upon techniques from probabilities in

Banach spaces;• limit theorems for unions of random sets in relation to the theory of extreme

values;• stochastic optimisation ideas in relation to random sets that appear as epigraphs

of random functions;• properties of level sets and excursions of stochastic processes.

These developments constitute the core of this book, which aims to cast thetheory of random sets into the conventional probabilistic framework that involvesdistributional properties, limit theorems and related analytical tools.

Central Topics of the Book

This book concentrates on several basic concepts in the theory of random sets.The first is the capacity functional that determines the distribution of a randomclosed set in a locally compact Hausdorff separable space. Unlike probabilitymeasures, the capacity functional is non-additive. The studies of non-additive setfunctions are abundant, especially, in view of game theory applications to describethe gain attained by a coalition of players, in statistics as belief functions in orderto model situations where the underlying probability measure is uncertain, and inmathematical finance, where non-additive set functions are essential to assess risk.

Page 9: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Preface ix

The capacity functional can be used to characterise the weak convergence ofrandom sets and some properties of their distributions. In particular, this concernsunions of random closed sets, where the regular variation property of the capacityfunctional is of primary importance. However, the capacity functional does not helpto deal with a number of other issues, for instance to define the expectation of arandom closed set.

Here the leading role is taken over by the concept of a selection, which is a(single-valued) random element that almost surely belongs to a random set. In thisframework, it is convenient to view a random closed set as a multifunction (or set-valued function) on a probability space and use the well-developed machinery ofset-valued analysis, see, e.g., Hu and Papageorgiou [402]. By taking expectations ofintegrable selections, one defines the selection expectation of a random closed set.The selection expectation of a random set defined on a non-atomic probability spaceis always convex and can be alternatively defined as the convex set whose supportfunction equals the expected support function of a random set. The Minkowski sumof random sets is introduced as the set of sums of all their points (or all theirselections) and can be equivalently defined using the arithmetic sum of the supportfunctions. Therefore, limit theorems for Minkowski sums of random sets can bederived from the existing results for random elements in functional spaces. Thesetools make it possible to explore set-valued martingales.

Important examples of random closed sets appear as epigraphs of random lowersemicontinuous functions. Viewing the epigraphs as random closed sets makes itpossible to obtain results for lower semicontinuous functions under the weakestpossible conditions. In particular, this concerns the convergence of minimum valuesand minimisers, which is a subject of stochastic optimisation theory.

It is possible to consider the family of closed sets as both a semigroup and alattice. Therefore, the results on lattice- or semigroup-valued random elements arevery useful in the theory of random sets.

Plan

Since the concept of a set is central for mathematics, the book is highly inter-disciplinary and relies on tools from a number of mathematical theories andconcepts: capacities, convex geometry, set-valued analysis, topology, harmonicanalysis on semigroups, continuous lattices, non-additive measures and upper/lowerprobabilities, limit theorems in Banach spaces, the general theory of stochasticprocesses, extreme values, stochastic optimisation, point processes and randommeasures.

The book starts with the definition of a random closed set. The space E whichrandom sets belong to is very often assumed to be locally compact Hausdorff witha countable base. The Euclidean space Rd is a generic example. Often we switchto the more general case of E being a Polish space or Banach space (if a linearstructure is essential). It is convenient to work with random closed sets, which is the

Page 10: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

x Preface

typical setting in this book, although in some places we mention random open setsand random Borel sets. Choquet’s theorem concerning the existence of random setdistributions is proved and relationships with set-valued analysis (or multifunctions)and lattices are explained. The rest of Chap. 1 relies on the concept of the capacityfunctional. It highlights relationships between capacity functionals and properties ofrandom sets, develops some analytic theory, convergence concepts, applications topoint processes and random capacities and finally surveys various interpretations forcapacities that stem from game theory, imprecise probabilities and robust statistics.Special attention is devoted to the case of random convex compact sets (or convexbodies if the carrier space is Euclidean).

Chapter 2 concerns expectation concepts for random closed sets. The main part isdevoted to the selection (or Aumann) expectation based on the idea of an integrableselection. Chapter 3 continues this topic by dealing with Minkowski sums of randomsets. The dual representation of the selection expectation—as the set of expectationsof all selections and as the expectation of the support function—makes it possible torefer to limit theorems in Banach spaces in order to derive the corresponding resultsfor random closed sets.

The study of unions for random sets is closely related to extremes of randomvariables and further generalisations for pointwise extremes of stochastic processes.Chapter 4 describes the main results for the unions of random sets and explains thebackground ideas that are related to the studies of lattice-valued random elementsand regular variation on abstract spaces.

Chapter 5 is devoted to links between random sets and stochastic processes.This concerns set-valued processes that develop in time, in particular, set-valuedmartingales. Furthermore, this relates to random sets interpretations of conventionalstochastic processes, where random sets appear as graphs, level sets or epigraphs(hypographs). Several areas related to random sets and stochastic processes are onlymentioned in brief, for instance, the theory of set-indexed processes, where randomsets appear as stopping times (or stopping sets), excursions of random fields, andpotential theory for Markov processes that provides further examples of capacitiesrelated to hitting times and paths of stochastic processes.

The Appendices summarise the necessary mathematical background; it stemsfrom various parts of mathematics and is normally scattered between various texts.

Second Edition

The period between the first and second editions witnessed the appearance of severalbooks on stochastic geometry and random sets authored by Nguyen [651], Schneiderand Weil [780], Chiu, Stoyan, Kendall and Mecke [169], on random measures byKallenberg [444], Poisson point processes by Last and Penrose [526], and on non-additive measures by Grabisch [321] and Cuzzolin [196].

Page 11: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Preface xi

The second edition of this book includes new material in the following direc-tions:

• unbounded and possibly non-closed random sets motivated by applications inmathematical finance in order to describe set-valued portfolios;

• selections of random sets, motivated by the use of random sets to describepartially identified models in econometrics;

• random closed (compact) sets in Polish spaces;• regular variation and stability of random elements in abstract spaces;• sublinear and superlinear expectations of random sets, motivated by applications

to risk assessment;• results on transformations of capacities and rearrangement invariant random

closed sets;• relationships between random sets and multivariate probability theory, mostly

using the concept of zonoids, connections to stable laws and multivariateextremes, series representations of stable laws;

• for Minkowski sums, a new Marcinkiewicz–Zygmund strong law of largenumbers is proved, and results on large deviations for sums of heavy-tailedrandom sets are mentioned;

• continuous time set-valued processed are discussed in depth, including theseparability concept, graphical convergence, and uniform laws of large numbers.

In the second edition, the locally compact and infinite-dimensional settingsare more clearly identified, and it has been made clearer which results hold forunbounded random closed sets and for non-closed random sets. The measure-theoretic proof of Choquet’s theorem has been corrected and a new proof followingthe idea of relative compactness has been added. The characterisation of selectionsis now presented with a full proof. The presentation of the union scheme hasbeen restructured by the systematic use of regular variation in abstract spaces,and both the union- and sum-stability concepts are brought in relation to seriesrepresentations. The presentation of the selection expectation is accompanied bythe discussion and the proof of the Aumann identity; full proofs of the properties ofconditional expectations are now included, and the generalised selection expectationis introduced. Results on extremal processes are brought in relation to the recentwork on capacities; a new streamlined proof for the properties of continuous choiceprocesses is now presented.

The second edition gave a chance to correct numerous misprints, occasionalmistakes and misinterpretations. While the chapter structure remained the same,the presented material has undergone lots of substantial changes to the extent thatthis edition may well be considered a completely rewritten text. It includes alsonumerous references to papers on random sets and their applications published since2005.

Page 12: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

xii Preface

Conventions

The numbering in the second edition follows a three-digit pattern, where the firstdigit is the chapter number followed by section. When referring to the Appendices,the first two digits are replaced by a letter that designates the particular appendix.The statements in theorems and propositions are mostly designated by Romannumerals, while the conditions usually follow the Arabic numeration.

Although the main concepts in this book are used throughout the whole text,it is anticipated that the reader will be able to read the book from the middle. Theconcepts are often restated, definitions recalled, and the notational system is set to beas consistent as possible, taking into account various conventions within a numberof mathematical areas that build up this book.

Future supporting information for this book (e.g., the eventual list of misprints orcomments to open problems) will be available through Springer’s WEB site or fromthe author’s personal page, which can easily be found with search engines.

Acknowledgements

G. Matheron’s book Random Sets and Integral Geometry [581] accompanied methroughout my whole life in mathematics since 1981 where I first saw its Russiantranslation (published in 1978). Then I became fascinated in this cocktail oftechniques from topology, convex geometry and probability theory that essentiallymakes up the theory of random sets.

This book project (over the two editions) has spanned my work and life in fivedifferent countries: Germany, the Netherlands, Scotland, Spain and Switzerland. Iwould like to thank the people of all these and many other countries who supportedme at various stages of my work and from whom I had a chance to learn. Inparticular, I would like to thank Dietrich Stoyan who, a while ago, encouragedme to start writing this book, and my colleagues in Bern for a wonderful workingand living environment. The Swiss National Science Foundation (SNF) has beensupporting my research work for many years.

A lot of motivation for the second edition came from economical and financialapplications. I am grateful to Francesca Molinari for bringing the theory of randomsets to econometrics and for explaining to me relevant problems.

I am grateful to the creators of the XEmacs software which was absolutelyindispensable during my work on this large LATEX project and to the staff of Springerwho helped me to complete this work.

Finally, I would like to thank my family and close friends for being always readyto help, whatever happens.

Bern, Switzerland Ilya MolchanovMay 2017

Page 13: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Contents

1 Random Closed Sets and Capacity Functionals . . . . . . . . . . . . . . . . . . . . . . . . . . 11.1 Distributions of Random Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

1.1.1 Set-Valued Random Elements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11.1.2 Capacity Functionals. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61.1.3 Choquet’s Theorem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151.1.4 Proofs of Choquet’s Theorem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201.1.5 Separating Classes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271.1.6 Further Functionals Related to Random Sets . . . . . . . . . . . . . . . 311.1.7 Separable Random Sets and Inclusion Functionals . . . . . . . . 381.1.8 Hitting Processes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44

1.2 The Lattice-Theoretic Framework . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 491.2.1 Basic Constructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 491.2.2 Existence of Measures on Partially Ordered Sets . . . . . . . . . . 501.2.3 Locally Finite Measures on Posets . . . . . . . . . . . . . . . . . . . . . . . . . . 541.2.4 Existence of Random Sets Distributions .. . . . . . . . . . . . . . . . . . . 56

1.3 Measurability and Multifunctions.. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 571.3.1 Multifunctions in Metric Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . 571.3.2 Random Compact Sets in Polish Spaces . . . . . . . . . . . . . . . . . . . . 621.3.3 The Effros �-Algebra . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 641.3.4 Distribution of Random Closed Sets in Polish Spaces . . . . . 671.3.5 Measurability of Set-Theoretic Operations . . . . . . . . . . . . . . . . . 691.3.6 Non-closed Random Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72

1.4 Selections of Random Closed Sets. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 771.4.1 Existence and Uniqueness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 771.4.2 Distributions of Selections. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 821.4.3 Families of Selections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88

1.5 Capacity Functionals and Properties of Random Closed Sets . . . . . . . 901.5.1 Invariance and Stationarity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 901.5.2 Regenerative Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 941.5.3 The Expected Measure of a Random Set . . . . . . . . . . . . . . . . . . . 971.5.4 Hausdorff Dimension . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100

xiii

Page 14: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

xiv Contents

1.5.5 Comparison of Random Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1041.5.6 Transformation of Capacities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1081.5.7 Rearrangement Invariance .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110

1.6 Calculus with Capacities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1121.6.1 The Choquet Integral . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1121.6.2 The Radon–Nikodym Theorem for Capacities . . . . . . . . . . . . . 1201.6.3 Derivatives of Capacities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122

1.7 Convergence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1271.7.1 Weak Convergence .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1271.7.2 Convergence Almost Surely and in Probability . . . . . . . . . . . . 1361.7.3 Probability Metrics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140

1.8 Random Convex Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1461.8.1 C-Additive Capacities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1461.8.2 Containment Functional . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1501.8.3 Non-compact Random Convex Sets . . . . . . . . . . . . . . . . . . . . . . . . 156

1.9 Point Processes and Random Measures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1611.9.1 Random Sets and Point Processes . . . . . . . . . . . . . . . . . . . . . . . . . . . 1611.9.2 A Representation of Random Sets as Point Processes . . . . . 1701.9.3 Random Sets and Random Measures . . . . . . . . . . . . . . . . . . . . . . . 1751.9.4 Random Capacities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1781.9.5 Robbins’ Theorem for Random Capacities . . . . . . . . . . . . . . . . . 181

1.10 Various Interpretations of Capacities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1881.10.1 Non-additive Measures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1881.10.2 Upper and Lower Probabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1921.10.3 Belief Functions .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1981.10.4 Capacities in Robust Statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201

Notes to Chap. 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204

2 Expectations of Random Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2252.1 The Selection Expectation and Aumann Integral . . . . . . . . . . . . . . . . . . . . 225

2.1.1 Integrable Selections and Decomposability . . . . . . . . . . . . . . . . 2262.1.2 The Selection Expectation .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2382.1.3 Applications of the Selection Expectation .. . . . . . . . . . . . . . . . . 2512.1.4 Variants of the Selection Expectation . . . . . . . . . . . . . . . . . . . . . . . 2592.1.5 Convergence of the Selection Expectations.. . . . . . . . . . . . . . . . 2632.1.6 Conditional Expectation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270

2.2 Further Definitions of Expectations.. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2782.2.1 General Methods of Defining Expectations.. . . . . . . . . . . . . . . . 2782.2.2 The Vorob’ev Expectation .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2822.2.3 Distance Average.. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2862.2.4 The Radius-Vector Expectation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2902.2.5 Expectations in Metric Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2912.2.6 Convex Combination Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2982.2.7 Sublinear and Superlinear Expectations . . . . . . . . . . . . . . . . . . . . 299

Notes to Chap. 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 306

Page 15: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Contents xv

3 Minkowski Sums . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3173.1 The Strong Law of Large Numbers for Random Sets. . . . . . . . . . . . . . . . 317

3.1.1 Minkowski Sums of Deterministic Sets . . . . . . . . . . . . . . . . . . . . . 3173.1.2 The Strong Law of Large Numbers for Random

Compact Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3203.1.3 Applications of the Strong Law of Large Numbers . . . . . . . . 3263.1.4 Non-identically Distributed Summands.. . . . . . . . . . . . . . . . . . . . 3353.1.5 Non-compact Summands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 339

3.2 Limit Theorems .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3443.2.1 The Central Limit Theorem for Minkowski Averages . . . . . 3443.2.2 Gaussian Random Sets. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3503.2.3 Minkowski Infinitely Divisible Random Compact Sets . . . . 3543.2.4 Stable Random Compact Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 357

3.3 Further Results Related to Minkowski Sums . . . . . . . . . . . . . . . . . . . . . . . . . 3613.3.1 Convergence of Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3613.3.2 Renewal Theorems .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3633.3.3 Ergodic Theorems.. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3673.3.4 Large Deviations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 369

Notes to Chap. 3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 373

4 Unions of Random Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3794.1 Infinite Divisibility and Stability for Unions . . . . . . . . . . . . . . . . . . . . . . . . . 379

4.1.1 Infinite Divisibility for Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3794.1.2 Scheme of Series for Unions of Random Closed Sets . . . . . 3864.1.3 Infinite Divisibility of Lattice-Valued Random

Elements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3884.1.4 Union-Stable Random Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3924.1.5 LePage Series Representation and Examples . . . . . . . . . . . . . . . 3984.1.6 Non-multiplicative Normalisations . . . . . . . . . . . . . . . . . . . . . . . . . 404

4.2 Weak Convergence of Scaled Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4094.2.1 Stability of Limits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4094.2.2 Limit Theorems Under Regular Variation Conditions . . . . . 4104.2.3 Necessary Conditions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4174.2.4 The Probability Metrics Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . 420

4.3 Convergence with Probability One . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4244.3.1 Regularly Varying Capacities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4244.3.2 Almost Sure Convergence of Scaled Unions . . . . . . . . . . . . . . . 4264.3.3 Unions of Random Compact Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . 4294.3.4 Functionals of Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 432

4.4 Convex Hulls and Intersections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4344.4.1 Infinite Divisibility for Convex Hulls . . . . . . . . . . . . . . . . . . . . . . . 4344.4.2 Convex-Stable Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4374.4.3 Intersections .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 440

Notes to Chap. 4 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 444

Page 16: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

xvi Contents

5 Random Sets and Random Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4515.1 Random Multivalued Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 451

5.1.1 Multivalued Martingales in Discrete Time. . . . . . . . . . . . . . . . . . 4515.1.2 Continuous Time Set-Valued Processes. . . . . . . . . . . . . . . . . . . . . 4625.1.3 Special Classes of Set-Valued Processes. . . . . . . . . . . . . . . . . . . . 4735.1.4 Random Functions with Stochastic Domains .. . . . . . . . . . . . . . 482

5.2 Level and Excursion Sets of Random Functions .. . . . . . . . . . . . . . . . . . . . 4865.2.1 Excursions of Random Fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4865.2.2 Random Subsets of the Positive Half-Line and

Filtrations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4915.2.3 Level Sets of Strong Markov Processes. . . . . . . . . . . . . . . . . . . . . 4945.2.4 Set-Valued Stopping Times and Set-Indexed

Martingales . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5015.3 Semicontinuous Random Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 503

5.3.1 Epigraphs and Epi-Convergence . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5035.3.2 Weak Epi-Convergence of Random Functions . . . . . . . . . . . . . 5075.3.3 Stochastic Optimisation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5185.3.4 Epigraphs and Extremal Processes . . . . . . . . . . . . . . . . . . . . . . . . . . 5235.3.5 Increasing Set-Valued Processes of Excursion Sets . . . . . . . . 5325.3.6 Strong Law of Large Numbers for Epigraphical Sums. . . . . 5345.3.7 Level Sums of Random Upper Semicontinuous

Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 537Notes to Chap. 5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 540

Appendices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 553A Topological Spaces and Metric Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 553B Linear Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 560C Space of Closed Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 566D Compact Sets and the Hausdorff Metric . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 571E Multifunctions and Semicontinuity .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 579F Measures and Probabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 583G Capacities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 590H Convex Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 595I Semigroups, Cones and Harmonic Analysis . . . . . . . . . . . . . . . . . . . . . . . . . 602J Regular Variation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 606

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 613

Name Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 649

Subject Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 659

List of Notation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 675

Page 17: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

Chapter 1Random Closed Sets and Capacity Functionals

1.1 Distributions of Random Sets

1.1.1 Set-Valued Random Elements

Measurability Definition

As the name suggests, a random set is an object with values being sets, so that thecorresponding record space is the space of subsets of a given carrier space. At thisstage, a mere definition of a general random element like a random set presents littledifficulty as soon as a �-algebra on the record space is specified.

Because the family of all sets is rather rich, it is usual to consider random setswith some extra conditions on their possible values, e.g., closed, open, or convex.In order to include the case of random singletons (which are closed in topologicalspaces satisfying rather mild requirements), it is common to consider random closedsets. The family of closed subsets of a topological space E is denoted by F , whileK and G denote, respectively, the family of all compact and open subsets of E. It isoften assumed that E is a locally compact Hausdorff second countable topologicalspace (LCHS space). The Euclidean space Rd is a generic example of such aspace E.

Let us fix a complete probability space .˝;A;P/ which will be used throughoutto define random elements. It is natural to call an F -valued random element arandom closed set. However, one should be more specific about measurabilityissues, in other words, when defining a random element it is necessary to specifywhich information is available in terms of the observable events from the �-algebraA in ˝ . It is essential to ensure that the measurability requirement is restrictiveenough, so that all functionals of interest become random variables. At the sametime, the measurability condition must not be too strict in order to include as manyrandom elements as possible. The following definition describes a rather flexibleand useful concept of a random closed set.

© Springer-Verlag London Ltd. 2017I. Molchanov, Theory of Random Sets, Probability Theory and StochasticModelling 87, DOI 10.1007/978-1-4471-7349-6_1

1

Page 18: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

2 1 Random Closed Sets and Capacity Functionals

Definition 1.1.1 (Definition of a random closed set) A map XW˝ 7! F from aprobability space .˝;A;P/ to the family of closed sets in an LCHS space E iscalled a random closed set if, for every compact set K in E

f! W X.!/\ K ¤ ;g 2 A: (1.1.1)

Although we will postpone considering of random closed sets in more generalspaces until Sect. 1.3.1, we give here the definition of random closed sets in Polishspaces, which is equivalent to the above definition if the carrier space E is LCHS.

Definition 1.1.10 A map XW˝ 7! F from a probability space .˝;A;P/ to thefamily of closed sets in a Polish space E is called a random closed set if, for everyopen set G in E

f! W X.!/\ G ¤ ;g 2 A: (1.1.2)

Condition (1.1.1) means that observing X one can always say if X hits or missesany given compact set K. In more abstract language, (1.1.1) says that the mapXW˝ 7! F is measurable as a map between the underlying probability space andthe space F equipped with the �-algebra B.F / generated by fF 2 F W F\K ¤ ;gfor K running through the family K of compact subsets of E.

Denote the family of closed sets that hit any given A � E by

FA D fF 2 F W F \ A ¤ ;g;

so that FK is the family of closed sets that hit K 2 K. Since the �-algebra B.F / isgenerated by FK for all K from K, this �-algebra clearly contains the complementsto FK . These complements are denoted by

F K D fF 2 F W F \ K D ;g;

so that F K is the family of closed sets missing K.The topological assumptions on E are important in the following proposition,

which establishes the equivalence of Definition 1.1.1 and Definition 1.1.1’. Itconfirms that B.F / coincides with the Effros �-algebra discussed in greater detailin Sect. 1.3.1 for the case of a general Polish space E.

Proposition 1.1.2 If E is LCHS, then the �-algebraB.F / is countably generatedand coincides with the �-algebra generated by FG for G running through the familyG of open subsets of E

Proof. By Proposition A.1, each K 2 K can be approximated by a sequence of opensets fGn; n � 1g, so that Gn # K, whence

FK D\n�1

FGn :

Page 19: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

1.1 Distributions of Random Sets 3

Furthermore, for every G from the family G of open sets,

FG D fF 2 F W F \ G ¤ ;g D[n

FKn 2 B.F /;

where fKn; n � 1g is a sequence of compact sets such that Kn " G (here thelocal compactness of E is essential, see Proposition A.1). Taking relatively compactsets from a countable base of the topology on E confirms that B.F / is countablygenerated. utCorollary 1.1.3 Let E be LCHS. A map XW˝ 7! F is a random closed set if andonly if fX \ K ¤ ;g 2 A for all K 2 M, where M is any family of compact sets,such that any open set appears as a countable union of sets from M.

Proof. Only sufficiency requires a proof. Since each open set G is obtained as theunion of compact sets Kn 2 M, n � 1, we have F G D [nF Kn , so that the resultfollows from Proposition 1.1.2. ut

The Fell topology on the family F of closed sets (see Appendix C) is generatedby open sets FG for G 2 G and F K for K 2 K. Therefore, the �-algebra generatedby FK for K 2 K coincides with the Borel �-algebra B.F / generated by the Felltopology on F . It is possible to reformulate Definition 1.1.1 as follows.

Definition 1.1.100 Assume that E is LCHS. A map XW˝ 7! F is called a randomclosed set if X is measurable with respect to the Borel �-algebra on F with respectto the Fell topology, i.e.

X�1.Y/ D f! W X.!/ 2 Xg 2 A

for each Y 2 B.F /.Condition (1.1.1) can be reformulated as

X�1.FK/ D f! W X.!/ 2 FKg 2 A: (1.1.3)

It is easy to see that (1.1.3) implies the measurability of a number of further events,e.g., fX \ G ¤ ;g for every G 2 G as confirmed by Proposition 1.1.2, fX \ F ¤ ;gand fX � Fg for every F 2 F . Letting F D E yields that fX \E ¤ ;g D fX ¤ ;gis also measurable.

If two random closed sets X and Y share the same distribution, then we write

Xd� Y. This means P fX 2 Yg D P fY 2 Yg for every measurable family of

closed sets Y 2 B.F /. In the following we see that this is the case if andonly if P fX \ K ¤ ;g D P fY \ K ¤ ;g for all compact sets K (assuming E isLCHS).

Page 20: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

4 1 Random Closed Sets and Capacity Functionals

Examples of Random Closed Sets

Example 1.1.4 (Singleton) If � is a random element in E (measurable with respectto the Borel �-algebra on E), then the singleton X D f�g is a random closed set.

Example 1.1.5 (Half-line) If � is a random variable, then X D .�1; �� is a randomclosed set on the line E D R. Indeed, fX \ K ¤ ;g D f� � infKg is a measurableevent for every K � E. Along the same lines, X D .�1; �1� � � � � � .�1; �d� is arandom closed subset of Rd if .�1; : : : ; �d/ is a d-dimensional random vector.

Example 1.1.6 (Random interval) If � and � are two random variables in R suchthat � � � a.s., then the random interval X D Œ�; �� is a random closed set. This canbe checked directly as fX \ K D ;g D f� < infKg [ f� > supKg.Example 1.1.7 (Random triangle and random ball) If �1; �2; �3 are three randomvectors in Rd, then the triangle with vertices �1; �2 and �3 is a random closed set.If � is a random vector in Rd and � is a non-negative random variable, then therandom ball B�.�/ of radius � centred at � is a random closed set (Fig. 1.1.1). Whileit is possible to deduce this directly from Definition 1.1.1, it is easier to refer togeneral results established later on in Theorem 1.3.25.

Example 1.1.8 (Random line) Let .�; �/ be a random point from RC� Œ0; 2�/. Theline in R2 orthogonal to the direction given by � and located at distance � from theorigin is a random closed set. It is obtained by mapping a random singleton to a lineusing a set-valued map, see Appendix E. Many other random sets are defined in thisway as M.�/, applying a set-valued function MWRm 7! F to a random vector in Rm.

Example 1.1.9 (Random set in finite space) Let E D fx1; : : : ; xng be a finite spaceof cardinality n. Equipped with the discrete topology (so that all its subsets areclosed and open at the same time) it is an LCHS space. Then X is a random set inE if and only if the vector .1x12X; : : : ; 1xn2X/ of indicators is a random vector withvalues in f0; 1gn.Example 1.1.10 (Levels and excursions of stochastic process) Let �x, x 2 E, be areal-valued stochastic process on E with continuous sample paths. Then its level setX D fx 2 E W �x D tg is a random closed set for every t 2 R. Indeed,

fX \ K D ;g Dn

infx2K �x > t

o[n

supx2K

�x < to

is measurable. Similarly, fx W �x � tg and fx W �x � tg are random closed sets. Ifthe stochastic process �x, x 2 E, is not necessarily continuous, then these randomsets are graph measurable and not necessarily closed, see Example 1.3.33.

Page 21: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

1.1 Distributions of Random Sets 5

Fig. 1.1.1 Simple examples of random closed sets

Random Variables Associated with Random Closed Sets

Example 1.1.11 (Indicator) For every x 2 E, the indicator 1X.x/ (equal to 1 if x 2X and to zero otherwise) is a random variable.

Example 1.1.12 (Norm) The norm

kXk D supfkxk W x 2 Xg

of an almost surely non-empty random closed set X in E D Rd is a random variable(with possibly infinite values). The event fkXk > tg means that X hits the open setG, being the complement of the closed ball of radius t centred at the origin.

Example 1.1.13 Let � be a metric on E. For each x 2 E, the distance function

�.x;X/ D inff�.x; y/ W y 2 Xg; x 2 E;

is a random variable with values in Œ0;1�, where the value1 arises if X is empty.Indeed, f�.x;X/ � tg D fBt.x/\X ¤ ;g. Considered as a function of x, the distancefunction is a continuous stochastic process.

Example 1.1.14 (Measure of random set) If is a �-finite Borel measure on E,then .X/ is a random variable. This follows directly from Fubini’s theorem since.X/ D R 1X.x/.dx/, see Sect. 1.5.3. If E is a finite space and .A/ is the numberof points in A, then the random variable

.X/ D card.X/ DXx2E

1x2X

is the cardinality of X. The same applies for the case of a countable E, however,then the cardinality of X may become infinite.

Page 22: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

6 1 Random Closed Sets and Capacity Functionals

Proposition 1.1.15 Let E be LCHS.

(i) The number card.X \B/ of points in X \ B is a random variable (with possiblyinfinite values) for each Borel set B in E.

(ii) The number of connected components of a random closed set X is a randomvariable (with possibly infinite values).

Proof. (i) It suffices to prove that card.X \ G/ is a random variable for all openG. Then card.X \ G/ is the supremum of

Pi 1X\Gi¤; over all n � 1 and disjoint

G1;G2; : : : ;Gn from the countable base of the topology and such that Gi � G forall i. It suffices to note that 1X\Gi¤; is a random variable, and the supremum is takenover a countable family.(ii) Let fKn; n � 1g be a sequence of compact sets that grows to E. The numberof connected components of X is the limit of the number of connected componentsof X \ Kn, so that it suffices to prove the result for random sets in compact spaces.The number of connected components in X is at most n if X is covered by the unionof n disjoint open sets. Since E has a countable base and X is compact, these opendisjoint open sets G1; : : : ;Gn may be chosen as finite unions of sets from the base.Finally, note that the event X � G1 [ � � � [Gn is measurable. ut

A closed set F has reach at least r > 0 if each point y from its r-envelope Fr

(see (A.1)) admits the unique point y 2 F that is nearest to x. The set F is saidto be of positive reach if the supremum of such r (called the reach of F) is strictlypositive. Each convex set has infinite (hence, positive) reach.

Proposition 1.1.16 The reach of a random closed set inRd is a random variable.

Proof. It suffices to show that the family of sets of reach at least r is closed in Fand so is measurable. Let fFn; n � 1g be a sequence of sets of reach at least r, andlet Fn ! F in the Fell topology. By Theorems C.7 and C.14, the distance functions�.x;Fn/ converge to �.x;F/ uniformly for all x in any compact set. By Federer [264,Th. 4.13], the limiting set F has reach at least r. ut

1.1.2 Capacity Functionals

Definition

The distribution of a random closed set X is determined by P.Y/ D P fX 2 Yg forall Y 2 B.F /. The particular choice of Y D FK and P fX 2 FKg D P fX \ K ¤ ;gis useful since the families FK , K 2 K, generate the Borel �-algebra B.F /.

Page 23: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

1.1 Distributions of Random Sets 7

Definition 1.1.17 (Capacity functional) The functional TXWK 7! Œ0; 1� given by

TX.K/ D P fX \ K ¤ ;g ; K 2 K; (1.1.4)

is said to be the capacity functional of X. We write T.K/ instead of TX.K/ where noambiguity occurs.

Example 1.1.18 (Capacity functionals of simple random sets)(i) If X D f�g is a random singleton, then TX.K/ D P f� 2 Kg, so that the capacityfunctional is the probability distribution of �. If X is f�g with probability p andotherwise is equal to the whole space E, then TX.K/ D pP f� 2 Kg C .1 � p/1K¤;.(ii) Let X D f�1; �2g be the set formed by two independent identically distributedrandom elements in E (X is a singleton if �1 D �2). Then TX.K/ D 1 � .1 �P f�1 2 Kg/2. For instance, if �1 and �2 are the numbers shown by two dice, thenX � f1; 2; : : : ; 6g and TX.f6g/ is the probability that at least one die shows six.(iii) Let X D .�1; �� be a random closed set in R, where � is a random variable.Then TX.K/ D P f� > infKg for all K 2 K.(iv) If X D fx 2 E W �x � tg for t 2 R and a real-valued sample continuousstochastic process �x, x 2 E, then TX.K/ D P fsupx2K �x � tg. The capacityfunctional at K D fxg is P f�x � tg.(v) If X D ft � 0 W wt D 0g is the set of zeros for the standard Brownian motionwt, then

TX.Œa; b�/ D 2

�arccos

pa=b

by the arcsine law, see, e.g., Kallenberg [443, Th. 13.16].It follows immediately from the definition of T D TX that

T.;/ D 0; (1.1.5)

and

0 � T.K/ � 1; K 2 K: (1.1.6)

It should be noted that P fX \E ¤ ;g D P fX ¤ ;g (which can be viewed as thevalue T.E/ of the capacity functional extended to possibly non-compact sets) maybe strictly less than one.

Since FKn # FK as Kn # K, the continuity property of the probability measure Pimplies that T is upper semicontinuous (see Proposition E.12), i.e.

T.Kn/ # T.K/ as Kn # K in K: (1.1.7)

Page 24: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

8 1 Random Closed Sets and Capacity Functionals

Properties (1.1.5) and (1.1.7) mean that T is a (topological) precapacity that can beextended to the family of all subsets of E as described in Appendix G.

Complete Alternation

It is easy to see that the capacity functional T is monotone, i.e.

T.K1/ � T.K2/ if K1 � K2:

Moreover, T satisfies a stronger monotonicity property described below. To eachfunctional T defined on a family of (compact) sets we can associate the followingsuccessive differences:

K1T.K/ D T.K/ � T.K [ K1/; (1.1.8)

Kn � � �K1T.K/ D Kn�1 � � �K1T.K/

�Kn�1 � � �K1T.K [ Kn/; n � 2: (1.1.9)

Note that Kn � � �K1T.K/ is invariant under permutations of K1; : : : ;Kn. If T is thecapacity functional of X, then

K1T.K/ D P fX \ K ¤ ;g � P fX \ .K [ K1/ ¤ ;gD �P fX \ K1 ¤ ;; X \ K D ;g :

Applying this argument consecutively yields an important relationship betweenthe higher-order successive differences and the distribution of X

�Kn � � �K1T.K/ D P fX \ K D ;; X \ Ki ¤ ;; i D 1; : : : ; ngD P

˚X 2 F K

K1;:::;Kn

�; (1.1.10)

where

F KK1;:::;Kn

D fF 2 F W F \ K D ;; F \ K1 ¤ ;; : : : ;F \ Kn ¤ ;gD F K \ FK1 \ � � � \ FKn ;

see Fig. 1.1.2. In particular, (1.1.10) implies

Kn � � �K1T.K/ � 0 (1.1.11)

for all n � 1 and K;K1; : : : ;Kn 2 K. Equation (1.1.11) establishes the completealternation property of the capacity functional T, see Definition 1.1.23.

Page 25: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

1.1 Distributions of Random Sets 9

Fig. 1.1.2 A set F fromF KK1;K2;K3 : it misses K and hits

each of K1;K2;K3

Fig. 1.1.3 Random closedset from Example 1.1.19(ii) z

d

x

b

yc

aX

Example 1.1.19 (Higher-order differences)(i) Let X D f�g be a random singleton with distribution P. Then

�Kn � � �K1T.K/ D P˚� 2 .K1 \ � � � \ Kn \ Kc/

�:

(ii) Let X D .�1; �1� � .�1; �2� be a random closed set in the plane R2. Then�fxgT.fy; zg/ for x D .a; c/, y D .b; c/, z D .a; d/ is the probability that � lies inthe rectangle Œa; b/ � Œc; d/, see Fig. 1.1.3.(iii) Let X D fx W �x � 0g for a continuous real-valued random function � on E.Then

�Kn � � �K1T.K/ D P

(supx2K

�x < 0; supx2Ki

�x � 0; i D 1; : : : ; n):

The properties of the capacity functional T resemble those of the cumulativedistribution function of random vectors. The upper semicontinuity property (1.1.7)is similar to right-continuity, and (1.1.11) generalises the monotonicity concept.The complete alternation property (1.1.11) corresponds to the non-negativity ofprobability contents of parallelepipeds. While for d-dimensional random vectorsit suffices to check the successive differences up to order d, all orders are needed forrandom sets.

In contrast to measures, the functional T is not additive, but only subadditive, i.e.

T.K1 [ K2/ � T.K1/C T.K2/ (1.1.12)

for all compact sets K1 and K2.

Page 26: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

10 1 Random Closed Sets and Capacity Functionals

Example 1.1.20 (Non-additive capacity functional) If X D Br.�/ is the ball ofradius r centred at a random point � in Rd, then TX.K/ D P f� 2 Krg is not additive,since the r-envelopes Kr

1 and Kr2 are not necessarily disjoint for disjoint K1 and K2.

Inequality (1.1.11) for n D 2 turns into

T.K/C T.K [K1 [K2/ � T.K [K1/C T.K [K2/; K;K1;K2 2 K; (1.1.13)

which yields (1.1.12) if K D ;. By letting K1 be K[K1 and K2 be K[K2 and usingthe monotonicity of T, (1.1.13) is equivalent to

T.K1 \ K2/C T.K1 [ K2/ � T.K1/C T.K2/; K1;K2 2 K; (1.1.14)

meaning that T is concave, also called strongly subadditive.

Extension of the Capacity Functional

As explained in Appendix G, a capacity ' defined on compact sets in an LCHSspace can be naturally extended to the family P D P .E/ of all subsets so that itpreserves alternation or the monotonicity properties enjoyed by '. In its applicationto capacity functionals of random closed sets, put

T�.G/ D supfT.K/ W K 2 K;K � Gg; G 2 G; (1.1.15)

and

T�.M/ D inffT�.G/ W G 2 G;G Mg; M 2 P : (1.1.16)

Theorem 1.1.21 (Consistency of extension)

(i) T�.K/ D T.K/ for each K 2 K.(ii) For all Borel sets B in E,

T�.B/ D supfT.K/ W K 2 K; K � Bg:

(iii) The functional T� is completely alternating on the family of all subsets of E.

Proof. The first statement follows from the upper semicontinuity of T. Note thatT�.K/ is a limit of T�.Gn/ for a sequence of open sets Gn # K. By choosing Kn 2K such that K � Kn � Gn we deduce that T.Kn/ # T�.K/, while at the sametime T.Kn/ # T.K/ since T is upper semicontinuous. The second statement is acorollary from the more intricate Choquet capacitability theorem, see Theorem G.2.The complete alternation of the extension follows from Proposition G.6. ut

Page 27: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

1.1 Distributions of Random Sets 11

Since the extension T� coincides with T on K, in the following we use the samenotation T to denote the extension, i.e. T.G/ or T.B/ denotes the values of theextended T on open G and Borel B. While T is upper semicontinuous on compactsets, its extension satisfies T.Gn/ " T.G/ for any sequence of open sets Gn " G.

Theorem 1.1.22 The extended capacity functional satisfies

T.B/ D P fX \ B ¤ ;g

for all Borel B.

Proof. By letting Kn " G 2 G, the continuity property of probability measuresyields that T.G/ D P fX \ G ¤ ;g for all G 2 G. The event fX \ B ¤ ;gis measurable by Theorem 1.3.3. By (1.1.16), it is possible to find a decreasingsequence of open sets Gn B such that T.Gn/ # T.B/. By Theorem 1.1.21(ii),there is an increasing sequence of compact sets Kn � B such that T.Kn/ " T.B/. Itsuffices to note that

T.Kn/ � P fX \ B ¤ ;g � T.Gn/: ut

The countable subadditivity property of probability measures yields that thecapacity functional is countably subadditive on Borel sets, that is,

T�[1

iD1Bi� �

1XiD1

T.Bi/ (1.1.17)

for all B1;B2; : : : 2 B.E/.

Complete Alternation and Monotonicity of General Functionals

Because of the importance of the upper semicontinuity property (1.1.7) and thecomplete alternation (1.1.11), it is natural to consider general functionals that satisfythese properties without immediate reference to distributions of random closed sets.

Definition 1.1.23 (Completely alternating and completely [-monotone func-tionals) Let D be a family of sets which is closed under finite unions (so thatM1 [ M2 2 D if M1;M2 2 D). A real-valued functional ' defined on D is saidto be

(i) completely alternating or completely [-alternating (notation ' 2 A.D/ or ' 2A[.D/) if

Kn � � �K1'.K/ � 0; n � 1; K;K1; : : : ;Kn 2 D I (1.1.18)

Page 28: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

12 1 Random Closed Sets and Capacity Functionals

(ii) completely [-monotone (notation ' 2 M[.D/) if

Kn � � �K1'.K/ � 0; n � 1; K;K1; : : : ;Kn 2 D:

Definition 1.1.23(i) with D D K and ' D TX corresponds to the completealternation property of the capacity functional. Definition 1.1.23 complies withDefinition I.5 applied to the semigroup D with the union being the semigroupoperation, Therefore, it is possible to use the results of Appendix I within thiscontext. Theorem I.8 states that ' 2 A[.K/ if and only if e�t' 2 M[.K/ for allt > 0. Let us formulate one particularly important corollary of this fact.

Proposition 1.1.24 If ' is a completely alternating non-negative functional, then1 � e�'.K/ is a completely alternating functional with values in Œ0; 1/.

Proposition 1.1.24 is often used to construct a capacity functional from acompletely alternating upper semicontinuous functional that may take values greaterthan one.

Example 1.1.25 Every measure is a completely alternating functional, since

�Kn � � �K1.K/ D ..K1 [ � � � [ Kn/ n K/ � 0:

In particular,K1.K/ D �.K1/ if K and K1 are disjoint.If (1.1.18) holds for all n � k and some natural number k, then the functional '

is called k-alternating. In particular, ' is increasing if and only if it is 1-alternating,that is,

K1'.K/ D '.K/� '.K [ K1/ � 0:

Since

K2K1'.K/ D '.K/� '.K [ K1/ � '.K [ K2/C '.K [ K1 [ K2/;

(1.1.18) for n D 2 turns into

'.K/C '.K [ K1 [ K2/ � '.K [ K1/C '.K [ K2/: (1.1.19)

In particular, if D is closed under finite intersections, contains the empty set, and'.;/ D 0, then letting K D ; in (1.1.19) yields that

'.K1 [ K2/ � '.K1/C '.K2/; (1.1.20)

meaning that ' is subadditive. For an increasing ', inequality (1.1.19) is equivalentto

'.K1 \ K2/C '.K1 [ K2/ � '.K1/C '.K2/ (1.1.21)

Page 29: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

1.1 Distributions of Random Sets 13

for all K1 and K2. A functional ' satisfying (1.1.21) is called concave or stronglysubadditive. Functionals satisfying the reverse inequality in (1.1.21) are calledconvex or strongly superadditive. Furthermore, ' is called 2-alternating ifK1'.K/and K2K1'.K/ are non-positive for all K;K1;K2 2 D. Therefore, ' is 2-alternating if it is both concave and monotone.

Another natural semigroup operation on sets is intersection, which leads to otherconcepts of alternating and monotone functionals. Similarly to the definition ofKn � � �K1'.K/, we introduce the following successive differences

rK1'.K/ D '.K/� '.K \ K1/; (1.1.22)

rKn � � � rK1'.K/ D rKn�1 � � � rK1'.K/� rKn�1 � � � rK1'.K \ Kn/; n � 2: (1.1.23)

The following definition is a direct counterpart of Definition 1.1.23.

Definition 1.1.26 (Completely \-alternating and completely monotone func-tionals) Let D be a family of sets which is closed under finite intersections. Areal-valued functional ' defined on D is said to be

(i) completely \-alternating (notation ' 2 A\.D/) if

rKn � � � rK1'.K/ � 0; n � 1; K;K1; : : : ;Kn 2 D I

(ii) completely monotone or completely \-monotone (notation ' 2 M.D/ or ' 2M\.D/) if

rKn � � � rK1'.K/ � 0; n � 1; K;K1; : : : ;Kn 2 D:

When saying that ' is completely alternating we always mean that ' iscompletely [-alternating, while calling ' completely monotone means that ' iscompletely \-monotone.

If D is closed both under finite unions and under finite intersections, the completealternation condition can be equivalently formulated as

'.

n\iD1

Ki/ �X

;¤J�f1;:::;ng.�1/card.J/C1'.

[i2J

Ki/ (1.1.24)

for all n � 1 and K1; : : : ;Kn 2 D. The complete monotonicity condition isequivalent to

'.

n[iD1

Ki/ �X

;¤J�f1;:::;ng.�1/card.J/C1'.

\i2J

Ki/: (1.1.25)

Page 30: Ilya Molchanov Theory of Random Sets - Startseite · † set-valued analysis and multifunctions, see Castaing and Valadier [158]; † advances in image analysis and microscopy that

14 1 Random Closed Sets and Capacity Functionals

Proposition 1.1.27 Let 'WD 7! Œ0; 1�. Then,

(i) ' 2 A[.D/ if and only if, for any fixed L 2 D,

�L'.K/ D '.K [ L/ � '.K/ 2 M[.D/ I

(ii) ' 2 A\.D/ if and only if, for any fixed L 2 D,

�rL'.K/ D '.K \ L/ � '.K/ 2 M\.D/:

(iii) Let 'WD 7! Œ0; 1�. Then ' 2 A[.D/ (respectively, ' 2 A\.D/) if and only ifQ'.K/ 2 M\.D0/ (respectively, Q'.K/ 2 M[.D0/) for the dual functional

Q'.K/ D 1 � '.Kc/; Kc 2 D; (1.1.26)

defined on the familyD0 D fKc W K 2 Dg of complements of the sets from D.

Proof. (i) It suffices to note that

Kn : : : K1 .�L'.K// D �LKn : : : K1'.K/

with a similar relationship valid for the successive differences based on intersec-tions. Statement (ii) is proved similarly. The proof of (iii) is a matter of verificationthat

Kn � � �K1 Q'.K/ D �rKcn� � � rKc

1'.Kc/: ut

Complete Alternation and Positive Definiteness

The family K becomes an abelian semigroup if equipped with the union operation.This semigroup is idempotent and also 2-divisible, meaning that each element canbe represented as the sum of two identical elements, that is, K D K [ K. In thiscase, the family of completely alternating functionals coincides with the family ofnegative definite functionals, and the family of completely monotone functionalsis the same as the family of positive definite functionals, see Berg, Christensen andRessel [92, Cor. 4.6.8] and Theorem I.6. This fact is presented in the followingtheorem.

Theorem 1.1.28 A functional 'WK 7! RC is completely alternating if and only if

nXiD1

cicj'.Ki [ Kj/ � 0

for all n � 2, K1; : : : ;Kn 2 K, and c1; : : : ; cn 2 R such thatP

ci D 0.