Definition 21.11.2.3B5FF6A6C162Let $F\colon N\rightarrow [-\infty ,\infty ]$ be a function. The epigraph of $F$ is defined as the following set
21.11.1 The notion of convex functionsFB8022E8BCA8
Let $N$ be a real vector space of finite dimension.
Definition 21.11.3.4FA12A948A00 A convex function on $N$ is a function $F\colon N\rightarrow [-\infty ,\infty ]$ such that the epigraph $\operatorname{epi}F$ is a convex subset of $N\times \mathbb {R}$.
The effective domain of $F$ is the set
A convex function $F$ on $N$ such that $\operatorname{Dom}F\neq \varnothing $ and $F(n)\neq -\infty $ for all $n\in N$ is said to be proper.
The set of convex functions on $N$ is denoted by $\mathrm{Conv}(N)$. The subset of proper convex functions is denoted by $\mathrm{Conv}^{\mathrm{prop}}(N)$.
Lemma 21.11.4.47309C75E6C1 Let $F\colon N\rightarrow [-\infty ,\infty ]$. Then $F$ is convex if and only if the following condition holds: suppose that $n,r\in N$ and $a,b\in \mathbb {R}$ such that $a>F(n)$, $b>F(r)$, then for any $t\in (0,1)$, we have
Proof. Assume first that the epigraph is convex. Given $a>F(n)$ and $b>F(r)$, choose finite $a'<a$ and $b'<b$ with $F(n)\leq a'$ and $F(r)\leq b'$. Convexity of the epigraph gives $F(tn+(1-t)r)\leq ta'+(1-t)b'<ta+(1-t)b$.
Conversely, take $(n,a),(r,b)$ in the epigraph. For every $\varepsilon>0$ the assumed inequality applied to $a+\varepsilon,b+\varepsilon$ gives $F(tn+(1-t)r)<ta+(1-t)b+\varepsilon$. Let $\varepsilon\downarrow0$. The resulting weak inequality says that the convex combination of these two points belongs to the epigraph. Endpoints cause no difficulty. This proof also covers values $-\infty$; points with value $+\infty$ contribute no points to the epigraph.
Example 21.11.5.1532A37DD27F Let $A\subseteq N$ be a convex subset. Then the characteristic function $\chi _ A\colon N\rightarrow \{ 0,\infty \} $ of $A$ is defined by
The function $\chi _ A$ lies in $\mathrm{Conv}(N)$.
Example 21.11.6.8CBDC69B6C55 Let $M$ be the dual vector space of $N$ and $P\subseteq M$ be a convex subset. The support function $\operatorname{Supp}_ P\in \mathrm{Conv}(N)$ of $P$ is defined as follows:
It is well-known that convexity is preserved by a number of natural operations. We recall a few to fix the notation.
Definition 21.11.7.0ECB6CF7B06D Let $F_1,\ldots ,F_ m\in \mathrm{Conv}^{\mathrm{prop}}(N)$ ($m\in \mathbb {Z}_{>0}$). We define their infimal convolution $F_1 \square \cdots \square F_ m\in \mathrm{Conv}(N)$ as follows:
Proposition 21.11.8.68114EF2F29C Let $\{ F_ i\} _{i\in I}$ be a non-empty family in $\mathrm{Conv}(N)$. Then $\sup _{i\in I} F_ i\in \mathrm{Conv}(N)$.
Proof. For every $x\in N$ and $a\in\mathbb R$, the inequality $a\geq\sup_iF_i(x)$ holds exactly when $a\geq F_i(x)$ for every $i$. Consequently \[\operatorname{epi}(\sup_iF_i)=\bigcap_i\operatorname{epi}F_i.\] An intersection of convex sets is convex, so the supremum is convex. This also covers extended values and an empty epigraph.
Definition 21.11.9.8F179BE28950 Let $f\colon N\rightarrow [-\infty ,\infty ]$. The lower convex envelope of $f$ is defined as
It follows from proposition 21.11.8 that $\operatorname{CE}f\in \mathrm{Conv}(N)$.
Definition 21.11.10.6561D15F1216 Given a non-empty family $\{ F_ i\} _{i\in I}$ in $\mathrm{Conv}(N)$, we define
When the family $I$ is finite, say $I=\{ 1,\ldots ,m\} $, we also write
Definition 21.11.11.4D25259F16EC Given a non-empty family $\{ F_ i\} _{i\in I}$ in $\mathrm{Conv}(N)$, we define
When the family $I$ is finite, say $I=\{ 1,\ldots ,m\} $, we also write
Proposition 21.11.12.B99B20CD6166 Let $F_1,\ldots ,F_ m\in \mathrm{Conv}^{\mathrm{prop}}(N)$. Then
Proof. Let $H$ denote the infimum displayed in the statement, with the infimum of the empty set equal to $+\infty$. It is at most $F_i$ for every $i$: put weight $1$ on that index and weight $0$ on the others, choosing arbitrary points in their nonempty effective domains.
To prove convexity, take admissible representations of $x$ and $y$, multiply their weights by $t$ and $1-t$, and combine them. For each index $i$ with combined weight $\gamma_i>0$, replace its two points by their weighted barycenter. Convexity of $F_i$ makes its new contribution no larger than the sum of the old contributions. If $\gamma_i=0$, choose any point of its domain. This produces a representation of $tx+(1-t)y$. Taking approximations to the infima proves the strict-height convexity criterion proved above, including when an infimum is $-\infty$.
Finally, every convex function $G\leq F_i$ for all $i$ is at most the value of every admissible combination, by convexity applied to finite epigraph heights above the $F_i(x_i)$ and then taking their limits. Thus $G\leq H$. Therefore $H$ is the largest convex minorant of $\inf_iF_i$, which is precisely $F_1\land\cdots\land F_m$.
Lemma 21.11.13.2F4F518BD56D Let $\{ F_ i\} _{i\in I}$ be a decreasing net in $\mathrm{Conv}(N)$. Then $\inf _{i\in I} F_ i\in \mathrm{Conv}(N)$.
Proof. Write $F=\inf _{i\in I} F_ i$. We shall apply the characterization in 21.11.4. Take $n,r\in N$, $a,b\in \mathbb {R}$ such that $a>F(n)$, $b>F(r)$ and $t\in (0,1)$. We need to show that
By definition, there are $j_ n,j_ r\in I$ such that $a>F_ i(n)$ for $i\geq j_ n$ and $b>F_ i(r)$ for $i\geq j_ r$. Since $I$ is directed, we can find $j\in I$ dominating both $j_ n$ and $j_ r$, and then for any $i\geq j$, we have
It follows from 21.11.4 that
for any $i\geq j$. Since $F_ i$ is decreasing in $i$, we conclude (21.11.14). $\square$
Definition 21.11.15.61B746F5E884 Let $F\in \mathrm{Conv}(N)$. The closure $\operatorname{cl}F\in \mathrm{Conv}(N)$ of $F$ is defined as follows: If $F(n)=-\infty $ for some $n\in N$, then $\operatorname{cl}F\coloneqq -\infty $. Otherwise, we define $\operatorname{cl}F$ as the lower semicontinuity regularization of $F$.
A convex function $F\in \mathrm{Conv}(N)$ is closed if $F=\operatorname{cl}F$. In other words, $F\in \mathrm{Conv}(N)$ is closed if one of the following conditions holds:
9B2264291DE3$F\equiv -\infty $;
55523AC55CA5$F\equiv \infty $;
C1225E82131E$F$ is proper and lower semicontinuous.
Proposition 21.11.16.E013E1966E44Let $F\in \mathrm{Conv}(N)$ be a closed convex function. Then $F$ is the supremum of all affine functions lying below $F$.
Proof. For a closed proper $F$, finite-dimensional Fenchel duality gives \[F(x)=F^{**}(x)=\sup_p\{\langle p,x\rangle-F^*(p)\}.\] For every $p$ with $F^*(p)<+\infty$, the expression in braces is an affine minorant of $F$, by the definition of conjugacy. Conversely, every affine minorant $\langle p,x\rangle+c$ satisfies $c\leq-F^*(p)$. Thus the supremum is exactly that of all affine minorants. If $F\equiv+\infty$, arbitrary constant minorants already have supremum $+\infty$. If $F\equiv-\infty$, there are no finite affine minorants and their supremum is $-\infty$.
Theorem 21.11.17.7E0B71CF3B0E Let $F\in \mathrm{Conv}^{\mathrm{prop}}(N)$. Then $\operatorname{cl}F$ is a closed proper convex function. Moreover, $\operatorname{cl}F$ agrees with $F$ except possibly on the relative boundary of $\operatorname{Dom}F$.
Proof. Apply the closure theorem for proper convex functions. It proves that the lower semicontinuous regularization of $F$ is closed and proper and agrees with $F$ on the relative interior of its effective domain. Since $F$ is proper, this regularization is exactly the closure defined here.
Outside the closure of $\operatorname{Dom}F$, both functions are $+\infty$: a neighborhood misses the effective domain, so the lower semicontinuous regularization is $+\infty$ there. Every remaining point outside the relative boundary belongs to the relative interior of the domain. Therefore disagreement is possible only on that relative boundary, as asserted.
Proposition 21.11.18.B6B15657CD64 Let $F,F'\in \mathrm{Conv}(N)$ be closed convex functions. Assume that
A4BAF58116DC$\operatorname{RelInt}\operatorname{Dom}F=\operatorname{RelInt}\operatorname{Dom}F'$, and
FAD3EA2C74FA$F=F'$ on $\operatorname{RelInt}\operatorname{Dom}F$.
Then $F=F'$.
Proof. For proper closed functions this is the uniqueness assertion in the convex closure theorem. More explicitly, the closure of the epigraph over the relative interior of the effective domain is the whole epigraph: for a point of the epigraph, take convex combinations with a fixed epigraph point whose base is in that relative interior, and let the coefficient of the fixed point tend to zero. Thus identical values on the common relative interior give identical epigraphs and hence identical functions.
The improper cases in the definition of closedness are also determined: empty effective domain means the function identically $+\infty$; if one function is identically $-\infty$, the common relative interior is $N$ and the value agreement makes the other identical to it. These cases complete the proof.
Definition 21.11.19.CC63E6A637E8 Given $F,F'\in \mathrm{Conv}(N)$, we write $F\preceq F'$ if there is $C\in \mathbb {R}$ such that
We say $F\sim F'$ if $F\preceq F'$ and $F'\preceq F$ both hold.
Theorem 21.11.20.A7E9B5A114CA Let $C\subseteq N$ be an open subset. Let $(f_ i)_{i>0}$ be a sequence of real-valued convex functions on $C$. Suppose that the sequence converges on a dense subset of $C$ and the limit is finite. Then the limit
exists for all $x\in C$ and is convex on $C$. Moreover, the sequence $(f_ i)_ i$ converges uniformly to $f$ on each compact subset of $C$.
Proof. On every open convex ball relatively compact in $C$, dense convergence for finite convex functions applies to the restriction of the given dense set and supplies a finite convex local limit with locally uniform convergence. Local limits agree on overlaps, because they are pointwise limits of the same sequence. They therefore define a finite function $f$ on $C$.
Every compact subset of $C$ is covered by finitely many smaller such balls. Taking the maximum of the finitely many uniform error bounds proves uniform convergence on that compact set. Passing to the limit in each convexity inequality proves convexity wherever the corresponding segment lies in $C$; in the usual convention that the domain of a convex function is convex, this is convexity on $C$. In particular the limiting values at the original dense set determine $f$ uniquely.
Comments
Corrections, questions, and mathematical discussion are welcome. Sign in with GitHub to comment. Comments are public.