Pome

21.11.1 The notion of convex functionsFB8022E8BCA8

Let $N$ be a real vector space of finite dimension.

Definition 21.11.2.3B5FF6A6C162Let $F\colon N\rightarrow [-\infty ,\infty ]$ be a function. The epigraph of $F$ is defined as the following set

\[ \operatorname{epi}F\coloneqq \left\{ (n,r)\in N\times \mathbb {R}: r\geq F(n) \right\} . \]

Definition 21.11.3.4FA12A948A00 A convex function on $N$ is a function $F\colon N\rightarrow [-\infty ,\infty ]$ such that the epigraph $\operatorname{epi}F$ is a convex subset of $N\times \mathbb {R}$.

The effective domain of $F$ is the set

\[ \operatorname{Dom}F\coloneqq \left\{ n\in N : F(n)<\infty \right\} . \]

A convex function $F$ on $N$ such that $\operatorname{Dom}F\neq \varnothing $ and $F(n)\neq -\infty $ for all $n\in N$ is said to be proper.

The set of convex functions on $N$ is denoted by $\mathrm{Conv}(N)$. The subset of proper convex functions is denoted by $\mathrm{Conv}^{\mathrm{prop}}(N)$.

The following characterization of convex functions is well-known.

Lemma 21.11.4.47309C75E6C1 Let $F\colon N\rightarrow [-\infty ,\infty ]$. Then $F$ is convex if and only if the following condition holds: suppose that $n,r\in N$ and $a,b\in \mathbb {R}$ such that $a>F(n)$, $b>F(r)$, then for any $t\in (0,1)$, we have

\[ F(tn+(1-t)r)<ta+(1-t)b. \]

Proof. Assume first that the epigraph is convex. Given $a>F(n)$ and $b>F(r)$, choose finite $a'<a$ and $b'<b$ with $F(n)\leq a'$ and $F(r)\leq b'$. Convexity of the epigraph gives $F(tn+(1-t)r)\leq ta'+(1-t)b'<ta+(1-t)b$.

Conversely, take $(n,a),(r,b)$ in the epigraph. For every $\varepsilon>0$ the assumed inequality applied to $a+\varepsilon,b+\varepsilon$ gives $F(tn+(1-t)r)<ta+(1-t)b+\varepsilon$. Let $\varepsilon\downarrow0$. The resulting weak inequality says that the convex combination of these two points belongs to the epigraph. Endpoints cause no difficulty. This proof also covers values $-\infty$; points with value $+\infty$ contribute no points to the epigraph.

See [Theorem 4.2, Roc70] for the proof.

Example 21.11.5.1532A37DD27F Let $A\subseteq N$ be a convex subset. Then the characteristic function $\chi _ A\colon N\rightarrow \{ 0,\infty \} $ of $A$ is defined by

\[ \chi _ A(n)\coloneqq \left\{ \begin{aligned} 0,& \quad n\in A;\\ \infty ,& \quad n\not\in A. \end{aligned} \right. \]

The function $\chi _ A$ lies in $\mathrm{Conv}(N)$.

Example 21.11.6.8CBDC69B6C55 Let $M$ be the dual vector space of $N$ and $P\subseteq M$ be a convex subset. The support function $\operatorname{Supp}_ P\in \mathrm{Conv}(N)$ of $P$ is defined as follows:

\[ \operatorname{Supp}_ P(n)\coloneqq \sup \{ \langle m,n \rangle : m\in P \} . \]

It is well-known that convexity is preserved by a number of natural operations. We recall a few to fix the notation.

Definition 21.11.7.0ECB6CF7B06D Let $F_1,\ldots ,F_ m\in \mathrm{Conv}^{\mathrm{prop}}(N)$ ($m\in \mathbb {Z}_{>0}$). We define their infimal convolution $F_1 \square \cdots \square F_ m\in \mathrm{Conv}(N)$ as follows:

\[ F_1 \square \cdots \square F_ m(n)\coloneqq \inf \left\{ \sum _{i=1}^ m F_ i(n_ i):n_ i\in N, \sum _{i=1}^ m n_ i=n \right\} . \]
The fact $F_1 \square \cdots \square F_ m\in \mathrm{Conv}(N)$ is proved in [Theorem 5.4, Roc70]. One should note that $F_1 \square \cdots \square F_ m$ is not always proper.

Proposition 21.11.8.68114EF2F29C Let $\{ F_ i\} _{i\in I}$ be a non-empty family in $\mathrm{Conv}(N)$. Then $\sup _{i\in I} F_ i\in \mathrm{Conv}(N)$.

Proof. For every $x\in N$ and $a\in\mathbb R$, the inequality $a\geq\sup_iF_i(x)$ holds exactly when $a\geq F_i(x)$ for every $i$. Consequently \[\operatorname{epi}(\sup_iF_i)=\bigcap_i\operatorname{epi}F_i.\] An intersection of convex sets is convex, so the supremum is convex. This also covers extended values and an empty epigraph.

This follows from [Theorem 5.5, Roc70]. In particular, this allows us to introduce

Definition 21.11.9.8F179BE28950 Let $f\colon N\rightarrow [-\infty ,\infty ]$. The lower convex envelope of $f$ is defined as

\[ \operatorname{CE}f\coloneqq \sup \{ F\in \mathrm{Conv}(N): F\leq f \} . \]

It follows from proposition 21.11.8 that $\operatorname{CE}f\in \mathrm{Conv}(N)$.

Definition 21.11.10.6561D15F1216 Given a non-empty family $\{ F_ i\} _{i\in I}$ in $\mathrm{Conv}(N)$, we define

\[ \bigwedge _{i\in I}F_ i\coloneqq \operatorname{CE}\left(\inf _{i\in I} F_ i\right). \]

When the family $I$ is finite, say $I=\{ 1,\ldots ,m\} $, we also write

\[ F_1\land \cdots \land F_ m=\bigwedge _{i\in I}F_ i. \]

Definition 21.11.11.4D25259F16EC Given a non-empty family $\{ F_ i\} _{i\in I}$ in $\mathrm{Conv}(N)$, we define

\[ \bigvee _{i\in I}F_ i\coloneqq \sup _{i\in I} F_ i. \]

When the family $I$ is finite, say $I=\{ 1,\ldots ,m\} $, we also write

\[ F_1\lor \cdots \lor F_ m=\bigvee _{i\in I}F_ i. \]
Recall that $\bigvee _{i\in I}F_ i\in \mathrm{Conv}(N)$ by proposition 21.11.8.

Proposition 21.11.12.B99B20CD6166 Let $F_1,\ldots ,F_ m\in \mathrm{Conv}^{\mathrm{prop}}(N)$. Then

\[ \begin{split} F_1\land \cdots \land F_ m(x)=\inf \left\{ \sum _{i=1}^ m \lambda _ i F_ i(x_ i):x_ i\in \operatorname{Dom}(F_ i),\right.\\ \left.\lambda _ i\in [0,1],\sum _{i=1}^ m\lambda _ i=1, \sum _{i=1}^ m\lambda _ i x_ i=x \right\} . \end{split} \]

Proof. Let $H$ denote the infimum displayed in the statement, with the infimum of the empty set equal to $+\infty$. It is at most $F_i$ for every $i$: put weight $1$ on that index and weight $0$ on the others, choosing arbitrary points in their nonempty effective domains.

To prove convexity, take admissible representations of $x$ and $y$, multiply their weights by $t$ and $1-t$, and combine them. For each index $i$ with combined weight $\gamma_i>0$, replace its two points by their weighted barycenter. Convexity of $F_i$ makes its new contribution no larger than the sum of the old contributions. If $\gamma_i=0$, choose any point of its domain. This produces a representation of $tx+(1-t)y$. Taking approximations to the infima proves the strict-height convexity criterion proved above, including when an infimum is $-\infty$.

Finally, every convex function $G\leq F_i$ for all $i$ is at most the value of every admissible combination, by convexity applied to finite epigraph heights above the $F_i(x_i)$ and then taking their limits. Thus $G\leq H$. Therefore $H$ is the largest convex minorant of $\inf_iF_i$, which is precisely $F_1\land\cdots\land F_m$.

See [Theorem 5.6, Roc70] for the more general result.

Lemma 21.11.13.2F4F518BD56D Let $\{ F_ i\} _{i\in I}$ be a decreasing net in $\mathrm{Conv}(N)$. Then $\inf _{i\in I} F_ i\in \mathrm{Conv}(N)$.

Proof. Write $F=\inf _{i\in I} F_ i$. We shall apply the characterization in 21.11.4. Take $n,r\in N$, $a,b\in \mathbb {R}$ such that $a>F(n)$, $b>F(r)$ and $t\in (0,1)$. We need to show that

752978EE01F6 21.11.14
\begin{equation} F(tn+(1-t)r)<ta+(1-t)b. \end{equation}

By definition, there are $j_ n,j_ r\in I$ such that $a>F_ i(n)$ for $i\geq j_ n$ and $b>F_ i(r)$ for $i\geq j_ r$. Since $I$ is directed, we can find $j\in I$ dominating both $j_ n$ and $j_ r$, and then for any $i\geq j$, we have

\[ a>F_ i(n),\quad b>F_ i(r). \]

It follows from 21.11.4 that

\[ F_ i(tn+(1-t)r)<ta+(1-t)b \]

for any $i\geq j$. Since $F_ i$ is decreasing in $i$, we conclude (21.11.14). $\square$

Definition 21.11.15.61B746F5E884 Let $F\in \mathrm{Conv}(N)$. The closure $\operatorname{cl}F\in \mathrm{Conv}(N)$ of $F$ is defined as follows: If $F(n)=-\infty $ for some $n\in N$, then $\operatorname{cl}F\coloneqq -\infty $. Otherwise, we define $\operatorname{cl}F$ as the lower semicontinuity regularization of $F$.

A convex function $F\in \mathrm{Conv}(N)$ is closed if $F=\operatorname{cl}F$. In other words, $F\in \mathrm{Conv}(N)$ is closed if one of the following conditions holds:

  1. 9B2264291DE3

    $F\equiv -\infty $;

  2. 55523AC55CA5

    $F\equiv \infty $;

  3. C1225E82131E

    $F$ is proper and lower semicontinuous.

Proposition 21.11.16.E013E1966E44Let $F\in \mathrm{Conv}(N)$ be a closed convex function. Then $F$ is the supremum of all affine functions lying below $F$.

Proof. For a closed proper $F$, finite-dimensional Fenchel duality gives \[F(x)=F^{**}(x)=\sup_p\{\langle p,x\rangle-F^*(p)\}.\] For every $p$ with $F^*(p)<+\infty$, the expression in braces is an affine minorant of $F$, by the definition of conjugacy. Conversely, every affine minorant $\langle p,x\rangle+c$ satisfies $c\leq-F^*(p)$. Thus the supremum is exactly that of all affine minorants. If $F\equiv+\infty$, arbitrary constant minorants already have supremum $+\infty$. If $F\equiv-\infty$, there are no finite affine minorants and their supremum is $-\infty$.

See [Theorem 12.1, Roc70].

Theorem 21.11.17.7E0B71CF3B0E Let $F\in \mathrm{Conv}^{\mathrm{prop}}(N)$. Then $\operatorname{cl}F$ is a closed proper convex function. Moreover, $\operatorname{cl}F$ agrees with $F$ except possibly on the relative boundary of $\operatorname{Dom}F$.

Proof. Apply the closure theorem for proper convex functions. It proves that the lower semicontinuous regularization of $F$ is closed and proper and agrees with $F$ on the relative interior of its effective domain. Since $F$ is proper, this regularization is exactly the closure defined here.

Outside the closure of $\operatorname{Dom}F$, both functions are $+\infty$: a neighborhood misses the effective domain, so the lower semicontinuous regularization is $+\infty$ there. Every remaining point outside the relative boundary belongs to the relative interior of the domain. Therefore disagreement is possible only on that relative boundary, as asserted.

See [Theorem 7.4, Roc70].

Proposition 21.11.18.B6B15657CD64 Let $F,F'\in \mathrm{Conv}(N)$ be closed convex functions. Assume that

  1. A4BAF58116DC

    $\operatorname{RelInt}\operatorname{Dom}F=\operatorname{RelInt}\operatorname{Dom}F'$, and

  2. FAD3EA2C74FA

    $F=F'$ on $\operatorname{RelInt}\operatorname{Dom}F$.

Then $F=F'$.

Proof. For proper closed functions this is the uniqueness assertion in the convex closure theorem. More explicitly, the closure of the epigraph over the relative interior of the effective domain is the whole epigraph: for a point of the epigraph, take convex combinations with a fixed epigraph point whose base is in that relative interior, and let the coefficient of the fixed point tend to zero. Thus identical values on the common relative interior give identical epigraphs and hence identical functions.

The improper cases in the definition of closedness are also determined: empty effective domain means the function identically $+\infty$; if one function is identically $-\infty$, the common relative interior is $N$ and the value agreement makes the other identical to it. These cases complete the proof.

This is a special case of [Corollary 7.3.4, Roc70].

Definition 21.11.19.CC63E6A637E8 Given $F,F'\in \mathrm{Conv}(N)$, we write $F\preceq F'$ if there is $C\in \mathbb {R}$ such that

\[ F\leq F'+C. \]

We say $F\sim F'$ if $F\preceq F'$ and $F'\preceq F$ both hold.

Theorem 21.11.20.A7E9B5A114CA Let $C\subseteq N$ be an open subset. Let $(f_ i)_{i>0}$ be a sequence of real-valued convex functions on $C$. Suppose that the sequence converges on a dense subset of $C$ and the limit is finite. Then the limit

\[ f(x)\coloneqq \lim _{i\to \infty } f_ i(x) \]

exists for all $x\in C$ and is convex on $C$. Moreover, the sequence $(f_ i)_ i$ converges uniformly to $f$ on each compact subset of $C$.

Proof. On every open convex ball relatively compact in $C$, dense convergence for finite convex functions applies to the restriction of the given dense set and supplies a finite convex local limit with locally uniform convergence. Local limits agree on overlaps, because they are pointwise limits of the same sequence. They therefore define a finite function $f$ on $C$.

Every compact subset of $C$ is covered by finitely many smaller such balls. Taking the maximum of the finitely many uniform error bounds proves uniform convergence on that compact set. Passing to the limit in each convexity inequality proves convexity wherever the corresponding segment lies in $C$; in the usual convention that the domain of a convex function is convex, this is convexity on $C$. In particular the limiting values at the original dense set determine $f$ uniquely.

This is a special case of [Theorem 10.8, Roc70].
Cite this page

Comments

Corrections, questions, and mathematical discussion are welcome. Sign in with GitHub to comment. Comments are public.