Proof.
(1) The epigraph of a supremum is the intersection of the epigraphs. Let $(F_ i)$ be a decreasing net of convex functions with limit $F=\inf _ iF_ i$, let $x,y\in N_{\mathbb R}$ and $0<\lambda <1$, and let $a>F(x)$ and $b>F(y)$ be real numbers. Choose indices $i_1,i_2$ with $F_{i_1}(x)<a$ and $F_{i_2}(y)<b$, and an index $i$ following both. Then $F_ i(x)<a$ and $F_ i(y)<b$, and convexity of $\operatorname {epi}F_ i$ gives
\[ F((1-\lambda )x+\lambda y)\leq F_ i((1-\lambda )x+\lambda y)\leq (1-\lambda )a+\lambda b. \]
Since $a$ and $b$ are arbitrary, this shows that $\operatorname {epi}F$ is convex; this also covers the case where $F(x)$ or $F(y)$ equals $-\infty $.
(2) If $H(x)<a$ and $H(x')<a'$, we can choose admissible combinations for $x$ and $x'$ with values below $a$ and $a'$; mixing them with weights $1-\lambda $ and $\lambda $ gives an admissible combination for $(1-\lambda )x+\lambda x'$ with value below $(1-\lambda )a+\lambda a'$. Hence $H$ is convex. Combinations with $q=1$ show $H\leq F_ i$ for each $i$. If $G$ is convex and $G\leq F_ i$ for all $i$, then for every admissible combination the points $(x_ j,F_{i_ j}(x_ j))$ lie in $\operatorname {epi}G$, and so does their convex combination with the weights $\lambda _ j$, since a convex set contains the convex combinations of its points; that is,
\[ G\Bigl (\sum _ j\lambda _ jx_ j\Bigr )\leq \sum _ j\lambda _ jF_{i_ j}(x_ j). \]
Hence $G\leq H$. For the conjugate, the supremum defining $H^*(p)$ is the supremum over all admissible combinations of
\[ \Bigl \langle p,\sum _ j\lambda _ jx_ j\Bigr \rangle -\sum _ j\lambda _ jF_{i_ j}(x_ j)=\sum _ j\lambda _ j\bigl (\langle p,x_ j\rangle -F_{i_ j}(x_ j)\bigr )\leq \sup _ iF_ i^*(p), \]
and combinations with $q=1$ give equality. Since affine functions are convex, an affine function lies below $H$ if and only if it lies below $\inf _ iF_ i$. Suppose that $H$ has an affine minorant. Then $H$ is proper, so $\overline H$ is a closed proper convex function by proposition 21.2.6, and $\overline H=H^{**}=(\sup _ iF_ i^*)^*$ by theorem 21.3.2. A lower semicontinuous convex function below $\inf _ iF_ i$ lies below $H$, and therefore below $\overline H$.
(3) Convexity of $F\mathbin \square G$ follows as in (2), by mixing decompositions $x=y+z$ and $x'=y'+z'$ whose values $F(y)+G(z)$ are close to the infima. The two suprema over $y$ and $z$ in
\[ (F\mathbin \square G)^*(p)=\sup _{y,z}\bigl (\langle p,y\rangle -F(y)+\langle p,z\rangle -G(z)\bigr )=F^*(p)+G^*(p) \]
are independent, which gives the conjugate formula.
(4) If $n=0$, then $F$ and $G$ are constants and both sides equal $-F(0)-G(0)$; so let $n\geq 1$. Let $J(p)=\inf _{q+r=p}(F^*(q)+G^*(r))$. Each conjugate is bounded below by minus its value at the origin: $F^*\geq -F(0)$ and $G^*\geq -G(0)$. Moreover, for every $R>0$, choosing $x$ with $|x|=R$ and $\langle q,x\rangle =R|q|$ gives
\[ F^*(q)\geq R|q|-\max _{|x|\leq R}F(x), \]
and the analogous bound holds for $G^*$. Consequently, if $p$ stays bounded and $F^*(q)+G^*(r)$ stays bounded above, then $q$ and $r=p-q$ stay bounded: for instance $F^*(q)\leq F^*(q)+G^*(r)+G(0)$, and the last bound with $R=1$ controls $|q|$. Lower semicontinuity of $F^*$ and $G^*$ therefore implies that the infimum defining $J(p)$ is attained whenever it is finite: a minimizing sequence of decompositions has a convergent subsequence. The same argument, applied to $p_ k\to p$ and decompositions attaining $J(p_ k)$, shows that $J$ is lower semicontinuous. By (3), $J=F^*\mathbin \square G^*$ is convex; it is bounded below by $-F(0)-G(0)$, and it is proper, since $J(q_0+r_0)\leq F^*(q_0)+G^*(r_0)<+\infty $ for subgradients $q_0\in \partial F(0)$ and $r_0\in \partial G(0)$. Finite convex functions are continuous, so $F$ and $G$ are closed and $F^{**}=F$, $G^{**}=G$. By (3), $J^*=F^{**}+G^{**}=F+G$, and theorem 21.3.2 gives $J=J^{**}=(F+G)^*$.
$\square$
Comments
Corrections, questions, and mathematical discussion are welcome. Sign in with GitHub to comment. Comments are public.