Monotone conjugacy on the half-line, and the convex functions built from a gauge #
Two correspondences that fit together. The first is conjugacy for nondecreasing convex functions of
one nonnegative variable: on that class the ordinary conjugate, cut back to the half-line, is again
such a function, and the operation is an involution. The second composes such a function with a
closed gauge on a vector space; the result is a convex function all of whose sublevel sets are
dilates of one another, and conjugacy on those functions is the first correspondence applied level
by level, with the gauge replaced by its polar. Specialising the half-line factor to ζ ↦ ζ^p / p
gives the functions positively homogeneous of degree p, whose conjugates are positively
homogeneous of the Hölder conjugate degree q; that the two powers are exchanged is Young's
inequality, read as a conjugacy.
Main definitions #
MonotoneHalfLineFn g—g : ℝ → ERealis+∞on the negative axis, nondecreasing on the half-line, convex, closed, and finite at the origin.IsGaugeLike f—f 0 = inf f, and the sublevel sets above that infimum are all positive multiples of one another.monotoneConj g— the monotone conjugateg⁺(s) = sup {t s - g t ∣ t ≥ 0}, itself taken to be+∞fors < 0.monotoneComp g k— the compositeg ∘ kof such agwith a[0, +∞]-valuedk, under the conventiong (+∞) = +∞.levelSup g α— the crossing levelsup {ζ ≥ 0 ∣ g ζ ≤ α}, the dilation factor of the sublevel set{g ∘ k ≤ α}.powHalfLine p,PosHomogeneousDeg p f,degGauge p f— the functionζ ↦ ζ^p / pof the half-line; the conditionf (λ x) = λ^p f xforλ > 0; and the gauge(p f)^{1/p}attached to such anf.
Main results #
monotoneHalfLineFn_monotoneConj,monotoneConj_monotoneConj— the class is stable undermonotoneConj, andg⁺⁺ = g(Theorem 12.4 in [^1]).closedProperConvexFn_monotoneComp,setOf_monotoneComp_le_eq_smul— for a non-constantg,g ∘ kis closed proper convex, and its sublevel sets are all dilates of{k ≤ 1}.conj_monotoneComp—(g ∘ k)* = g⁺ ∘ k°for a closed gaugek.monotoneConj_powHalfLine—(ζ ↦ ζ^p / p)⁺ = (σ ↦ σ^q / q).posHomogeneousDeg_iff_exists_isGauge— a closed proper convex function is positively homogeneous of degreepexactly when it is(1/p) k^pfor a closed gaugek.conj_monotoneComp_powHalfLine,polarGauge_degGauge,pairing_le_rpow_mul_rpow,polarSet_setOf_le_inv— the conjugate of(1/p) k^pis(1/q) (k°)^q, the gauges(p f)^{1/p}and(q f*)^{1/q}are polar, and the level sets{f ≤ 1/p}and{f* ≤ 1/q}are polar sets.closedProperConvexFn_and_isGaugeLike_iff— a function is closed proper convex and gauge-like exactly when it isg ∘ kfor a closed gaugekand a non-constantMonotoneHalfLineFn g(Theorem 15.3 in [^1]).IsGaugeLike.exists_eq_monotoneCompis the reconstruction half.
Implementation notes #
A MonotoneHalfLineFn may be constant, and then g ∘ k need not be closed: its sublevel sets
are dom k, which for a closed gauge can fail to be closed. That is what the "non-constant"
hypothesis buys, and it enters only through MonotoneHalfLineFn.exists_monotoneConj_ne_top; the
conjugacy formula itself does not need it.
References #
[^1]: R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970, §12 and §15.
Restriction to a closed set #
Cutting a closed function down to a closed set leaves it closed.
The self-pairing of the line, flipped #
mulPairing is its own flip, but only propositionally, so the results stated against B.flip need
the flipped copy to be visible to instance search as well.
Nondecreasing convex functions on the half-line #
A nondecreasing closed convex function on the half-line: +∞ on the negative axis,
nondecreasing on [0, ∞), convex, closed, and finite at the origin.
Convexity and closedness are asked of g as a function on all of ℝ; because g is +∞ to the
left of the origin, that is the same as asking them on the half-line. This is exactly the class on
which monotone conjugacy is an involution.
gis+∞to the left of the origin.- monotoneOn : MonotoneOn g (Set.Ici 0)
gis nondecreasing on the half-line. - convex : ConvexFn g
gis convex. - closed : ClosedFn g
gis closed. gis finite at the origin.
Instances For
A function of this class never takes the value -∞: it is +∞ somewhere, so the exceptional
branch of clFn is excluded.
The infimum of g is attained at the origin.
g 0 is the least value of g.
A function of this class is proper.
The monotone conjugate #
The monotone conjugate g⁺(s) = sup {t s - g t ∣ t ≥ 0} of a function on the half-line.
Like g itself it is taken to be +∞ to the left of the origin, which is what makes the
operation an involution rather than a bijection onto a smaller class.
Equations
- Tdaf.ConvexAnalysis.monotoneConj g = Tdaf.ConvexAnalysis.restrict (Set.Ici 0) fun (s : ℝ) => ⨆ (t : ℝ), ⨆ (_ : 0 ≤ t), ↑(t * s) - g t
Instances For
On a function that is +∞ to the left of the origin, the supremum over the half-line and the
supremum over the whole line agree, so the monotone conjugate is the ordinary conjugate for
mulPairing, cut back to the half-line.
The conjugate is constant to the left of the origin, with the value -g 0.
The monotone conjugate at the origin is -g 0.
The class is stable under monotone conjugacy.
The negative half of the line contributes nothing to the biconjugate supremum at a nonnegative
argument: there g⁺ is constant, and the constant is already the value of the term at the origin.
This is the only place where the truncation in monotoneConj has to be undone.
Monotone conjugacy is an involution on the nondecreasing closed convex functions of one nonnegative variable that are finite at the origin.
The proof is the Fenchel–Moreau theorem for mulPairing together with iSup_sub_monotoneConj,
which says that truncating the conjugate to the half-line does not change the second conjugate at
a nonnegative argument.
Composing a gauge with a function on the half-line #
The composite g ∘ k of a function on the half-line with a [0, +∞]-valued function k,
with the convention g (+∞) = +∞.
Presenting the composite as an infimum over the real levels above k x avoids extending g to
EReal by hand — and hence a Decidable split — while making both defining equations one-line
consequences: monotoneComp g k x = g c when k x = c and g is nondecreasing on the half-line
(monotoneComp_of_eq_coe), and monotoneComp g k x = ⊤ when k x = ⊤
(monotoneComp_of_eq_top).
Equations
- Tdaf.ConvexAnalysis.monotoneComp g k x = ⨅ (t : ℝ), ⨅ (_ : k x ≤ ↑t), g t
Instances For
The defining formula for the composite.
The composite at a finite value of k: the infimum is attained at the level t = k x,
because g is nondecreasing on the half-line. No semicontinuity is involved.
Convexity and properness of the composite #
Composing preserves convexity. No monotonicity of g is needed: the infimum over the real
levels above k x already builds it in, and the strict form of convexity
(convexFn_iff_forall_lt) supplies a level for each side to be combined.
The composite is proper: it takes the value g 0 at the origin, which is finite, and it is
bounded below by g 0 everywhere.
Growth of a non-constant function of the half-line #
A convex nondecreasing function of the half-line that is not constant grows at least linearly, so
its monotone conjugate is finite at small positive arguments. That is the exact content of the
"non-constant" hypothesis: it is what makes g ∘ k closed.
A convex function of the half-line lies above the secant through the origin, extended.
If g 0 ≤ c₀ and r ≤ g t₂ with t₂ > 0, then g t ≥ c₀ + ((r - c₀) / t₂) t for t ≥ t₂.
A non-constant convex nondecreasing function of the half-line has an affine minorant of
positive slope, beyond the point where it first rises. This is the quantitative form of
"g (ζ) → +∞".
The monotone conjugate of a non-constant function of the half-line is finite somewhere on
the positive axis — it is finite at every ζ below the slope of the affine minorant.
The monotone conjugate of a function finite at a positive level is non-constant. The term
of the defining supremum at that level is an affine function of s with positive slope, so g⁺
grows without bound. Together with MonotoneHalfLineFn.exists_monotoneConj_ne_top this is
Rockafellar's "g⁺ satisfies the same conditions as g", and it shows that conjugacy exchanges
the two side conditions.
The set of levels at which a non-constant function of the half-line is below a given real
bound is bounded above: past the affine minorant, c₀ + m t ≤ α caps t.
A convex function of the half-line finite at some positive level is continuous from the right
at the origin, in the form needed here: every real level strictly above g 0 is already attained
at some positive argument. Without finiteness at a positive level g may jump to +∞ at once.
The sublevel sets of g ∘ k are dilates of one another #
This is the geometric content of Rockafellar's "gauge-like": every sublevel set {g ∘ k ≤ α} with
α above the minimum is the dilate λ • {k ≤ 1}, with λ the crossing level of g at α.
The sublevel sets of g ∘ k are the sublevel sets of k, at the crossing level.
The sublevel sets of g ∘ k are dilates of {k ≤ 1} — Rockafellar's "gauge-like", for
the composite of a closed gauge with a non-constant nondecreasing closed convex function of the
half-line finite at some positive level.
The conjugate of a gauge composed with a function on the half-line #
The composite g ∘ k of a closed gauge with a nondecreasing closed convex function on the
half-line is conjugate to the composite of the polar gauge with the monotone conjugate. The proof
regroups the supremum defining the conjugate by the level ζ = k x: on the dilate ζ • {k ≤ 1}
the composite is at most g ζ, and the supremum of the pairing over that dilate is ζ k°(y).
Closedness of k enters only through conj_monotoneComp_le.
Where a gauge vanishes the pairing is nonpositive, provided the polar gauge is finite there.
The set {k = 0} is the recession cone of {k ≤ 1} and not in general {0}, so the bound has to
be obtained by scaling: k (l⁻¹ • x) = 0 ≤ 1 for every l > 0, whence ⟨x, y⟩ ≤ l k°(y), and
letting l shrink gives ⟨x, y⟩ ≤ 0. Finiteness of k°(y) is essential — in EReal,
0 * (+∞) = 0.
The core lower bound. On the dilate ζ • {k ≤ 1} the composite g ∘ k
is at most g ζ, and the supremum of the pairing over that dilate is ζ k°(y); so
ζ k°(y) - g ζ is a lower bound for the conjugate of g ∘ k, at every level ζ > 0 where g is
finite.
Nothing is assumed about g beyond finiteness at the single level ζ, and nothing about k
beyond its being a gauge. This one lemma supplies both the ≥ half of the conjugacy formula and,
at a point where the polar gauge is +∞, the degeneracy that forces the conjugate to be +∞
there.
The origin realises the level ζ = 0 of the computation, since a gauge vanishes there.
The ≥ half of the conjugacy formula, at a point where the polar gauge is finite.
The Cauchy–Schwarz inequality for a gauge and its polar: ⟨x, y⟩ ≤ k(x) k°(y) wherever
both sides are finite.
For k(x) > 0 this is the level-set description of a closed gauge, x ∈ k(x) • {k ≤ 1}, together
with the identification of k° as the support function of {k ≤ 1}. For k(x) = 0 the product
would be 0 · k°(y), and the bound is pairing_nonpos_of_gauge_eq_zero.
The ≤ half of the conjugacy formula, at a point where the polar gauge is finite.
The supremum over x is regrouped by the level ζ = k x, and on each level the pairing is bounded
by pairing_le_mul_of_gauge.
The conjugacy formula: for a closed gauge k and a nondecreasing closed convex g on the
half-line that is finite at some positive level, the conjugate of g ∘ k is g⁺ ∘ k°.
The finiteness hypothesis is used only where k°(y) = +∞, to force the conjugate to be +∞
there; both halves of the finite case hold without it. It cannot be dropped: for g the indicator
of {0} the left-hand side is δ*(· ∣ {k ≤ 0}), which vanishes on the polar of the recession cone
of {k ≤ 1}, while the right-hand side is +∞ off the barrier cone of {k ≤ 1}, and those two
cones differ.
Neither compatibility nor continuity of the pairing is needed, and g need not be non-constant;
the topology on E enters only through the closedness of k.
g ∘ k is a closed proper convex function #
Closedness is obtained the way the book obtains it: by applying the conjugacy formula twice.
(g ∘ k)** = g⁺⁺ ∘ k°° = g ∘ k, and a convex function equal to its own biconjugate is closed. The
second application needs g⁺ to be finite somewhere on the positive axis, which is exactly what
g non-constant provides.
g ∘ k is closed, for a closed gauge k and a non-constant nondecreasing closed convex
g on the half-line finite at some positive level.
Non-constancy is essential and is exactly what the proof consumes, through
MonotoneHalfLineFn.exists_monotoneConj_ne_top: for constant g the composite is g 0 on
dom k and +∞ off it, and dom k need not be closed.
g ∘ k is a closed proper convex function.
The powers of the half-line #
ζ ↦ ζ^p / p for 1 < p < ∞. Under monotone conjugacy these functions are permuted by
p ↦ q, the Hölder conjugate exponent; that is Young's inequality, read as a conjugacy.
The function ζ ↦ ζ^p / p of the half-line, extended by +∞ to the negative axis.
Equations
- Tdaf.ConvexAnalysis.powHalfLine p = Tdaf.ConvexAnalysis.restrict (Set.Ici 0) fun (ζ : ℝ) => ↑(ζ ^ p / p)
Instances For
ζ ↦ ζ^p / p is nondecreasing on the half-line.
ζ ↦ ζ^p / p is a nondecreasing closed convex function of the half-line, finite at the
origin — the class on which monotone conjugacy is an involution.
Young's inequality, as a conjugacy: the monotone conjugate of ζ ↦ ζ^p / p is
σ ↦ σ^q / q, for Hölder conjugate exponents p and q.
The supremum sup {ζ σ - ζ^p / p ∣ ζ ≥ 0} is bounded above by σ^q / q by Young's inequality and
attained at ζ = σ^{q-1}, where ζ σ = ζ^p = σ^q.
Positive homogeneity of degree p #
f (λ x) = λ^p f x for λ > 0. For 1 < p < ∞ these are exactly the functions (1/p) k^p of a
closed gauge k, and the gauge is recovered as (p f)^{1/p}.
A function is positively homogeneous of degree p when f (λ • x) = λ^p f x for every
λ > 0. Degree 1 is PosHomogeneous; as there, only positive scalars are constrained, so the
value at the origin is not determined.
Equations
Instances For
A convex function positively homogeneous of degree p > 1 that vanishes at the origin is
nonnegative. Convexity gives λ^p f x ≤ λ f x for 0 < λ < 1, and λ^p < λ there.
The composite (1/p) k^p of a gauge is positively homogeneous of degree p.
The gauge attached to a function positively homogeneous of degree p: (p f)^{1/p}, with
(+∞)^{1/p} = +∞.
Written through monotoneComp so that the two defining equations come for free: it is
(p a)^{1/p} where f takes the finite value a ≥ 0, and +∞ where f is.
Equations
- Tdaf.ConvexAnalysis.degGauge p f = Tdaf.ConvexAnalysis.monotoneComp (fun (a : ℝ) => ↑((p * a) ^ p⁻¹)) f
Instances For
(p f)^{1/p} is the Minkowski functional of {f ≤ 1/p}.
(p f)^{1/p} is a gauge. Convexity is not proved from the formula but read off from the
level set: (p f)^{1/p} is the Minkowski functional of the convex set {f ≤ 1/p}.
(p · (1/p) k^p)^{1/p} = k: the gauge is recovered from the composite, so the
representation is unique.
Homogeneity of degree p for closed functions #
Closedness is what pins the value at the origin, and with it the sign.
A closed proper function positively homogeneous of degree p > 0 vanishes at the origin.
Along a ray into the origin the values are λ^p f x₀ → 0, so the epigraph, being closed, contains
(0, 0); of the three values homogeneity allows at the origin, only 0 is ≤ 0.
(p f)^{1/p} is a closed gauge, being the Minkowski functional of the closed convex set
{f ≤ 1/p}.
The representation f = (1/p) [(p f)^{1/p}]^p of a closed proper convex function
positively homogeneous of degree p.
A closed proper convex function is positively homogeneous of degree p ∈ (1, ∞) exactly
when it is (1/p) k^p for a closed gauge k. The gauge is unique — it is (p f)^{1/p}, by
degGauge_monotoneComp_powHalfLine.
Conjugacy for the homogeneous functions of degree p #
Corollaries 15.3.1 and 15.3.2: [(1/p) k^p]* = (1/q) (k°)^q, the gauge (p f)^{1/p} is polar to
(q f*)^{1/q}, and the two unit level sets {f ≤ 1/p} and {f* ≤ 1/q} are polar sets.
[(1/p) k^p]* = (1/q) (k°)^q.
The conjugate of a closed proper convex function positively homogeneous of degree p is
(1/q) (k°)^q for the gauge k = (p f)^{1/p} — in particular it is positively homogeneous of
degree q.
(p f)^{1/p} is a closed gauge whose polar is (q f*)^{1/q}.
The Hölder-type inequality ⟨x, y⟩ ≤ [p f(x)]^{1/p} [q f*(y)]^{1/q} on
dom f × dom f*.
The closed convex sets {f ≤ 1/p} and {f* ≤ 1/q} are polar to each other.
Gauge-like functions, and the converse half #
f is gauge-like when f 0 = inf f and the sublevel sets {f ≤ α} above that infimum are all
positive multiples of one set. setOf_monotoneComp_le_eq_smul says that g ∘ k is gauge-like;
here is the converse, that a gauge-like closed proper convex function is such a composite.
The gauge is the gauge of one sublevel set, k = γ(· | {f ≤ f 0 + 1}), and then every sublevel
set of f is a sublevel set of k (IsGaugeLike.exists_isGauge_setOf_le_eq); so f x depends on
x only through k x. The half-line factor is read off along a ray, g ζ = f (ζ • x₁) with
k x₁ = 1, which makes g convex and closed for free. Such a ray exists unless k takes only the
values 0 and +∞ — unless the sublevel sets are a single cone — in which case f is f 0 on
that cone and +∞ off it, and the half-line factor is the step function f 0 + δ(· | [0, 1]).
A gauge-like function, Rockafellar's term: the infimum of f is attained at the origin,
and the sublevel sets strictly above that infimum are all positive multiples of a single set.
The infimum of
fis attained at the origin.- exists_setOf_le_eq_smul : ∃ (C : Set E), ∀ (α : ℝ), f 0 < ↑α → ∃ (l : ℝ), 0 < l ∧ {x : E | f x ≤ ↑α} = l • C
The sublevel sets above the infimum are proportional to one another.
Instances For
The origin minimises a gauge-like function.
Any two sublevel sets above the infimum are positive multiples of each other — the form the reconstruction uses, with no reference to the auxiliary set.
f 0 is a real number, for a proper gauge-like f: it is finite below by properness, and
above because it is bounded by any value in the effective domain.
f is a nondecreasing function of k. If every sublevel set of f above its infimum
a₀ is a sublevel set of k, then k u ≤ k v forces f u ≤ f v.
f is +∞ wherever k is. Same hypotheses as le_of_forall_setOf_le_eq: a finite value
of f at u would put u in a sublevel set of k.
A gauge either takes the value 1 somewhere — supplying Rockafellar's ray — or takes only the
values 0 and +∞, in which case its sublevel sets are a single cone.
The gauge attached to a gauge-like function: the gauge of one sublevel set, of which every
sublevel set of f above the infimum is again a sublevel set.
The converse half: a gauge-like closed proper convex function is g ∘ k for a closed
gauge k and a non-constant nondecreasing closed convex function g of the half-line that is
finite at some positive level.
The forward half, in the packaging the converse produces: g ∘ k is gauge-like. This is
setOf_monotoneComp_le_eq_smul with the auxiliary set named.
The characterisation of gauge-like functions #
The two halves, assembled. The pairing enters only through the forward implication, where
closedness of g ∘ k comes from Fenchel–Moreau.
The conjugate of a gauge-like closed proper convex function is gauge-like too.
conj_monotoneComp says which composite it is; what has
to be checked is that g⁺ satisfies the same two side conditions as g, and conjugacy exchanges
them — g finite at a positive level makes g⁺ non-constant, and g non-constant makes g⁺
finite at a positive level.
A function is a gauge-like closed proper convex function exactly when it is g ∘ k for a
closed gauge k and a non-constant nondecreasing closed convex function g of the half-line which
is finite at some positive level.
The conjugacy formula that accompanies the theorem is conj_monotoneComp, (g ∘ k)* = g⁺ ∘ k°;
it needs neither the pairing hypotheses of the forward implication nor non-constancy.