Sup, inf convolution for convex functions
Let $\Omega$ be a bounded convex domain in $\mathbb{R}^n$. $f:\Omega\rightarrow\mathbb{R}^n$. If $f$ is a convex function in $\Omega$, then
$u$ is locally bounded and locally Lipschitz continuous. If $\partial_{x_i}f(x_0)$ exists at $x_0$, then $u$ is differentiable at $x_0$. By standard analysis, there exists a hyperplande $L_{x_0}(x)$ at any $x_0\in\Omega$. Now we any get a clearly picture to see that $u$ is differentiable at $x_0\in\Omega$.
Suppose $u$ is convex function in $\Omega$ and $u\in C(\overline{\Omega})$, show that
\begin{align}
u^\epsilon(x)=\max_{y\in\bar{\Omega}}(u(y)-\frac{1}{\epsilon}|x-y|^2)
\end{align}
is also convex in $\Omega^\epsilon$.
Since we can not find a direct relevant reference for the proof, we give one here.
Assume that
\begin{align}
u^\epsilon(x_0)=u(y_0)-\frac{1}{\epsilon}|x_0-y_0|^2.
\end{align}
Let $L(y)=u(y_0)+p(y-y_0)$ be the support plane at $y_0$, then we have
\begin{align}
u^\epsilon(x)&\geq u(y)-\frac{1}{\epsilon}|x-y|^2\\
&\geq u(y_0)+p_{y_0}(y-y_0)-\frac{1}{\epsilon}|x-y|^2\\
&= L_{y_0}(y)-\frac{1}{\epsilon}|x-y|^2
\end{align}
Therefore,
\begin{align}
u^\epsilon(x_0)&=L_{y_0}(y_0)-\frac{1}{\epsilon}|x_0-y_0|^2\\
u^\epsilon(x)&\geq L_{y_0}(y)-\frac{1}{\epsilon}|x-y|^2.
\end{align}
The last inequality implies that
\begin{align}
u^\epsilon(x)\geq L_{y_0}(x-x_0+y_0)-\frac{1}{\epsilon}|x_0-y_0|^2.
\end{align}
Let
\begin{align}
l_{x_0}(x)&=L_{y_0}(x-x_0+y_0)-\frac{1}{\epsilon}|x_0-y_0|^2\\
&=u(y_0)-\frac{1}{\epsilon}|x_0-y_0|^2+p_0(x-x_0),
\end{align}
then
\begin{align}
u^\epsilon(x_0)=l_{x_0}(x_0),\\
u^\epsilon(x)\geq l_{x_0}(x).
\end{align}
Hence, $u^\epsilon(x)$ is convex in $\Omega_\epsilon$.
Similarly, we can prove that $u_\epsilon$ is also convex. But the proof is different, I don't know why?
Suppose $u$ is convex function, show that
\begin{align}
u^\epsilon(x)=\min_{y\in\bar{\Omega}}(u(y)+\frac{1}{\epsilon}|x-y|^2)
\end{align}
is also convex in $\Omega^\epsilon$.
For any $x_1,x_2\in\Omega^\epsilon$, we have
\begin{align}
u^\epsilon(x_1)=u(y_1)+\frac{1}{\epsilon}|x_1-y_1|^2,\\
u^\epsilon(x_2)=u(y_2)+\frac{1}{\epsilon}|x_2-y_2|^2,
\end{align}
where $y_1,y_2\in\Omega$.
By convexity, for any $\lambda\in(0,1)$, we have
\begin{align*}
\lambda u^\epsilon(x_1)+(1-\lambda)u^\epsilon(x_2)&=\lambda u(y_1)+(1-\lambda)u(y_2)\\
&~~~~+\lambda\frac{1}{\epsilon}|x_1-y_1|^2
+(1-\lambda)\frac{1}{\epsilon}|x_2-y_2|^2\\
&\geq u(\lambda y_1+(1-\lambda)y_2)+\frac{1}{\epsilon}|\lambda x_1+(1-\lambda)x_2-(\lambda y_1+(1-\lambda)y_2)|^2\\
&\geq \min_{y\in\bar{\Omega}}(u(y)+\frac{1}{\epsilon}|\lambda x_1+(1-\lambda)x_2-y|^2)\\
=&u^\epsilon(\lambda x_1+(1-\lambda)x_2).
\end{align*}
Hence, $u^\epsilon(x)$ is convex.
Sup, inf convolution for convex functions的更多相关文章
- Understanding Convolution in Deep Learning
Understanding Convolution in Deep Learning Convolution is probably the most important concept in dee ...
- 【Convex Optimization (by Boyd) 学习笔记】Chapter 1 - Mathematical Optimization
以下笔记参考自Boyd老师的教材[Convex Optimization]. I. Mathematical Optimization 1.1 定义 数学优化问题(Mathematical Optim ...
- Spatial convolution
小结: 1.卷积广泛存在与物理设备.计算机程序的smoothing平滑.sharpening锐化过程: 空间卷积可应用在图像处理中:函数f(原图像)经过滤器函数g形成新函数f-g(平滑化或锐利化的新图 ...
- Convex optimization 凸优化
zh.wikipedia.org/wiki/凸優化 以下问题都是凸优化问题,或可以通过改变变量而转化为凸优化问题:[5] 最小二乘 线性规划 线性约束的二次规划 半正定规划 Convex functi ...
- Android+TensorFlow+CNN+MNIST 手写数字识别实现
Android+TensorFlow+CNN+MNIST 手写数字识别实现 SkySeraph 2018 Email:skyseraph00#163.com 更多精彩请直接访问SkySeraph个人站 ...
- 【论文翻译】NIN层论文中英对照翻译--(Network In Network)
[论文翻译]NIN层论文中英对照翻译--(Network In Network) [开始时间]2018.09.27 [完成时间]2018.10.03 [论文翻译]NIN层论文中英对照翻译--(Netw ...
- CCJ PRML Study Note - Chapter 1.6 : Information Theory
Chapter 1.6 : Information Theory Chapter 1.6 : Information Theory Christopher M. Bishop, PRML, C ...
- [BOOK] Applied Math and Machine Learning Basics
<Deep Learning> Ian Goodfellow Yoshua Bengio Aaron Courvill 关于此书Part One重难点的个人阅读笔记. 2.7 Eigend ...
- 【翻译】给初学者的 Neural Networks / 神经网络 介绍
本文翻译自 SATYA MALLICK 的 "Neural Networks : A 30,000 Feet View for Beginners" 原文链接: https:// ...
- Keras 自适应Learning Rate (LearningRateScheduler)
When training deep neural networks, it is often useful to reduce learning rate as the training progr ...
随机推荐
- oculus 安装其他盘方法
把安装文件OculusSetup.exe安装到D盘(默认直接按C盘) D:\softbackup\OculusSetup.exe /drive=D
- loj2839
除了 L 神 txdy 我还能说啥呢.(L 神把这题搬模拟赛了...) 即把每个 x 换成 ( 或 ),问是否能通过不多于一次区间反转(( 与 ) 交换)后合法. 考虑怎样的括号串是合法的. 假设左括 ...
- 下拉刷新 get请求 post请求 onLoad
"enablePullDownRefresh": true 下拉刷新之后背景颜色 "backgroundColor": "#efefef&qu ...
- 552. 学生出勤记录 II (Hard)
问题描述 552. 学生出勤记录 II (Hard) 可以用字符串表示一个学生的出勤记录,其中的每个字符用来标记当天的出勤情况(缺勤.迟到.到场).记录中只含下面三种字符: 'A':Absent,缺勤 ...
- K8s存储之Volume、PV、PVC、SC
Volume Volume(存储卷)是Pod中能够被多个容器访问的共享目录.Kubernetes的Volume概念.用途和目的与Docker的Volume比较类似,但两者不能等价.首先,Kuberne ...
- ES6判断对象是否为空
1.ES6判断对象是否为空{} let obj = {} if(Object.keys(obj).length == 0){ console.log("对象是空的") }else{ ...
- 【C学习笔记】day3-1 将数组A中的内容和数组B中的内容进行交换。(数组一样大)
#include <stdio.h> int main() { int a[5]; for (int i = 0; i < 5; i++) { scanf_s("%d&qu ...
- Git版本管理工具详细教程
一 Git初始化 下载安装, 下载地址: https://git-scm.com/downloads 每个系统的都有(linux.mac.windows等),看官网的安装教程,很详细,此处我以wind ...
- PCIe卡设计资料保存:536-基于ZU7EV的FMC 通用PCIe卡
基于ZU7EV的FMC 通用PCIe卡 一.板卡简介 基于3U PXIe的ZU11EG/ZU7EG/ZU7EV的通用 ,实现FMC的数据接口和主控计算,广泛应用于工业控制,检测,视觉处理.支持工业 ...
- 使用shell判断文件夹中是否包含文件
#!/bin/bash directory="/path/to/directory" if [ $(ls -A $directory) ]; then echo "有文件 ...