Sup, inf convolution for convex functions
Let $\Omega$ be a bounded convex domain in $\mathbb{R}^n$. $f:\Omega\rightarrow\mathbb{R}^n$. If $f$ is a convex function in $\Omega$, then
$u$ is locally bounded and locally Lipschitz continuous. If $\partial_{x_i}f(x_0)$ exists at $x_0$, then $u$ is differentiable at $x_0$. By standard analysis, there exists a hyperplande $L_{x_0}(x)$ at any $x_0\in\Omega$. Now we any get a clearly picture to see that $u$ is differentiable at $x_0\in\Omega$.
Suppose $u$ is convex function in $\Omega$ and $u\in C(\overline{\Omega})$, show that
\begin{align}
u^\epsilon(x)=\max_{y\in\bar{\Omega}}(u(y)-\frac{1}{\epsilon}|x-y|^2)
\end{align}
is also convex in $\Omega^\epsilon$.
Since we can not find a direct relevant reference for the proof, we give one here.
Assume that
\begin{align}
u^\epsilon(x_0)=u(y_0)-\frac{1}{\epsilon}|x_0-y_0|^2.
\end{align}
Let $L(y)=u(y_0)+p(y-y_0)$ be the support plane at $y_0$, then we have
\begin{align}
u^\epsilon(x)&\geq u(y)-\frac{1}{\epsilon}|x-y|^2\\
&\geq u(y_0)+p_{y_0}(y-y_0)-\frac{1}{\epsilon}|x-y|^2\\
&= L_{y_0}(y)-\frac{1}{\epsilon}|x-y|^2
\end{align}
Therefore,
\begin{align}
u^\epsilon(x_0)&=L_{y_0}(y_0)-\frac{1}{\epsilon}|x_0-y_0|^2\\
u^\epsilon(x)&\geq L_{y_0}(y)-\frac{1}{\epsilon}|x-y|^2.
\end{align}
The last inequality implies that
\begin{align}
u^\epsilon(x)\geq L_{y_0}(x-x_0+y_0)-\frac{1}{\epsilon}|x_0-y_0|^2.
\end{align}
Let
\begin{align}
l_{x_0}(x)&=L_{y_0}(x-x_0+y_0)-\frac{1}{\epsilon}|x_0-y_0|^2\\
&=u(y_0)-\frac{1}{\epsilon}|x_0-y_0|^2+p_0(x-x_0),
\end{align}
then
\begin{align}
u^\epsilon(x_0)=l_{x_0}(x_0),\\
u^\epsilon(x)\geq l_{x_0}(x).
\end{align}
Hence, $u^\epsilon(x)$ is convex in $\Omega_\epsilon$.
Similarly, we can prove that $u_\epsilon$ is also convex. But the proof is different, I don't know why?
Suppose $u$ is convex function, show that
\begin{align}
u^\epsilon(x)=\min_{y\in\bar{\Omega}}(u(y)+\frac{1}{\epsilon}|x-y|^2)
\end{align}
is also convex in $\Omega^\epsilon$.
For any $x_1,x_2\in\Omega^\epsilon$, we have
\begin{align}
u^\epsilon(x_1)=u(y_1)+\frac{1}{\epsilon}|x_1-y_1|^2,\\
u^\epsilon(x_2)=u(y_2)+\frac{1}{\epsilon}|x_2-y_2|^2,
\end{align}
where $y_1,y_2\in\Omega$.
By convexity, for any $\lambda\in(0,1)$, we have
\begin{align*}
\lambda u^\epsilon(x_1)+(1-\lambda)u^\epsilon(x_2)&=\lambda u(y_1)+(1-\lambda)u(y_2)\\
&~~~~+\lambda\frac{1}{\epsilon}|x_1-y_1|^2
+(1-\lambda)\frac{1}{\epsilon}|x_2-y_2|^2\\
&\geq u(\lambda y_1+(1-\lambda)y_2)+\frac{1}{\epsilon}|\lambda x_1+(1-\lambda)x_2-(\lambda y_1+(1-\lambda)y_2)|^2\\
&\geq \min_{y\in\bar{\Omega}}(u(y)+\frac{1}{\epsilon}|\lambda x_1+(1-\lambda)x_2-y|^2)\\
=&u^\epsilon(\lambda x_1+(1-\lambda)x_2).
\end{align*}
Hence, $u^\epsilon(x)$ is convex.
Sup, inf convolution for convex functions的更多相关文章
- Understanding Convolution in Deep Learning
Understanding Convolution in Deep Learning Convolution is probably the most important concept in dee ...
- 【Convex Optimization (by Boyd) 学习笔记】Chapter 1 - Mathematical Optimization
以下笔记参考自Boyd老师的教材[Convex Optimization]. I. Mathematical Optimization 1.1 定义 数学优化问题(Mathematical Optim ...
- Spatial convolution
小结: 1.卷积广泛存在与物理设备.计算机程序的smoothing平滑.sharpening锐化过程: 空间卷积可应用在图像处理中:函数f(原图像)经过滤器函数g形成新函数f-g(平滑化或锐利化的新图 ...
- Convex optimization 凸优化
zh.wikipedia.org/wiki/凸優化 以下问题都是凸优化问题,或可以通过改变变量而转化为凸优化问题:[5] 最小二乘 线性规划 线性约束的二次规划 半正定规划 Convex functi ...
- Android+TensorFlow+CNN+MNIST 手写数字识别实现
Android+TensorFlow+CNN+MNIST 手写数字识别实现 SkySeraph 2018 Email:skyseraph00#163.com 更多精彩请直接访问SkySeraph个人站 ...
- 【论文翻译】NIN层论文中英对照翻译--(Network In Network)
[论文翻译]NIN层论文中英对照翻译--(Network In Network) [开始时间]2018.09.27 [完成时间]2018.10.03 [论文翻译]NIN层论文中英对照翻译--(Netw ...
- CCJ PRML Study Note - Chapter 1.6 : Information Theory
Chapter 1.6 : Information Theory Chapter 1.6 : Information Theory Christopher M. Bishop, PRML, C ...
- [BOOK] Applied Math and Machine Learning Basics
<Deep Learning> Ian Goodfellow Yoshua Bengio Aaron Courvill 关于此书Part One重难点的个人阅读笔记. 2.7 Eigend ...
- 【翻译】给初学者的 Neural Networks / 神经网络 介绍
本文翻译自 SATYA MALLICK 的 "Neural Networks : A 30,000 Feet View for Beginners" 原文链接: https:// ...
- Keras 自适应Learning Rate (LearningRateScheduler)
When training deep neural networks, it is often useful to reduce learning rate as the training progr ...
随机推荐
- 记录C#学习过中看到的文章
1.DataRow 转实体类 https://www.cnblogs.com/macT/p/10878863.html https://www.cnblogs.com/yangboyu/archive ...
- ABAP 写入批次特征值以及更新批次特征值
需求 SAP启用了批次,需要在特征值中写入物料类型,区分该物料批次是用于研发的亦或是量产的,关于研发和量产标识我是坐在采购订单行项目增强中了,这里就不多赘述了,参考https://www.cnblog ...
- 新的学习历程-python2 print
1 print('hello world!') 2 print('hello','world!') #逗号自动添加默认的分隔符:空格 3 print('hello'+'world!') #加号表示字符 ...
- Java面向对象之创建对象内存分析
创建对象内存分析 代码 内存分析 属性 属性:字段Field 成员变量 默认初始化: 1.数字: 0 0.0 2.char: u0000 3.boolean:false 4.引用数据类型:null 5 ...
- 2022-05-11内部群每日三题-清辉PMP
1.一个低概率/高影响的技术风险发生了. 项目经理该怎么做? A. 提交变更请求来调整成本和进度基准 B. 进行风险审查,评估其对项目可交付成果的影响 C. 实施风险登记册中概述的减轻计划 D. 查询 ...
- Mysql昨天,上个月条件查询
1.查询昨日数据 SELECT * FROM test WHERE DATEDIFF(DATE_FORMAT(NOW(),'%Y%m%d'),DATE_FORMAT(created_time,'%Y% ...
- mysql函数实现oracle的序列
1.创建一张伪序列表 CREATE TABLE sequence ( seq_name VARCHAR (50) NOT NULL,-- 序列名称 current_val INT NOT NULL,- ...
- OS-lab2
OS-lab2 启动之后,我们的操作系统要能运行,需要一个载体,就是内存.内存的访问不是直接的,而是通过MMU完成.在完成MMU之前,我们先看看一些需要用到的宏定义和函数. include pmap. ...
- PyQt5模块说明
pyqt5的类别分为几个模块,包括以下: QtCoreQtGuiQtWidgetsQtMultimediaQtBluetoothQtNetworkQtPositioningEnginioQtWebSo ...
- 软件工程日报八——AlertDiatog的使用
今天学习了AlertDiatog的相关内容 AlertDialog可以在当前的界面上显示一个对话框,这个对话框是置顶于所有界面元素之上的,能够屏蔽掉其他控件的交互能力,因此AlertDialog一般是 ...