Sup, inf convolution for convex functions
Let $\Omega$ be a bounded convex domain in $\mathbb{R}^n$. $f:\Omega\rightarrow\mathbb{R}^n$. If $f$ is a convex function in $\Omega$, then
$u$ is locally bounded and locally Lipschitz continuous. If $\partial_{x_i}f(x_0)$ exists at $x_0$, then $u$ is differentiable at $x_0$. By standard analysis, there exists a hyperplande $L_{x_0}(x)$ at any $x_0\in\Omega$. Now we any get a clearly picture to see that $u$ is differentiable at $x_0\in\Omega$.
Suppose $u$ is convex function in $\Omega$ and $u\in C(\overline{\Omega})$, show that
\begin{align}
u^\epsilon(x)=\max_{y\in\bar{\Omega}}(u(y)-\frac{1}{\epsilon}|x-y|^2)
\end{align}
is also convex in $\Omega^\epsilon$.
Since we can not find a direct relevant reference for the proof, we give one here.
Assume that
\begin{align}
u^\epsilon(x_0)=u(y_0)-\frac{1}{\epsilon}|x_0-y_0|^2.
\end{align}
Let $L(y)=u(y_0)+p(y-y_0)$ be the support plane at $y_0$, then we have
\begin{align}
u^\epsilon(x)&\geq u(y)-\frac{1}{\epsilon}|x-y|^2\\
&\geq u(y_0)+p_{y_0}(y-y_0)-\frac{1}{\epsilon}|x-y|^2\\
&= L_{y_0}(y)-\frac{1}{\epsilon}|x-y|^2
\end{align}
Therefore,
\begin{align}
u^\epsilon(x_0)&=L_{y_0}(y_0)-\frac{1}{\epsilon}|x_0-y_0|^2\\
u^\epsilon(x)&\geq L_{y_0}(y)-\frac{1}{\epsilon}|x-y|^2.
\end{align}
The last inequality implies that
\begin{align}
u^\epsilon(x)\geq L_{y_0}(x-x_0+y_0)-\frac{1}{\epsilon}|x_0-y_0|^2.
\end{align}
Let
\begin{align}
l_{x_0}(x)&=L_{y_0}(x-x_0+y_0)-\frac{1}{\epsilon}|x_0-y_0|^2\\
&=u(y_0)-\frac{1}{\epsilon}|x_0-y_0|^2+p_0(x-x_0),
\end{align}
then
\begin{align}
u^\epsilon(x_0)=l_{x_0}(x_0),\\
u^\epsilon(x)\geq l_{x_0}(x).
\end{align}
Hence, $u^\epsilon(x)$ is convex in $\Omega_\epsilon$.
Similarly, we can prove that $u_\epsilon$ is also convex. But the proof is different, I don't know why?
Suppose $u$ is convex function, show that
\begin{align}
u^\epsilon(x)=\min_{y\in\bar{\Omega}}(u(y)+\frac{1}{\epsilon}|x-y|^2)
\end{align}
is also convex in $\Omega^\epsilon$.
For any $x_1,x_2\in\Omega^\epsilon$, we have
\begin{align}
u^\epsilon(x_1)=u(y_1)+\frac{1}{\epsilon}|x_1-y_1|^2,\\
u^\epsilon(x_2)=u(y_2)+\frac{1}{\epsilon}|x_2-y_2|^2,
\end{align}
where $y_1,y_2\in\Omega$.
By convexity, for any $\lambda\in(0,1)$, we have
\begin{align*}
\lambda u^\epsilon(x_1)+(1-\lambda)u^\epsilon(x_2)&=\lambda u(y_1)+(1-\lambda)u(y_2)\\
&~~~~+\lambda\frac{1}{\epsilon}|x_1-y_1|^2
+(1-\lambda)\frac{1}{\epsilon}|x_2-y_2|^2\\
&\geq u(\lambda y_1+(1-\lambda)y_2)+\frac{1}{\epsilon}|\lambda x_1+(1-\lambda)x_2-(\lambda y_1+(1-\lambda)y_2)|^2\\
&\geq \min_{y\in\bar{\Omega}}(u(y)+\frac{1}{\epsilon}|\lambda x_1+(1-\lambda)x_2-y|^2)\\
=&u^\epsilon(\lambda x_1+(1-\lambda)x_2).
\end{align*}
Hence, $u^\epsilon(x)$ is convex.
Sup, inf convolution for convex functions的更多相关文章
- Understanding Convolution in Deep Learning
Understanding Convolution in Deep Learning Convolution is probably the most important concept in dee ...
- 【Convex Optimization (by Boyd) 学习笔记】Chapter 1 - Mathematical Optimization
以下笔记参考自Boyd老师的教材[Convex Optimization]. I. Mathematical Optimization 1.1 定义 数学优化问题(Mathematical Optim ...
- Spatial convolution
小结: 1.卷积广泛存在与物理设备.计算机程序的smoothing平滑.sharpening锐化过程: 空间卷积可应用在图像处理中:函数f(原图像)经过滤器函数g形成新函数f-g(平滑化或锐利化的新图 ...
- Convex optimization 凸优化
zh.wikipedia.org/wiki/凸優化 以下问题都是凸优化问题,或可以通过改变变量而转化为凸优化问题:[5] 最小二乘 线性规划 线性约束的二次规划 半正定规划 Convex functi ...
- Android+TensorFlow+CNN+MNIST 手写数字识别实现
Android+TensorFlow+CNN+MNIST 手写数字识别实现 SkySeraph 2018 Email:skyseraph00#163.com 更多精彩请直接访问SkySeraph个人站 ...
- 【论文翻译】NIN层论文中英对照翻译--(Network In Network)
[论文翻译]NIN层论文中英对照翻译--(Network In Network) [开始时间]2018.09.27 [完成时间]2018.10.03 [论文翻译]NIN层论文中英对照翻译--(Netw ...
- CCJ PRML Study Note - Chapter 1.6 : Information Theory
Chapter 1.6 : Information Theory Chapter 1.6 : Information Theory Christopher M. Bishop, PRML, C ...
- [BOOK] Applied Math and Machine Learning Basics
<Deep Learning> Ian Goodfellow Yoshua Bengio Aaron Courvill 关于此书Part One重难点的个人阅读笔记. 2.7 Eigend ...
- 【翻译】给初学者的 Neural Networks / 神经网络 介绍
本文翻译自 SATYA MALLICK 的 "Neural Networks : A 30,000 Feet View for Beginners" 原文链接: https:// ...
- Keras 自适应Learning Rate (LearningRateScheduler)
When training deep neural networks, it is often useful to reduce learning rate as the training progr ...
随机推荐
- jquery获得标签的值或元素的内容
例如: .html() 获取a标签中的i元素 console.error($("a[name=" + index + "]").html()); 设置a标签里的 ...
- php正方形图片转成成圆形图片-GD
/** * 剪切图片为圆形 * @param $picture 图片数据流 比如file_get_contents(imageurl)返回的东东 * @return 图片数据流 */ private ...
- js中各种事件监听
html.push('<input type="button" id="autocount_' + sysTime + '" class="la ...
- tabs 滑动效果
https://www.zhangxinxu.com/wordpress/2020/07/css-var-improve-components/ 伪类选择器 https://blog.csdn.net ...
- k8s之pod的生命周期
pod生命周期 和一个个独立的应用容器一样,Pod 也被认为是相对临时性(而不是长期存在)的实体. Pod 会被创建.赋予一个唯一的 ID(UID),并被调度到节点,并在终止(根据重启策略)或删除之前 ...
- python判断文件后缀名
endswith()方法 利用文件名或路径名对文件后缀进行判断,例如对文件名后缀是否为.jpg的文件进行判断. path = "file.jpg" bool = path.ends ...
- react 05 router
安装 npm i react-router-dom -- save<Router basename="/admin"> <Route path="/&q ...
- KU060板卡设计资料原理图第636篇:基于FMC的KU060高性能 PCIe 载板
基于FMC的KU060高性能 PCIe 载板 一.板卡概述 板卡主控芯片采用Xilinx 公司的 Kintex UltraScale系列FPGA XCKU060-2FFVA1156.板载 2 组 64 ...
- js获取的 后端的列表。
1.引号被转码 处理办法 {% autoescape off %} var tmp = '{{ data1 }}'; var tmp = '{{ data2 }}'; {% endautoescape ...
- Unity C#for和foreach效率比较
下面是代码自己测试一下即可 using System.Collections; using System.Collections.Generic; using UnityEngine; public ...