en.wikipedia.org/wiki/Convex_combination 凸组合 In convex geometry, a convex combination is a linear combination of points (which can be vectors, scalars, or more generally points in an affine space) where all coefficients are non-negative and sum to 1.…

The author has a course on web: http://brickisland.net/DDGSpring2016/ It has more reading assignments and sliders which are good for you to understand ddg. ------------------------------------------------------------- DISCRETE DIFFERENTIAL GEOMETRY :…

Attention and Augmented Recurrent Neural Networks CHRIS OLAHGoogle Brain SHAN CARTERGoogle Brain Sept. 8 2016 Citation: Olah & Carter, 2016 Recurrent neural networks are one of the staples of deep learning, allowing neural networks to work with seque…

Regularized Linear Regression with scikit-learn Earlier we covered Ordinary Least Squares regression. In this posting we will build upon this foundation and introduce an important extension to linear regression, regularization, that makes it applicab…

Awesome-Pytorch-list 2018-08-10 09:25:16 This blog is copied from: https://github.com/Epsilon-Lee/Awesome-pytorch-list Pytorch & related libraries pytorch : Tensors and Dynamic neural networks in Python with strong GPU acceleration. pytorch extras :…

Visual Question Answering with Memory-Augmented Networks 2018-05-15 20:15:03 Motivation: 虽然 VQA 已经取得了很大的进步,但是这种方法依然对完全 general,freeform VQA 表现很差,作者认为是因为如下两点: 1. deep models trained with gradient based methods learn to respond to the majority of train…

Adam Kosiorek About Attention in Neural Networks and How to Use It this blog comes from: http://akosiorek.github.io/ml/2017/10/14/visual-attention.html  Oct 14, 2017 Attention mechanisms in neural networks, otherwise known as neural attention or just…

1 Which Programs can be Solved? This package lets you solve convex quadratic programs of the general form   in n real variables x=(x0,…,xn−1). Here, A is an m×n matrix (the constraint matrix), b is an m-dimensional vector (the right-hand side), ⋛ is…

哎.刚刚submit上paper比較心虚啊.无心学习.还是好好码码文字吧. subgradient介绍 subgradient中文名叫次梯度.和梯度一样,全然能够多放梯度使用.至于为什么叫子梯度,是由于有一些凸函数是不可导的,没法用梯度.所以subgradient就在这里使用了. 注意到.子梯度也是求解凸函数的.仅仅是凸函数不是处处可导. f:X→R是一个凸函数,X∈Rn是一个凸集. 若是f在x′处∇f(x′)可导.考虑一阶泰勒展开式: f(x)≥f(x′)+∇(f(x′)T(x−x′),∀x∈…

ICLR 2014 International Conference on Learning Representations Apr 14 - 16, 2014, Banff, Canada Workshop Track Submitted Papers Stochastic Gradient Estimate Variance in Contrastive Divergence and Persistent Contrastive Divergence Mathias Berglund, Ta…