Tag: convexity | Page 0

Post #12
Optimization Learning Notes 6

book Public Date: 2020-08-08 12:48:20.617006

update Update Date: 2020-08-17 13:03:26.353419

With KKT-conditions, we have already got some powerful tools to analysis the local minimizers, but when is a local minimizer also a global one? In a special category of optimization problems, the convex optimization, this is always true. In the f...
Read More Raw Content

Post #17
Selected Topics on Convexity

book Public Date: 2020-10-01 18:17:45.994530

update Update Date: 2020-10-01 18:26:56.209455

We are going to have a look at some advanced topics Optimality Conditions for Unconstrained Optimization Problems
on convexity, gradient descent and other related stuffs. 
Additional Mathematics Background
Fréchet Differentiability
Fréchet Differentiatio...
Read More Raw Content

Post #18
Selected Topics on Gradient Descent Method

book Public Date: 2020-10-03 11:46:24.715138

update Update Date: 2020-10-03 11:55:58.532449

In this post, we basically extend the discussions in Optimization Learning Notes 6 on Gradient Descent Method (GDM).
More on Descent Direction
We have already seen that Descent Direction is a important concept of GDM. However, why do we choose the negative...
Read More Raw Content