All Posts | Page 0


Feel Lucky

Post #18
Selected Topics on Gradient Descent Method

book Public Date: 2020-10-03 11:46:24.715138

update Update Date: 2020-10-03 11:55:58.532449

In this post, we basically extend the discussions in Optimization Learning Notes 6 on Gradient Descent Method (GDM).
More on Descent Direction
We have already seen that Descent Direction is a important concept of GDM. However, why do we choose the negative...
Read More Raw Content

Post #17
Selected Topics on Convexity

book Public Date: 2020-10-01 18:17:45.994530

update Update Date: 2020-10-01 18:26:56.209455

We are going to have a look at some advanced topics Optimality Conditions for Unconstrained Optimization Problems
on convexity, gradient descent and other related stuffs. 
Additional Mathematics Background
Fréchet Differentiability
Fréchet Differentiatio...
Read More Raw Content

Post #16
Past Today and Future

book Public Date: 2020-09-30 17:54:06.856069

update Update Date: 2020-09-30 17:59:46.522623

I remembered there was a day during the last summer vacation when many things went wrong and I just felt too sorrow to do anything else. So I started this post. Later, however, I found it too negative to publish so I just stopped writing at that time. Toda...
Read More Raw Content

Post #15
Optimization Learning Notes 7

book Public Date: 2020-09-13 16:40:43.046931

update Update Date: 2020-09-13 16:40:43.046931

More on Newton's Method
Convergence Rate
Let $f$ be twice continuous differentiable and let $x^\ast$ be a local minimizer of $f$. For some given $\epsilon \gt 0$ assume that:
 - there exists $\mu \gt 0$ with $\nabla^2 f(x) \succcurlyeq \mu I$ for any $x \in B_\epsilon(x^\ast)$...
Read More Raw Content

Post #14
Write a BF Compiler with Joy

book Public Date: 2020-08-13 16:12:06.150016

update Update Date: 2020-08-15 18:06:17.022984

This post is written to be a tutorial and show case of PEG parser, LLVM and C++ practices.
Before the Journey
 is the main language used in this post and  is the build tool. I will assume you have learned basic knowledge of  and .
The related repo is publi...
Read More Raw Content