# All Posts | Page 0

Post #18
##### Selected Topics on Gradient Descent Method

book Public Date: 2020-10-03 11:46:24.715138

update Update Date: 2020-10-03 11:55:58.532449

In this post, we basically extend the discussions in Optimization Learning Notes 6 on Gradient Descent Method (GDM).
More on Descent Direction
We have already seen that Descent Direction is a important concept of GDM. However, why do we choose the negative...

Post #17
##### Selected Topics on Convexity

book Public Date: 2020-10-01 18:17:45.994530

update Update Date: 2020-10-01 18:26:56.209455

We are going to have a look at some advanced topics Optimality Conditions for Unconstrained Optimization Problems
on convexity, gradient descent and other related stuffs.
Fréchet Differentiability
Fréchet Differentiatio...

Post #16
##### Past Today and Future

book Public Date: 2020-09-30 17:54:06.856069

update Update Date: 2020-09-30 17:59:46.522623

I remembered there was a day during the last summer vacation when many things went wrong and I just felt too sorrow to do anything else. So I started this post. Later, however, I found it too negative to publish so I just stopped writing at that time. Toda...

Post #15
##### Optimization Learning Notes 7

book Public Date: 2020-09-13 16:40:43.046931

update Update Date: 2020-09-13 16:40:43.046931

More on Newton's Method
Convergence Rate
Let $f$ be twice continuous differentiable and let $x^\ast$ be a local minimizer of $f$. For some given $\epsilon \gt 0$ assume that:
- there exists $\mu \gt 0$ with $\nabla^2 f(x) \succcurlyeq \mu I$ for any $x \in B_\epsilon(x^\ast)$...

Post #14
##### Write a BF Compiler with Joy

book Public Date: 2020-08-13 16:12:06.150016

update Update Date: 2020-08-15 18:06:17.022984

This post is written to be a tutorial and show case of PEG parser, LLVM and C++ practices.
Before the Journey
is the main language used in this post and  is the build tool. I will assume you have learned basic knowledge of  and .
The related repo is publi...