Most of the times we see how some assumptions on objective function in an optimisation problem are implied. I will here discuss some interesting results regarding how some assumptions on objective function help us get some nice convergence rate in an optimisation problem in different scenerios, few of them I learnt in my courses and few from some books and papers.

Let’s start with some simple assumptions. Assume a function is lipschitz continuous and convex.