Consider function that has first and second derivatives at each point.
There are two finite difference approximations to its derivatives at a particular point :
[1]
Fig. 1
Intuitively (see Fig. 1),
[2]
Let
so that
Substituting
and
into (3) gives
i.e.,
See also “Deriving Finite Difference Approximations of the Derivatives“.