If f:\mathbb R\rightarrow\mathbb R, then df:\mathbb R^2\rightarrow\mathbb R is defined by
df(x,h)=f'(x)h
Sometimes the h is written as "dx", and df(x,h) as "dy", so that the expression above becomes
dy=f'(x)dx
Note that h=dx doesn't have to be "small" for this to be well-defined. It does however have to be small for f'(x)dx to be a good approximation of f(x+dx)-f(x) since
f(x+h)=f(x)+hf'(x)+\frac 1 2 h^2f''(x)+\mathcal O(h^3)
when h\rightarrow 0.
\Delta x is the same as h=dx, i.e. it's just a number. \Delta y or \Delta f is the actual change of the value of the function f, i.e.
\Delta f=f(x+h)-f(x)
so \Delta x=dx, but \Delta y\approx dy with \Delta y-dy\rightarrow 0 when dx\rightarrow 0.
The lowercase delta is used in the calculus of variations. See e.g. the Wikipedia definition of a
functional derivative. I'm not sure if it's used outside of that context.
I don't think I have ever seen the expression \partial x defined, or even
used other than as a part of the expression for a partial derivative:
D_if(x)=f_{,i}(x)=\frac{\partial}{\partial x}f(x)=\frac{\partial f(x)}{\partial x}
The expression \partial_\mu is however used in differential geometry, as a short version of \partial/\partial x^\mu, a partial derivative operator constructed from some coordinate system x:U\rightarrow\mathbb R^n, where U is an open subset of the manifold.
\partial_\mu|_p f=\frac{\partial}{\partial x^\mu}\bigg|_p f=(f\circ x^{-1})_{,\mu}(x(p))
There are few things in the physics literature that I find as confusing as the use of the word "infinitesimal". It took me some time to realize that when the word "infinitesimal" is used (in a physics book), the relevant variables aren't infinitesimals at all, and do not even need to be "small" in any sense of the word. The
only thing that the word "infinitesimal" represents in a physics book is that the equation that follows the word "infinitesimal" has been Taylor expanded around 0 and only the terms up to some finite order in the variables have been kept. Physicists apparently use the word "infinitesimal" only to avoid having to use the "big O" notation.