Are derivatives of vector valued functions tensors as well?
E.g. derivative of a fn from R^2 -> R is a vector. 2nd derivative is a matrix. 3rd derivative = tensor?
You can see it like that. If you consider the derivates as Tensors you can write the multidimensional variant of the Taylor expansion as
f(x+h) = f(x) + f'(x)(h) + (1/2) * f''(x)(h,h) + (1/6)f'''(x)(h,h,h)...
Remember my point about the rank n-Tensor being a multilinear real-valued function of n-vectors.
If you write H as the Hesse-Matrix you get the Tensor corresponding to f'' as
f''(v,w) = v * H * w^t.
In the above formula you evaluate it for v=h=w though.