Covariant derivatives are specifically defined for tensors because they measure the change of vectors in a consistent manner across different points in a manifold. Since tensors at various points belong to distinct tensor spaces, ordinary derivatives cannot be applied without a connection to relate these spaces. The covariant derivative ensures that the results remain invariant under coordinate transformations. This construction is essential for maintaining the geometric properties of the manifold. Thus, using covariant derivatives with tensors is necessary for meaningful mathematical operations in differential geometry.