It starts and ends on positive and negative charges by convention. The direction of the electric field is defined as the direction of force that the field applies on a positive test charge. Hence, the field points away from areas of net positive charge and towards areas of net negative charge.