The fact that you avoid the word "calculus" does not mean that you are not using it. You are using results from calculus when you say that the average velocity for constant acceleration is the average of the velocities at the end of the interval. It is not a self evident truth. The same for using the geometrical method. Arhimedes used it and even though he did not call it calculus, it was.
So it is true what
@berkeman said, you are still using calculus to justify the factor of 1/2.
I am not saying that it is not useful to show some sort of justification for students in non-calculus physics classes. You can easily justify the fact that the distance is not ##at^2## but a smaller fraction of this, due to the fact that the velocity was smaller than the final velocity during the motion. But the fact that the fraction is 1/2 and not 1/3 or any other requires the methods that we call "calculus". Whatever method you use to "justify" it, I think it is fair to tell the students that the result can be proven by mathematical methods they will learn later in calculus.