for perfect conductor :
conductivity is considered infinity ( σ = infinity ) , but do u know what is conductivity ?
1-it is the ratio between conduction current density ( J ) and electric field ( E ) >> ( σ = J/E )
2-but again , what is the conduction current density ( J ) >> it is the charge density ( ρ ) times the average velocity of the charges in a conductor ( U ) ( J = ρ * U )
3- and the charge density ( ρ ) = number of electrons ( Ne ) times the electron charge ( e ) ( ρ = Ne * e )
4- and again , what is the average speed U ? >> it is the electron mobility ( u ) times the electric field ( E ) ( U = u*E )
so the laws are :
( σ = J/E ) & ( J = ρ*U ) & ( ρ = Ne*e ) & ( U = u*E )
then :
σ = J/E = ( ρ*U )/E = ( Ne*e*u*E ) / E
then:
σ = Ne*e*u
where sigma is the conductivity , e is the electron charge , u is the electron mobility , so returning to the question:
u said "this argument implies that there are infinite charges inside the conductor" , yes it implies that σ = Ne*e*u = infinity , or the number of electrons is infinity , this doesn't happen in reality , that's why it's called " perfect conductor " .
in reality we can approximate some materials to be perfect conductors because ( as lalbatros said ) they need huge E in order to "use" all the electrons in the material to cancel this E field.
if the conductor wasn't considered perfect , there sure must exist some E field inside it , but again this E field is negligible unless it was very huge .
( i wish to know what will happen if the E field was very strong , will the conductor be ionized or what will happen , i don't know)
=)