Hi Ahmed, welcome to PF!
Let me expand on Orodruin's answer.
The first thing I'd tell you, is that cosmology in popular treatments is rife with imprecise language that can easily confuse the reader if he's not especially careful. That is not entirely a fault of the authors/speakers, as this highly abstract and mathematics-heavy field is hard, if not impossible, to describe unambiguously in words of everyday communication that shies away from equations and graphs.
Already I can see a number of misconceptions you've picked up. For example:
It is not correct to say that the universe is expanding at a velocity, be it constant or not. The universe is expanding at a
rate. It grows by a certain percentage over time. By analogy, it's equally incorrect to say it's expanding at velocity as it is to say that deposits on a savings account in a bank grow by a certain amount of $ (or whatever) per month - savings grow by some percentage per month. The exact amount varies depending on how much money you've deposited, and how long they had been there, but in all cases the percentage growth rate is the same.
So, in concrete terms, our universe is growing (currently) at about 1/144th of a percent per million years. That's how it should be understood - as a percentage growth, not a velocity (1/144th of a percent per million years is another way of writing the Hubble constant, by the way).
Hubble was first to notice that there is such a rate of growth. He noticed that a galaxy twice as far would recede twice as fast. In the same way as twice as much money in a bank will grow by twice the amount as it otherwise would. The discovery of importance here is not the amount of recession/growth (specific to anyone single galaxy only), but the overall rate of recession that can be deduced from those individual measurements.
The famous observation is represented by this graph:
where the circles are individual galaxies (nebulae, as they were classified back then).
The general trend of velocities increasing the farther away the galaxy is can be observed.
As Orodruin mentioned, the changing rate of growth is a recent (the last two decades) discovery.
Another misconception is that there is any directionality to the expansion. This is a natural conclusion when one imagines the universe as expanding from some concrete centre as if it were a big explosion of the kind we observe on Earth.
The universal expansion is indeed universal - it applies to every distance everywhere equally (same percentage growth rate), and does not have a centre. The big bang is not to be understood as an explosion seeding the empty space with matter, but as an already existing dense state of (possibly infinite) universe undergoing expansion, diluting and cooling. It did not happen at some point in space - it happened and still happens everywhere.
As such, all observers, regardless of where they are, see themselves as stationary, and all (far away) galaxies as receding from them. This is what the often-invoked balloon analogy tries to aid with visualising. If you pick any point on an expanding balloon's surface to be an observer, it'll measure every other point on the balloon as receding from it with velocity increasing with distance.
So, each point in the expanding universe is effectively stationary. As such, there is no associated acceleration imitating gravity, of the kind you'd experience in an elevator.
Finally, gravitationally-bound objects do not expand together with the rest of space, although I don't think you actually meant that (rather, you meant that Earth is a part of the expansion, being carried by it from some central point - which was addressed above).
You need to go beyond the scale of clusters of galaxies to observe the expansion.
This can be in a simplified way understood in terms of the escape velocity - from Hubble's graph (and Hubble Law generally), you can find the recession velocity of points some distance apart. The escape velocity is determined by all the mass contained in the radius equal to that distance. If the recession velocity is lower than the escape velocity thus calculated, the mass within that radius will remain gravitationally bound, and resist the expansion.
As mentioned before, the recession velocity becomes great enough only on large cosmological scales.
There are a lot of good materials to read on the subject available online, with varying level of complexity. One of the best, clearest, layman-oriented explanations of the current views on cosmology comes from a Scientific American article specifically addressing the most common misconceptions arising when first encountering the balloon analogy (but it has a broader appeal than just that). To be found here:
http://www.mso.anu.edu.au/~charley/papers/LineweaverDavisSciAm.pdf
We can direct you to more sources should you need them. Spending some time browsing the cosmology section of the forum, where similar questions have been often asked and responded to, might be also a good idea.