Why don’t all the rocks roll off big mountains?

It is a matter of extreme scales between the size of a particle of dirt and the scale of atomic force.

The issue is how narrow of a scope of scale is available to you in human intuitive experience. The real universe is far far larger and far far smaller than what it seems.