Why doesn't an object supported at its center of mass (gravity) spontaneously rotate?

As the earth rotates it would too, depending on which hemisphere you are in. Even if it were in a vacuum. However, it it were in space infinitely far from any mass it would find an equilibrium and thermodynamics would keep it that way.