I've had a look on the problem of a ball on a rotating circular track where the ball reaches a stable position at a fixed height that depends on the angular velocity and radius of the track only. For images and a video see https://www.leifiphysik.de/mechanik/kreisbewegung/versuche/kugel-rotierender-rinne (German language)
I do understand the derivation for the height $h=R-\frac{g}{\omega^2}$ and also understand that the derivation implicitly assumes $0\leq h\leq R$.
Taken together this suggests a lower bound for the angular velocity $\omega_\mathrm{min}=\sqrt{\frac{g}{R}}$ below which there is no stable motion. This value seems to correspond to the case where the gravitation force equals the centrifugal force at Radius $R$.
What I don't understand is the physical reason for such minimal angular speed and what it would have to do with rotation at radius $R$ (since in this case the radius of rotation would be closer to 0 than $R$). I imagine it has to do something with the forces, but don't really see how a minimum comes about.
One idea I had is that the shape of the track plays a role. Since it is rather flat in the center I would expect the normal force to be almost the same as the ball moves away from the center position, while the centrifugal force grows with $r^2$. However this is contrary to experiment, where the ball only starts to rise if the speed is sufficiently big.
