You can say this about something that moves a little when you push it or step on it.
Oops! This table isn’t steady. Can we put something under the leg?
Watch out-- that floor board isn’t steady.
You should also know the phrase "hold (something) steady":