"(somebody's) business" means decisions or details that that person is connected to and responsible for. The idea is that certain decisions are only one person's to make, and other people should not give advice or opinions on these topics. Stated positively, it's:
That's my business.
It's none of my business.