You can make guesses about things that happened in the past with the phrase "must have ___":
A: Where are Deanna and Jun?
B: They must have left already.
People use "must have" when they have a pretty strong reason or evidence for thinking something. You don't use "must have" when you're just making a guess about something you don't know about.