This is one way of saying "no" when someone asks you a question.
"No" sounds very final. "Not exactly" doesn't sound as complete and certain, so you can use it when the answer is 50% yes and 50% no:
A: Do you know how to get there?
B: Not exactly.