When you're speaking formally and politely, you can say "yes" to someone like this:

Yes, sir.

Yes ma'am.

"Yes, sir" or "Yes, ma'am" would be appropriate for:

a customer service employee talking to a customer

a polite high school student speaking to the principal of his or her school

a polite person speaking to a stranger