"I've got to hand it to you" means "I have to recognize your accomplishments.
You use this phrase to praise some who you don't usually praise, like:
- someone who you don't get along with
- someone who proved that you were wrong
You can also say "I have to hand it to you" and "You've got to hand it to (him/her/them/etc.)."