This means to do what you said you'd do, or do what you promised.
You can express what you're following through by using "follow through on ___":
Are you going to follow through on your promise?
You can express what the promise was using "(someone's) promise to ___"
I'm starting to think that she might not follow through on her promise to pay us back.