This phrase means to remind someone of something that they used to know. You "refresh" someone's memory by giving them more information or reviewing things that they should already know.
You use "refresh ___'s memory" like this:
I couldn't remember what it was called. James had to refresh my memory.
Can you refresh my memory as to how to fill out this expense request form?
This phrase can be used in both casual and polite conversation.