have a funny taste
When food or drinks "have a funny taste", it means that they taste like there's something wrong with them.
"Funny" can mean "bad", "wrong", or "strange" in some situations. It has this meaning in these phrases:
Something smells funny.
She's been acting funny lately.