When food or drinks "have a funny taste", it means that they taste like there's something wrong with them.

"Funny" can mean "bad", "wrong", or "strange" in some situations. It has this meaning in these phrases:

Something smells funny.

She's been acting funny lately.