This phrase is good for explaining how things were when you were a child. Its meaning is something like "When I was growing up,...":

Growing up, my family didn't have much money.

Growing up, I was a huge U2 fan.

This phrase is used in spoken English and in informal writing.