This phrase is good for explaining how things were when you were a child. Its meaning is something like "When I was growing up,...":
Growing up, my family didn't have much money.
Growing up, I was a huge U2 fan.
This phrase is used in spoken English and in informal writing.