This is a set expression. When someone complains about doing something difficult, boring or unpleasant, you can tell them this:

Life's not all fun and games, you know.

The meaning of the phrase is that you can't have fun all the time; you have to work hard sometimes.