What is the lowest temp I should leave my heat set to when I am not at home?

I have natural gas and 4 zones. I don't want the pipes to freeze obviously. One plumber told me 62 degrees, but I am thinking why not 55? Thanks!