Adam,
I can make a great case for either logging in and coming home to an empty inbox, or leaving the office at home and not intruding on your vacation. I waffle back and forth, and it really depends on how full may days are on vacation. If I'm just sitting on a recliner in the sun with iPad in hand, I may log on and work at my inbox. If I am having full days, no way.
Maybe the answer is to always vacation in places with no internet access.