I don't like the idea of not having the ability to see patients in the hospital (although I may be forced to drop privileges with back-up call being so onerous).
Of course, there's nothing that says that you can't go by and pay your hospitalized patients a social call, if you like. I often drop in on my patients post-operatively, even when I'm not consulted to follow them medically.
You can even be involved in their care, paging the hospitalist and inquiring after your patient's well-being, and making sure they're being looked after properly. They don't stop being your patient.