The main issue with VPN is throughput and risk of data loss on disconnect. The main issue with transferring physical machines is convenience and liability. I sort of see Terminal Server/Remote Desktop/LMI as a balance between the two.

You could get a dual WAN router at both offices to ensure uptime and reliability. Maybe use a cell phone as the second WAN or in case of emergency. That's when you definitely want to use Remote Desktop because LogMeIn needs more bandwith.