In fact, it's not uncommon for people to install ESXi on flash drives or SD Cards and have several copies lying around in case of a failure. Makes it easy to move things around as well.