Boot From Usb on an Old Pc Without Modding the BIOS: I spend most of my spare time testing new linux based distros so I have already burnt a huge stack of Live CDs which also cost a lot of money.Yes, you have to leave the USB memory stick there for every boot. Use Clover USB to boot into Clover and choose, start Windows EFI to boot into NVME.