If you do not want to download, write, and install Ubuntu Server from USB that you have around, you may purchase a USB drive that is preloaded with Ubuntu. Personally, I think preloaded bootable Ubuntu USB drives are not worth the money. It is a lot easier and cheaper write your own bootable USB installer.