While module writers can use any device or dtype to initialize parameters in their custom modules, good practice isto use dtype=torch.float and device='cpu' by default as well. Optionally, you can provide full flexibilityin these areas for your custom module by conforming to the convention demonstrated above that alltorch.nn modules follow: