An overloaded term with the following two possible definitions: 1. A category of hardware that can run a TensorFlow session, including CPUs, GPUs, and TPUs. 2. When training an ML model on accelerator chips (GPUs or TPUs), the part of the system that actually manipulates tensors and embeddings. The device runs on accelerator chips. In contrast, the host typically runs on a CPU.