Engineering Commons^™

Greentpu: Predictive Design Paradigm For Improving Timing Error Resilience Of A Near-Threshold Tensor Processing Unit, Pramesh Pandey, Prabal Basu, Koushik Chakraborty, Sanghamitra Roy

Electrical and Computer Engineering Faculty Publications

The emergence of hardware accelerators has brought about several orders of magnitude improvement in the speed of the deep neural-network (DNN) inference. Among such DNN accelerators, the Google tensor processing unit (TPU) has transpired to be the best-in-class, offering more than 15\times speedup over the contemporary GPUs. However, the rapid growth in several DNN workloads conspires to escalate the energy consumptions of the TPU-based data-centers. In order to restrict the energy consumption of TPUs, we propose GreenTPU - a low-power near-threshold (NTC) TPU design paradigm. To ensure a high inference accuracy at a low-voltage operation, GreenTPU identifies the patterns in …