The NVIDIA T4 is a data center GPU that NVIDIA announced in 2018. Built on the Turing architecture, it has 16GB of GDDR6 memory and Tensor Cores in a single-slot card with a 70W power draw, which makes it easy to install several per server. Launched under the name Tesla T4, it targets inference, video processing, and virtual desktop workloads rather than large-scale training.
It is widely available on major clouds such as Google Cloud and AWS and is known as the GPU allocated in the free tier of Google Colab. Although slower than newer GPUs, it is sufficient for loading open-weight models of a few billion parameters for inference and for small experiments, so it is frequently used in education.