Hugging Face Transformers

Open-source Python library from Hugging Face that provides a unified API for downloading and running pretrained models and tokenizers.

1 articleLast mentioned

Hugging Face Transformers is an open-source Python library developed and maintained by Hugging Face. It began in 2018 as pytorch-pretrained-bert, a PyTorch port of BERT, and was renamed Transformers in 2019. It lets developers download the many pretrained models hosted on the Hugging Face Hub with a few lines of code and use them for inference and fine-tuning.

Auto classes such as AutoModel and AutoTokenizer load the appropriate architecture and tokenizer from a model name alone, and the pipeline API runs tasks such as text generation or classification in a single call. The tokenizer's chat template feature converts conversation messages into the special-token format a model expects. The library is built primarily on PyTorch and supports vision and speech models as well as natural language processing.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Pre-Training, Fine-Tuning and RL: Where Frontier LLMs Get Their QualityAI Performance ·

    …5B, a 500 million parameter open-weight model, can be loaded in a free Google Colab notebook on an NVIDIA T4 GPU through the Hugging Face Transformers pipeline.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.