PyTorch

Open-source deep learning framework released in 2016 by Meta's AI research group, known for dynamic computation graphs and automatic differentiation.

1 articleLast mentioned

PyTorch is an open-source deep learning framework released in 2016 by FAIR, the AI research group of Facebook (now Meta). A Python redesign of the Lua-based Torch library, it provides GPU-accelerated tensor operations and the autograd automatic differentiation engine. Its define-by-run approach builds the computation graph as code executes, so models can be debugged like ordinary Python programs.

In the standard training loop, a model is defined as a torch.nn.Module class, loss.backward() computes gradients, and optimizer.step() updates the parameters. Governance moved to the PyTorch Foundation under the Linux Foundation in 2022. It is the de facto standard framework for most LLM research and open-model implementations, including Hugging Face Transformers.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Pre-Training, Fine-Tuning and RL: Where Frontier LLMs Get Their QualityAI Performance ·

    With billions of parameters, that is impossible, which is where automatic differentiation frameworks such as PyTorch, JAX and TensorFlow come in.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.