TextGrad

TextGrad is an open-source framework that optimizes prompts and other components of AI systems by propagating natural-language feedback from a language model backward like gradients.

1 articleLast mentioned

TextGrad is an open-source Python framework released in 2024 by researchers at Stanford University. In the way gradients are backpropagated when training a neural network, it passes natural-language critiques written by a language model about an output back to earlier stages of a system and revises each component accordingly. The authors describe this as automatic differentiation via text, and the framework follows a syntax similar to that of the deep learning library PyTorch.

The variables it can optimize are not limited to prompts and include anything expressed as text, such as answers to problems, code and molecular structures. It is used to tune compound AI systems that combine multiple language model calls and tools.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • AI Agent Tuning: When to Rewrite Prompts and When to Retrain WeightsAI Performance ·

    TextGrad takes a different route.

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.