InstructGPT

InstructGPT is a language model released by OpenAI in 2022 that trained GPT-3 to follow instructions using reinforcement learning from human feedback (RLHF).

2 articlesLast mentioned

InstructGPT is a language model released by OpenAI in January 2022. Built on GPT-3, it was trained with supervised fine-tuning on human-written demonstrations, followed by reinforcement learning from human feedback (RLHF), in which a reward model learned from human rankings of multiple outputs is used to optimize the model. The method is described in the paper "Training language models to follow instructions with human feedback" published the same year.

InstructGPT was found to follow user instructions better than the original GPT-3 while producing fewer untruthful or harmful outputs, and it established the RLHF training approach later used widely in conversational language models including ChatGPT.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • Off-Switch Game: Why Claude Opus 4.6 Resisted Shutdown in 91% of TasksAI Ethics ·

    The dominant alignment method, Reinforcement Learning from Human Feedback (RLHF), was popularized by OpenAI in 2022 for InstructGPT and GPT-3.

    Read article
  • ChatGPT for Financial Services: One Shared Model, Hosted Data, Human ReviewAI News ·

    InstructGPT in 2022 used reinforcement learning from human feedback (RLHF), in which human labelers rank several model outputs from best to worst and a reward m…

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.