Instruction Tuning

What is Instruction Tuning?

Instruction tuning is the process of fine-tuning a base language model on a dataset of (instruction, output) pairs to improve its ability to follow user commands and act as an assistant.

Where did the term "Instruction Tuning" come from?

The step that bridges the gap between a text completor and a chatbot like ChatGPT.

How is "Instruction Tuning" used today?

Standard practice for creating helpful AI assistants.

Related Terms