Parameter

What is Parameter?

Parameters are the internal variables (weights) learned by the model during training. The number of parameters (e.g., 7B, 175B) roughly correlates with the model's complexity and capacity to learn.

Where did the term "Parameter" come from?

Standard terminology in statistics and machine learning.

How is "Parameter" used today?

Used as the primary metric to describe the 'size' of an AI model.

Related Terms