Model Merging

What is Model Merging?

Model Merging involves combining the weights of two or more fine-tuned models to create a single model that retains the skills of both, without retraining.

Where did the term "Model Merging" come from?

Exploded in the open-source community.

How is "Model Merging" used today?

Methods like SLERP and DARE are standards on Hugging Face.

Related Terms