Frankenmerge is a colloquial term for models created by stitching together layers from different models (e.g., stacking Llama layers) to create a larger model with non-standard parameter counts.
Experimental technique by the GPU-poor community.
Often tops leaderboards by 'hacking' model depth.