SOS-LoRA: Static Orthogonal-Subspace Low-Rank Adaptation with Fixed Multi-Scale Scaling

A tweak to LoRA fine-tuning splits its capacity into separate orthogonal experts, beating standard LoRA with zero extra inference cost.