2026. Preference Optimization for Robust Instruction Following in Parameter-Efficient Language Models. Journal of Advanced Artificial Intelligence Research. 5, 1 (Aug. 2026).