Writings

Explores the application of Parameter-Efficient Finetuning (PEFT) method Low-Rank Adaptation+ (LoRA+) on the transfer learning of Llama 3.2 1B. Achieved a 112% improvement in BLEU and a 21.7% increase in ROUGE-L compared to baseline models.