Parameter-efficient Fine-tuning

Sparse Low-rank Adaptation of Pre-trained Language Models
Fine-tuning pre-trained large language models in a parameter-efficient manner is widely studied for its effectiveness and efficiency. …
PDF Cite Code
Sparse Low-rank Adaptation of Pre-trained Language Models