Breaking Free Transformer Models: Task-specific Context Attribution Promises Improved Generalizability Without Fine-tuning Pre-trained LLMs
Published in AAAI Responsible Language Model (ReLM) Workshop, 2024
Recommended citation: Tytarenko, S. & Amin, M. R. (2024). "Breaking Free Transformer Models: Task-specific Context Attribution Promises Improved Generalizability Without Fine-tuning Pre-trained LLMs." AAAI Responsible Language Model (ReLM) Workshop, 2024. arXiv:2401.16638. http://stepantita.github.io/files/SpaceModel.pdf
In this paper, we present a framework that allows for maintaining generalizability, and enhances the performance on the downstream task by utilizing task-specific context attribution
Download paper here · arXiv:2401.16638
Recommended citation: Tytarenko, S. & Amin, M. R. (2024). “Breaking Free Transformer Models: Task-specific Context Attribution Promises Improved Generalizability Without Fine-tuning Pre-trained LLMs.” AAAI Responsible Language Model (ReLM) Workshop, 2024. arXiv:2401.16638.