Text-to-LoRA: Instant Transformer Adaption

[We] introduce Text-to-LoRA (T2L), a model capable of adapting large language models (LLMs) on the fly solely based on a natural language description of the target task. T2L is a hypernetwork trained to construct LoRAs in a single inexpensive forward pass.

Code repository here: https://github.com/SakanaAI/text-to-lora