LoRA Speedrun – a public wall-clock leaderboard for fine-tuning techniques

The LoRA Speedrun is a public leaderboard designed to standardize and benchmark parameter-efficient fine-tuning techniques for large language models. By using a frozen task, hardware, and dataset, it allows researchers to compare the efficiency of various LoRA-based methods in a controlled environment.