Skip to content

Low-Rank Adaptation of Large Language Models clean implementation

License

Notifications You must be signed in to change notification settings

joey00072/TinyLora

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TinyLora

Easy hackable for Low-Rank Adaptations,

LoRA: Low-Rank Adaptation of Large Language Models https://arxiv.org/abs/2106.09685

TODO

  • Update Readme
  • Add way to save only lora weights
  • Add merge layer
  • Add unmerge layer

About

Low-Rank Adaptation of Large Language Models clean implementation

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages