GPTBigCodeForCausalLM LoRA support

[tybritten]

Would love to see LoRA support for GPTBigCodeForCausalLM. We have fine tuned adapters per-language.

[simon-mo]

GPTBigCodeForCausalLM is already supported, and but it needs to support the weight loading logic so it knows how to load the weights. Do you have a public lora model that contributor can test with?

For contributors, the model code is here https://github.com/vllm-project/vllm/blob/57f044945f25d90d1b434014b2719ba6b06fdc44/vllm/model_executor/models/gpt_bigcode.py and the lora loading logic in llama should be a good template

vllm/vllm/model_executor/models/llama.py

Line 236 in 57f0449

lora_config: Optional[LoRAConfig] = None,

[tybritten]

Sure thing, I just uploaded one:
https://huggingface.co/tybritten/lora-for-starcoder

[raywanb]

btw what language is this adapter for? I'm trying to test it.