Closed
Description
Hello,
any consideration add Alibi context scaling using ntk like method to support baichuan13b much more context length input?
there were some work did it: https://github.com/keezen/ntk_alibi
Hello,
any consideration add Alibi context scaling using ntk like method to support baichuan13b much more context length input?
there were some work did it: https://github.com/keezen/ntk_alibi