Jlama is a Java library that provides a simple way to integrate LLM models into Java applications.
Jlama is built with Java 21 and utilizes the new Vector API for faster inference.
Jlama uses huggingface models in safetensor format.
Models must be specified using the owner/model-name format. For example, meta-llama/Llama-2-7b-chat-hf.
Pre-quantized models are maintained under https://huggingface.co/tjake