|
9722 | 9722 | - filename: Llama-3.3-MagicalGirl-2.5.i1-Q4_K_M.gguf
|
9723 | 9723 | sha256: 25db6d4ae5649e6d2084036d8f05ec1aca459126e2d4734d6c18f1e16147a4d3
|
9724 | 9724 | uri: huggingface://mradermacher/Llama-3.3-MagicalGirl-2.5-i1-GGUF/Llama-3.3-MagicalGirl-2.5.i1-Q4_K_M.gguf
|
| 9725 | +- !!merge <<: *llama31 |
| 9726 | + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/1613114437487-60262a8e0703121c822a80b6.png |
| 9727 | + name: "nvidia_llama-3.1-nemotron-nano-4b-v1.1" |
| 9728 | + urls: |
| 9729 | + - https://huggingface.co/nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 |
| 9730 | + - https://huggingface.co/bartowski/nvidia_Llama-3.1-Nemotron-Nano-4B-v1.1-GGUF |
| 9731 | + description: | |
| 9732 | + Llama-3.1-Nemotron-Nano-4B-v1.1 is a large language model (LLM) which is a derivative of nvidia/Llama-3.1-Minitron-4B-Width-Base, which is created from Llama 3.1 8B using our LLM compression technique and offers improvements in model accuracy and efficiency. It is a reasoning model that is post trained for reasoning, human chat preferences, and tasks, such as RAG and tool calling. |
| 9733 | + |
| 9734 | + Llama-3.1-Nemotron-Nano-4B-v1.1 is a model which offers a great tradeoff between model accuracy and efficiency. The model fits on a single RTX GPU and can be used locally. The model supports a context length of 128K. |
| 9735 | + |
| 9736 | + This model underwent a multi-phase post-training process to enhance both its reasoning and non-reasoning capabilities. This includes a supervised fine-tuning stage for Math, Code, Reasoning, and Tool Calling as well as multiple reinforcement learning (RL) stages using Reward-aware Preference Optimization (RPO) algorithms for both chat and instruction-following. The final model checkpoint is obtained after merging the final SFT and RPO checkpoints |
| 9737 | + |
| 9738 | + This model is part of the Llama Nemotron Collection. You can find the other model(s) in this family here: |
| 9739 | + |
| 9740 | + Llama-3.3-Nemotron-Ultra-253B-v1 |
| 9741 | + Llama-3.3-Nemotron-Super-49B-v1 |
| 9742 | + Llama-3.1-Nemotron-Nano-8B-v1 |
| 9743 | + |
| 9744 | + This model is ready for commercial use. |
| 9745 | + overrides: |
| 9746 | + parameters: |
| 9747 | + model: nvidia_Llama-3.1-Nemotron-Nano-4B-v1.1-Q4_K_M.gguf |
| 9748 | + files: |
| 9749 | + - filename: nvidia_Llama-3.1-Nemotron-Nano-4B-v1.1-Q4_K_M.gguf |
| 9750 | + sha256: 530f0e0ade58d22d4b24d9378cf8a87161d22f33cae8f2f65876f3a1555819e6 |
| 9751 | + uri: huggingface://bartowski/nvidia_Llama-3.1-Nemotron-Nano-4B-v1.1-GGUF/nvidia_Llama-3.1-Nemotron-Nano-4B-v1.1-Q4_K_M.gguf |
9725 | 9752 | - &deepseek
|
9726 | 9753 | url: "github:mudler/LocalAI/gallery/deepseek.yaml@master" ## Deepseek
|
9727 | 9754 | name: "deepseek-coder-v2-lite-instruct"
|
|
0 commit comments