Open
Description
LocalAI version: v2.29.0 with latest commits from master pulled
Environment, CPU architecture, OS, and Version: Mac T8132 MacOS 15.5 24F74
Describe the bug
When downloading certain models it does not download the file, but instead prints a text instead of a progress bar:
{Metadata:{URL: Name:arch-function-7b Description:The Katanemo Arch-Function collection of large language models (LLMs) is a collection state-of-the-art (SOTA) LLMs specifically designed for function calling tasks. The models are designed to understand complex function signatures, identify required parameters, and produce accurate function call outputs based on natural language prompts. Achieving performance on par with GPT-4, these models set a new benchmark in the domain of function-oriented tasks, making them suitable for scenarios where automated API interaction and function execution is crucial. In summary, the Katanemo Arch-Function collection demonstrates: State-of-the-art performance in function calling Accurate parameter identification and suggestion, even in ambiguous or incomplete inputs High generalization across multiple function calling use cases, from API interactions to automated backend tasks. Optimized low-latency, high-throughput performance, making it suitable for real-time, production environments. License:apache-2.0 URLs:[https://huggingface.co/katanemolabs/Arch-Function-7B https://huggingface.co/mradermacher/Arch-Function-7B-GGUF] Icon:https://avatars.githubusercontent.com/u/112724757 Tags:[llm gguf gpu qwen qwen2.5 cpu function-calling] AdditionalFiles:[{Filename:Arch-Function-7B.Q4_K_M.gguf SHA256:6e38661321d79d02b8cf57c79d97c6c0e19adb9ffa66083cc440c24e257234b6 URI:huggingface://mradermacher/Arch-Function-7B-GGUF/Arch-Function-7B.Q4_K_M.gguf}] Gallery:{URL:github:mudler/LocalAI/gallery/index.yaml@master Name:localai} Installed:false} ConfigFile:map[] Overrides:map[parameters:map[model:Arch-Function-7B.Q4_K_M.gguf]]}
In the command line when running debug it gets spammed with INF Success relating /browse/job/progress but no progress is made and it keeps looping until you close the page where you started the download.
To Reproduce
Simply search for the arch models like arch-function-7b in the gallery and click on Install.
Expected behavior
Normally a progress bar appears and the model is getting downloaded.
Logs
From the command line running in debug:
11:07AM INF Success ip=*** latency=94.299041ms method=POST status=200 url=/browse/search/models
11:08AM DBG UI job submitted to install : localai@arch-function-7b
11:08AM INF Success ip=*** latency="469.833µs" method=POST status=200 url=/browse/install/model/localai@arch-function-7b
11:08AM INF Success ip=*** latency="160.041µs" method=GET status=200 url=/browse/job/progress/e8aa54f8-4835-11f0-9413-fe7740099ce3
Additional context