Using mlx as backend

[sandangel]

Is it feasible to utilize MLX as the backend for development on Apple silicon devices?

[fblissjr]

Looking at the code, vllm looks to be the primary driver. My hunch is that the better path would be vllm working with MLX. Looks to be on their roadmap: vllm-project/vllm#2681

[github-actions]

This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.