Rust is a fantastic platform to build production machine learning infrastructure. Here are some of the reasons why we have chosen to build on Rust.
- High performance
- Robust Security model
- Excellent tooling
- Inter-operability with C/C++
- Ability to run in resource-constrained environments
- A high performance of Llama 2 https://github.com/srush/llama2.rs