Release llama_cpp_sys v0.2.1, llama_cpp v0.1.1

Author: scriptis

Cargo.lock

@@ -5,12 +5,53 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## v0.1.1 (2023-11-08)
+
+### Chore
+
+ - <csr-id-3eddbab3cc35a59acbe66fa4f5333a9ca0edb326/> Remove debug binary from Cargo.toml
+
+### New Features
+
+ - <csr-id-3bada658c9139af1c3dcdb32c60c222efb87a9f6/> add `LlamaModel::load_from_file_async`
+
+### Bug Fixes
+
+ - <csr-id-b676baa3c1a6863c7afd7a88b6f7e8ddd2a1b9bd/> require `llama_context` is accessed from behind a mutex
+   This solves a race condition when several `get_completions` threads are spawned at the same time
+ - <csr-id-4eb0bc9800877e460fe0d1d25398f35976b4d730/> `start_completing` should not be invoked on a per-iteration basis
+   There's still some UB that can be triggered due to llama.cpp's threading model, which needs patching up.
+
+### Commit Statistics
+
+<csr-read-only-do-not-edit/>
+
+ - 5 commits contributed to the release.
+ - 13 days passed between releases.
+ - 4 commits were understood as [conventional](https://www.conventionalcommits.org).
+ - 0 issues like '(#ID)' were seen in commit messages
+
+### Commit Details
+
+<csr-read-only-do-not-edit/>
+
+<details><summary>view details</summary>
+
+ * **Uncategorized**
+    - Add `LlamaModel::load_from_file_async` ([`3bada65`](https://github.com/binedge/llama_cpp-rs/commit/3bada658c9139af1c3dcdb32c60c222efb87a9f6))
+    - Remove debug binary from Cargo.toml ([`3eddbab`](https://github.com/binedge/llama_cpp-rs/commit/3eddbab3cc35a59acbe66fa4f5333a9ca0edb326))
+    - Require `llama_context` is accessed from behind a mutex ([`b676baa`](https://github.com/binedge/llama_cpp-rs/commit/b676baa3c1a6863c7afd7a88b6f7e8ddd2a1b9bd))
+    - `start_completing` should not be invoked on a per-iteration basis ([`4eb0bc9`](https://github.com/binedge/llama_cpp-rs/commit/4eb0bc9800877e460fe0d1d25398f35976b4d730))
+    - Update to llama.cpp 0a7c980 ([`94d7385`](https://github.com/binedge/llama_cpp-rs/commit/94d7385fefdab42ac6949c6d47c5ed262db08365))
+</details>
+
 ## v0.1.0 (2023-10-25)
 
 <csr-id-702a6ff49d83b10a0573a5ca1fb419efaa43746e/>
 <csr-id-116fe8c82fe2c43bf9041f6dbfe2ed15d00e18e9/>
 <csr-id-96548c840d3101091c879648074fa0ed1cee3011/>
 <csr-id-a5fb19499ecbb1060ca8211111f186efc6e9b114/>
+<csr-id-aa5eed4dcb6f50b25c878e584787211402a9138b/>
 
 ### Chore
 
@@ -34,7 +75,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 <csr-read-only-do-not-edit/>
 
- - 8 commits contributed to the release over the course of 5 calendar days.
+ - 9 commits contributed to the release over the course of 5 calendar days.
  - 6 commits were understood as [conventional](https://www.conventionalcommits.org).
  - 1 unique issue was worked on: [#3](https://github.com/binedge/llama_cpp-rs/issues/3)
 
@@ -47,6 +88,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
  * **[#3](https://github.com/binedge/llama_cpp-rs/issues/3)**
     - Release ([`116fe8c`](https://github.com/binedge/llama_cpp-rs/commit/116fe8c82fe2c43bf9041f6dbfe2ed15d00e18e9))
  * **Uncategorized**
+    - Release llama_cpp v0.1.0 ([`f24c7fe`](https://github.com/binedge/llama_cpp-rs/commit/f24c7fe3ebd851a56301ce3d5a1b4250d2d797b9))
     - Add CHANGELOG.md ([`aa5eed4`](https://github.com/binedge/llama_cpp-rs/commit/aa5eed4dcb6f50b25c878e584787211402a9138b))
     - Remove `include` from llama_cpp ([`702a6ff`](https://github.com/binedge/llama_cpp-rs/commit/702a6ff49d83b10a0573a5ca1fb419efaa43746e))
     - Use SPDX license identifiers ([`2cb06ae`](https://github.com/binedge/llama_cpp-rs/commit/2cb06aea62b892a032f515b78d720acb915f4a22))

crates/llama_cpp/CHANGELOG.md

@@ -1,6 +1,6 @@
 [package]
 name = "llama_cpp"
-version = "0.1.0"
+version = "0.1.1"
 description = "High-level bindings to llama.cpp with a focus on just being really, really easy to use"
 edition = "2021"
 authors = ["Dakota Thompson <me@scriptis.net>"]
@@ -13,7 +13,7 @@ publish = true
 ctor = "0.2.5"
 derive_more = "0.99.17"
 flume = "0.11.0"
-llama_cpp_sys = { version = "^0.2.0", path = "../llama_cpp_sys" }
+llama_cpp_sys = { version = "^0.2.1", path = "../llama_cpp_sys" }
 num_cpus = "1.16.0"
 thiserror = "1.0.50"
 tokio = { version = "1.33.0", features = ["sync", "rt"] }

crates/llama_cpp/Cargo.toml

@@ -5,6 +5,37 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## v0.2.1 (2023-11-08)
+
+### Chore
+
+ - <csr-id-ccb794d346de87e48199f9f0f3564f3c7a2cd607/> Update to `bindgen` 0.69.1
+
+### Bug Fixes
+
+ - <csr-id-4eb0bc9800877e460fe0d1d25398f35976b4d730/> `start_completing` should not be invoked on a per-iteration basis
+   There's still some UB that can be triggered due to llama.cpp's threading model, which needs patching up.
+
+### Commit Statistics
+
+<csr-read-only-do-not-edit/>
+
+ - 2 commits contributed to the release.
+ - 13 days passed between releases.
+ - 2 commits were understood as [conventional](https://www.conventionalcommits.org).
+ - 0 issues like '(#ID)' were seen in commit messages
+
+### Commit Details
+
+<csr-read-only-do-not-edit/>
+
+<details><summary>view details</summary>
+
+ * **Uncategorized**
+    - Update to `bindgen` 0.69.1 ([`ccb794d`](https://github.com/binedge/llama_cpp-rs/commit/ccb794d346de87e48199f9f0f3564f3c7a2cd607))
+    - `start_completing` should not be invoked on a per-iteration basis ([`4eb0bc9`](https://github.com/binedge/llama_cpp-rs/commit/4eb0bc9800877e460fe0d1d25398f35976b4d730))
+</details>
+
 ## v0.2.0 (2023-10-25)
 
 <csr-id-116fe8c82fe2c43bf9041f6dbfe2ed15d00e18e9/>
@@ -36,7 +67,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 <csr-read-only-do-not-edit/>
 
- - 10 commits contributed to the release over the course of 5 calendar days.
+ - 11 commits contributed to the release over the course of 5 calendar days.
  - 6 commits were understood as [conventional](https://www.conventionalcommits.org).
  - 3 unique issues were worked on: [#1](https://github.com/binedge/llama_cpp-rs/issues/1), [#2](https://github.com/binedge/llama_cpp-rs/issues/2), [#3](https://github.com/binedge/llama_cpp-rs/issues/3)
 
@@ -53,6 +84,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
  * **[#3](https://github.com/binedge/llama_cpp-rs/issues/3)**
     - Release ([`116fe8c`](https://github.com/binedge/llama_cpp-rs/commit/116fe8c82fe2c43bf9041f6dbfe2ed15d00e18e9))
  * **Uncategorized**
+    - Release llama_cpp_sys v0.2.0 ([`fa3af83`](https://github.com/binedge/llama_cpp-rs/commit/fa3af83e51f552ad60e3f4e06cb3582b0cb4be2f))
     - Use SPDX license identifiers ([`2cb06ae`](https://github.com/binedge/llama_cpp-rs/commit/2cb06aea62b892a032f515b78d720acb915f4a22))
     - Release llama_cpp_sys v0.2.0 ([`85f21a1`](https://github.com/binedge/llama_cpp-rs/commit/85f21a1eca80faa9bd3f2f160d58b21a437814aa))
     - Add CHANGELOG.md ([`0e836f5`](https://github.com/binedge/llama_cpp-rs/commit/0e836f5b60b0e2f110972ef384f23c350150f55b))

crates/llama_cpp_sys/CHANGELOG.md

@@ -1,6 +1,6 @@
 [package]
 name = "llama_cpp_sys"
-version = "0.2.0"
+version = "0.2.1"
 description = "Automatically-generated bindings to llama.cpp's C API"
 edition = "2021"
 authors = ["Dakota Thompson <me@scriptis.net>"]