Skip to content

Commit

Permalink
Fix imports
Browse files Browse the repository at this point in the history
  • Loading branch information
EricLBuehler committed Mar 10, 2024
1 parent 4a8af99 commit 33c49df
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 6 deletions.
4 changes: 2 additions & 2 deletions examples/python/bare_bones.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
from mistralrs import ModelKind, MistralLoader, Request
from mistralrs import ModelKind, MistralLoader, ChatCompletionRequest

kind = ModelKind.QuantizedGGUF
loader = MistralLoader(
Expand All @@ -11,7 +11,7 @@
)
runner = loader.load()
res = runner.send_chat_completion_request(
Request(
ChatCompletionRequest(
model="mistral",
messages=[
{"role": "user", "content": "Tell me a story about the Rust type system."}
Expand Down
4 changes: 2 additions & 2 deletions examples/python/python_api.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
from mistralrs import MistralLoader, QuantizedLoader, Request
from mistralrs import MistralLoader, QuantizedLoader, ChatCompletionRequest

loader = QuantizedLoader(
MistralLoader,
Expand All @@ -11,7 +11,7 @@
)
runner = loader.load()
res = runner.send_chat_completion_request(
Request(
ChatCompletionRequest(
model="mistral",
messages=[
{"role": "user", "content": "Tell me a story about the Rust type system."}
Expand Down
4 changes: 2 additions & 2 deletions mistralrs-pyo3/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ Please find [API docs here](API.md).

## Example
```python
from mistralrs import ModelKind, MistralLoader, Request
from mistralrs import ModelKind, MistralLoader, ChatCompletionRequest
kind = ModelKind.QuantizedGGUF
loader = MistralLoader(
Expand All @@ -39,7 +39,7 @@ loader = MistralLoader(
)
runner = loader.load()
res = runner.send_chat_completion_request(
Request(
ChatCompletionRequest(
model="mistral",
messages=[
{"role": "user", "content": "Tell me a story about the Rust type system."}
Expand Down

0 comments on commit 33c49df

Please sign in to comment.