Skip to content

Commit

Permalink
fixes
Browse files Browse the repository at this point in the history
  • Loading branch information
leo-gan committed Aug 15, 2024
1 parent e696328 commit 60863da
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions docs/docs/integrations/llms/rwkv.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -34,14 +34,13 @@ including streaming and CUDA support.

## Usage

### RWKV

To use the RWKV wrapper, you need to provide the path to the pre-trained model file and the tokenizer's configuration.
```python
from langchain_community.llms import RWKV
```

# Test the model
## Test the model

```python

Expand All @@ -66,7 +65,6 @@ def generate_prompt(instruction, input=None):
# Response:
"""


model = RWKV(model="./models/RWKV-4-Raven-3B-v7-Eng-20230404-ctx4096.pth", strategy="cpu fp32", tokens_path="./rwkv/20B_tokenizer.json")
response = model.invoke(generate_prompt("Once upon a time, "))
```
Expand Down

0 comments on commit 60863da

Please sign in to comment.