Skip to content

Commit 829c907

Browse files
committed
chore: updated README.md
1 parent 88faa10 commit 829c907

File tree

1 file changed

+24
-8
lines changed

1 file changed

+24
-8
lines changed

README.md

Lines changed: 24 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -26,20 +26,36 @@ ITEM_PIPELINES = {
2626
}
2727
```
2828

29+
### Save Scraped Items
30+
31+
```python
32+
from crawlab import save_item
33+
34+
scraped_items = [
35+
{
36+
'name': 'item1',
37+
'value': 'value1'
38+
},
39+
{
40+
'name': 'item2',
41+
'value': 'value2'
42+
}
43+
]
44+
45+
for item in scraped_items:
46+
save_item(item)
47+
```
48+
2949
## Development
3050

31-
### Install dependencies
51+
### Pre-requisites
3252

3353
```bash
34-
pip install -r requirements.txt
54+
pip install poetry
3555
```
3656

37-
### Compile gRPC
57+
### Install dependencies
3858

3959
```bash
40-
# Set the environment variable CRAWLAB_PROTO_PATH to the path of the gRPC proto files
41-
export CRAWLAB_PROTO_PATH=/path/to/grpc/proto/files
42-
43-
# Compile gRPC to Python code
44-
./compile_grpc.sh
60+
poetry install
4561
```

0 commit comments

Comments
 (0)