File tree Expand file tree Collapse file tree 1 file changed +24
-8
lines changed Expand file tree Collapse file tree 1 file changed +24
-8
lines changed Original file line number Diff line number Diff line change @@ -26,20 +26,36 @@ ITEM_PIPELINES = {
26
26
}
27
27
```
28
28
29
+ ### Save Scraped Items
30
+
31
+ ``` python
32
+ from crawlab import save_item
33
+
34
+ scraped_items = [
35
+ {
36
+ ' name' : ' item1' ,
37
+ ' value' : ' value1'
38
+ },
39
+ {
40
+ ' name' : ' item2' ,
41
+ ' value' : ' value2'
42
+ }
43
+ ]
44
+
45
+ for item in scraped_items:
46
+ save_item(item)
47
+ ```
48
+
29
49
## Development
30
50
31
- ### Install dependencies
51
+ ### Pre-requisites
32
52
33
53
``` bash
34
- pip install -r requirements.txt
54
+ pip install poetry
35
55
```
36
56
37
- ### Compile gRPC
57
+ ### Install dependencies
38
58
39
59
``` bash
40
- # Set the environment variable CRAWLAB_PROTO_PATH to the path of the gRPC proto files
41
- export CRAWLAB_PROTO_PATH=/path/to/grpc/proto/files
42
-
43
- # Compile gRPC to Python code
44
- ./compile_grpc.sh
60
+ poetry install
45
61
```
You can’t perform that action at this time.
0 commit comments