No module named 'scipy.sparse._coo'

[rgstephens]

Rasa Open Source version

3.0.8

Rasa SDK version

No response

Rasa X version

No response

Python version

3.8

What operating system are you using?

Linux

What happened?

Recently built models (past week or so) will not load if they use DIET. Here's the error from 3.0.8 but I have confirmed this issue affects 2.8.x so I think this is somehow related to pip build environment changes.

2022-02-16 06:35:45 ERROR rasa.core.agent - Could not load model due to Error initializing graph component for node 'run_DIETClassifier5', No module named 'scipy.sparse._coo'

This may be related to #5303 and #10883.

Command / Request

Running rasa-production using standard Helm deployment

Relevant log output

No response

[rgstephens]

Exalate commented:

rgstephens commented:

The problem is related to the release of scipy 1.8.0 on February 5. I worked around the problem by going back to 1.7.3. I think any models trained in an environment with Scipy 1.8.0 will fail when deployed to a production environment. It affects both 2.x & 3.x

[koaning]

Exalate commented:

koaning commented:

That's strange. Got a full traceback? I'm curious what part of what library is referring to a hidden module. The modules like _coo that start with an _ are typically not meant to be used publicly.

[azizullah2017]

Exalate commented:

azizullah2017 commented:

@koaning rasa==2.8.8

| /opt/venv/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: The model at 'models' could not be loaded. Error: : No module named 'scipy.sparse._coo' |

[DC1991Lau]

Exalate commented:

DC1991Lau commented:

It happens with the version 2.8.0 as well:

`File "/opt/venv/lib/python3.8/site-packages/rasa/utils/io.py", line 81, in pickle_load return pickle.load(f)

ModuleNotFoundError: No module named 'scipy.sparse._coo'`

[rmiaouh]

Exalate commented:

rmiaouh commented:

+1 (With rasa 3.0.6)

[azizullah2017]

Exalate commented:

azizullah2017 commented:

@rgstephens try with init project.

sudo docker run -it --rm --user 1000 -v $(pwd):/app rasa/rasa:3.0.8-full init --no-prompt

sudo docker run --user 1000 -it -p 5005:5005 -v $(pwd):/app rasa/rasa:3.0.8-full run --enable-api --cors “*” OR docker-compose up --build

POST: http://localhost:5005/webhooks/rest/webhook

{ "message": "Hello", "sender": "aziz" }

response

[

{ "recipient_id": "aziz", "text": "Hey! How are you?" }

]

[botsahab]

Exalate commented:

botsahab commented:

did you solve it?

[rgstephens]

Exalate commented:

rgstephens commented:

Yes, see above

[botsahab]

Exalate commented:

botsahab commented:

@rgstephens should install with pip install scipy ==1.7.3? sorry I am beginner in rasa

[rgstephens]

Exalate commented:

rgstephens commented:

yes