Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing values in df resulting in TypeError #4013

Open
labanyamukhopadhyay opened this issue Jan 20, 2022 · 3 comments
Open

Missing values in df resulting in TypeError #4013

labanyamukhopadhyay opened this issue Jan 20, 2022 · 3 comments
Labels
bug 🦗 Something isn't working Integration ➕➕ Issues with integrating Modin into other libraries Needs more information ❔ Issues that require more information from the reporter P3 Very minor bugs, or features we can hopefully add some day.

Comments

@labanyamukhopadhyay
Copy link
Contributor

Describe the problem

There is an issue with missing values in a dataframe that results in 'TypeError: boolean value of NA is ambiguous'. This may be due to modin not filling missing values before hand.

Source code

import statsmodels.api as sm

X_sm = sm.add_constant(X_drop_first)
model = sm.OLS(y.astype(float),X_sm.astype(int))
results = model.fit()
results.summary()

Screen Shot 2022-01-20 at 10 34 41 AM

After adding this line X_drop_first.fillna(0, inplace=True) before the import statement, the following error occurs:
ValueError: unrecognized data structures: <class 'modin.pandas.series.Series'> / <class 'numpy.ndarray'>

@devin-petersohn
Copy link
Collaborator

Thanks @labanyamukhopadhyay for the report!

What is X_drop_first in this case?

@labanyamukhopadhyay
Copy link
Contributor Author

X_drop_first is a modin dataframe with no clear missing values

@anmyachev anmyachev added Integration ➕➕ Issues with integrating Modin into other libraries bug 🦗 Something isn't working labels Apr 21, 2022
@vnlitvinov
Copy link
Collaborator

@labanyamukhopadhyay would you be able to construct a self-contained reproducer (with input data)?

@vnlitvinov vnlitvinov added Needs more information ❔ Issues that require more information from the reporter P3 Very minor bugs, or features we can hopefully add some day. labels Aug 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug 🦗 Something isn't working Integration ➕➕ Issues with integrating Modin into other libraries Needs more information ❔ Issues that require more information from the reporter P3 Very minor bugs, or features we can hopefully add some day.
Projects
None yet
Development

No branches or pull requests

4 participants