Skip to content

[Azure ML SDK v2 - AzureML fsspec] loading parquet file using azureml-fsspec results in segmentation fault #30518

Open

Description

  • azureml-fsspe:
  • 1.0.0:
  • Ubuntu:
  • 3.9 and 3.10:

Describe the bug
When loading a parquet file from AzureML using azureml:// and pandas, python exits with segmentation fault. When using AzureMachineLearningFileSystem and fs.download() and then load the file once it is downloaded the file is loaded without any issues. However, I would like to load it without having to download it first.

This does not happen with every parquet file and I am unable to identify a difference for the cases it works and when it does not work.

To Reproduce
Steps to reproduce the behavior:
Not sure how to reproduce the file setup ...

Expected behavior
I would expect that loading the file using azureml:// and azureml-fsspec should work the same way as downloading the file and then loading it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Labels

ClientThis issue points to a problem in the data-plane of the library.Machine LearningService AttentionWorkflow: This issue is responsible by Azure service team.bugThis issue requires a change to an existing behavior in the product in order to be resolved.customer-reportedIssues that are reported by GitHub users external to the Azure organization.needs-team-attentionWorkflow: This issue needs attention from Azure service team or SDK team

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions