Skip to content

dcc.Upload errors with big files #2869

Open

Description

Context

Issues

  • If I run the app with gunicorn or in my local env, some time after I upload the file the tab freezes or I get an internal server error (NOT a timeout because dcc.Upload has some kind of async functionality). > This is similar to what this issue describes: error with dcc.Upload() with large files #1728
Screenshot 2024-05-28 at 10 13 32 - If I run the app with Python in a Dash Enterprise workspace, I get a callback error which is kind of weird. If you look at the callback code and the print statements in the terminal, we only get two values despite having three Inputs. The first one is probably an empty string or list, which causes the if statement to “fail” (since list_of_contents is not None), so the error we see is related to code after the if statement. The real problem is that, even if the filenames and dates get passed correctly, the content is empty > This issue has been described before in the forum: (https://community.plotly.com/t/upload-500mb-csv-but-content-is-empty/83297. Screenshot error Screenshot callback code

Additional context

  • I've tried dash-uploader (link) and it works okay but I’m concerned about (1) privacy (all files are accessible by all users by default, as opposed to session-specific storage) and (2) memory (how does saving many big files affect the app memory/performance)
  • dash-uploader is not an official component and it’s not maintained, which raises some concerns regarding production environment.

Request

  • dcc.Upload being able to handle big files (500MB, >1GB, etc).
  • If the file is not been processed correctly (list_of_contents is empty) show a more helpful error.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    P3backlogbugsomething brokenfeaturesomething new

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions