Unable to import CSV into hosted database that enforces primary key ID

[applesauce49]

Bug description

1. create a mysql connection to a mySQL hosted mysql server that enforces sql_require_primary_key = ON
2. Enable CSV importing on the mysql server connection.
3. Go through the Upload a file to database form and select any database on the server.

Result:
ERROR: (MySQLdb.OperationalError) (3750, "Unable to create or change a table without a primary key, when the system variable 'sql_require_primary_key' is set. Add a primary key to the table or unset this variable to avoid this message. Note that tables without a primary key can cause performance problems in row-based replication, so please consult your DBA before changing this setting.")

here's the output of the table create command it's trying to do: [SQL: CREATE TABLE superset_storage.stripe_subscription_data ( "index" BIGINT,

You can see it's trying to add an index column, it's just not adding "PRIMARY KEY" to it.

Screenshots/recordings

No response

Superset version

6.0.0

Python version

3.9

Node version

16

Browser

Safari

Additional context

No response

Checklist

• I have searched Superset docs and Slack and didn't find a solution to my problem.
• I have searched the GitHub issue tracker and didn't find a similar bug report.
• I have checked Superset's logs for errors and if I found a relevant Python stacktrace, I included it here as text in the "additional context" section.

[dosubot]

Hi @applesauce49! I'm Dosu and I’m helping the superset team.

Superset's CSV import relies on pandas' DataFrame.to_sql, which does not add a PRIMARY KEY to the created table. When MySQL's sql_require_primary_key is ON, this causes the import to fail because the generated CREATE TABLE statement lacks a PRIMARY KEY—even if an "index" column is present, it's not set as PRIMARY KEY. There is currently no built-in way in Superset to declare a PRIMARY KEY during CSV upload, and no configuration option to change this behavior.

A practical workaround is to pre-create the target table in MySQL with a PRIMARY KEY before uploading your CSV, then use the "append" option during import. Alternatively, you could request a feature for primary key support in future releases, but as of now, this is a known limitation of the CSV upload flow in Superset and pandas.

References:

• Superset CSV upload code path
• Superset database engine spec and pandas integration

To reply, just mention @dosu.

---

^{How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other}

   

[sadpandajoe]

Looks like someone already created a PR for this issue. Once things look good we'll add reviewers. Removing Beto for now as someone is already working on it.