Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase size of column name in table ab_view_meu #6532

Merged

Conversation

betodealmeida
Copy link
Member

#5915 introduced support for Google Spreadsheets as datasources, using the gsheetsdb module. The code was tested using only SQLite as Superset's database. Today I discovered it fails in MySQL (and probably other databases that enforce column sizes for strings), since the table name of a Google spreadsheet is too big to be stored in the ab_view_menu table.

I increased the size of the column name from 100 to 255 characters, and tested the Google connector using MySQL as the main database for Superset.

@betodealmeida betodealmeida added !deprecated-label:bug Deprecated label - Use #bug instead risk:db-migration PRs that require a DB migration reviewable labels Dec 14, 2018
@codecov-io
Copy link

codecov-io commented Dec 14, 2018

Codecov Report

Merging #6532 into master will increase coverage by <.01%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff            @@
##           master   #6532      +/-   ##
=========================================
+ Coverage    73.5%   73.5%   +<.01%     
=========================================
  Files          72      72              
  Lines       10001   10002       +1     
=========================================
+ Hits         7351    7352       +1     
  Misses       2650    2650
Impacted Files Coverage Δ
superset/views/core.py 75.01% <0%> (+0.01%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 852c512...0cb805b. Read the comment docs.

@betodealmeida
Copy link
Member Author

Ping @mistercrunch

@mistercrunch
Copy link
Member

LGTM

@betodealmeida betodealmeida merged commit e2b9625 into apache:master Dec 18, 2018
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Dec 19, 2018
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
bipinsoniguavus pushed a commit to ThalesGroup/incubator-superset that referenced this pull request Dec 26, 2018
* Create migration script

* Use batch operation for ALTER COLUMN
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Dec 26, 2018
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Dec 28, 2018
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
@aboganas
Copy link
Contributor

@betodealmeida when I do superset db upgrade, it always hangs on this upgrade

@mistercrunch mistercrunch added the risk:may-require-downtime Upgrading to this feature may require downtime label Dec 30, 2018
@betodealmeida
Copy link
Member Author

@aboganas I also had problems when deploying this, but it eventually went through after I killed some processes in MySQL. I assumed in my case it was taking too long because of the size of the table.

I tested on a clean install and it works fine. @mistercrunch any idea why this could be hanging?

@betodealmeida
Copy link
Member Author

@aboganas
Copy link
Contributor

aboganas commented Jan 2, 2019

I left it running and it went through after like 8 hours. so maybe as you said there was a process holding it up

youngyjd pushed a commit to lyft/incubator-superset that referenced this pull request Jan 11, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 12, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 14, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
youngyjd pushed a commit to lyft/incubator-superset that referenced this pull request Jan 14, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 14, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 17, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 24, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
xtinec pushed a commit to lyft/incubator-superset that referenced this pull request Jan 28, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 30, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 30, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 30, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
(cherry picked from commit 0e51dfa)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 30, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
(cherry picked from commit 0e51dfa)
betodealmeida added a commit to lyft/incubator-superset that referenced this pull request Jan 31, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
(cherry picked from commit 0e51dfa)
xtinec pushed a commit to lyft/incubator-superset that referenced this pull request Feb 2, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
(cherry picked from commit 0e51dfa)
xtinec pushed a commit to lyft/incubator-superset that referenced this pull request Feb 4, 2019
* Create migration script

* Use batch operation for ALTER COLUMN

(cherry picked from commit e2b9625)
(cherry picked from commit 0e51dfa)
@mistercrunch mistercrunch added 🏷️ bot A label used by `supersetbot` to keep track of which PR where auto-tagged with release labels 🚢 0.34.0 labels Feb 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🏷️ bot A label used by `supersetbot` to keep track of which PR where auto-tagged with release labels !deprecated-label:bug Deprecated label - Use #bug instead risk:db-migration PRs that require a DB migration risk:may-require-downtime Upgrading to this feature may require downtime 🚢 0.34.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants