Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CSV Export of class data #1494

Merged
merged 23 commits into from
Aug 17, 2021
Merged
Show file tree
Hide file tree
Changes from 14 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,9 @@
### master
[Full Changelog](https://github.com/parse-community/parse-dashboard/compare/2.1.0...master)

__New features:__
* Added data export in CSV format for classes ([#1494](https://github.com/parse-community/parse-dashboard/pull/1494)), thanks to [Cory Imdieke](https://github.com/Vortec4800).

### 2.1.0
[Full Changelog](https://github.com/parse-community/parse-dashboard/compare/2.0.5...2.1.0)

Expand Down
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -570,6 +570,12 @@ This feature allows you to use the data browser as another user, respecting that

> ⚠️ Logging in as another user will trigger the same Cloud Triggers as if the user logged in themselves using any other login method. Logging in as another user requires to enter that user's password.

## CSV Export

This feature will take either selected rows or all rows of an individual class and saves them to a CSV file, which is then downloaded. CSV headers are added to the top of the file matching the property names.
Vortec4800 marked this conversation as resolved.
Show resolved Hide resolved

> ⚠️ There is currently a 10,000 row limit when exporting all data. If more than 10,000 rows are present in the class, the CSV file will only contain 10,000 rows.

# Contributing

We really want Parse to be yours, to see it grow and thrive in the open source community. Please see the [Contributing to Parse Dashboard guide](CONTRIBUTING.md).
Expand Down
108 changes: 107 additions & 1 deletion src/dashboard/Data/Browser/Browser.react.js
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@ import AttachRowsDialog from 'dashboard/Data/Browser/AttachRow
import AttachSelectedRowsDialog from 'dashboard/Data/Browser/AttachSelectedRowsDialog.react';
import CloneSelectedRowsDialog from 'dashboard/Data/Browser/CloneSelectedRowsDialog.react';
import EditRowDialog from 'dashboard/Data/Browser/EditRowDialog.react';
import ExportSelectedRowsDialog from 'dashboard/Data/Browser/ExportSelectedRowsDialog.react';
import history from 'dashboard/history';
import { List, Map } from 'immutable';
import Notification from 'dashboard/Data/Browser/Notification.react';
Expand Down Expand Up @@ -59,6 +60,7 @@ class Browser extends DashboardView {
showAttachRowsDialog: false,
showEditRowDialog: false,
rowsToDelete: null,
rowsToExport: null,

relation: null,
counts: {},
Expand Down Expand Up @@ -110,6 +112,9 @@ class Browser extends DashboardView {
this.showCloneSelectedRowsDialog = this.showCloneSelectedRowsDialog.bind(this);
this.confirmCloneSelectedRows = this.confirmCloneSelectedRows.bind(this);
this.cancelCloneSelectedRows = this.cancelCloneSelectedRows.bind(this);
this.showExportSelectedRowsDialog = this.showExportSelectedRowsDialog.bind(this);
this.confirmExportSelectedRows = this.confirmExportSelectedRows.bind(this);
this.cancelExportSelectedRows = this.cancelExportSelectedRows.bind(this);
this.getClassRelationColumns = this.getClassRelationColumns.bind(this);
this.showCreateClass = this.showCreateClass.bind(this);
this.refresh = this.refresh.bind(this);
Expand Down Expand Up @@ -1063,7 +1068,8 @@ class Browser extends DashboardView {
this.state.showAttachSelectedRowsDialog ||
this.state.showCloneSelectedRowsDialog ||
this.state.showEditRowDialog ||
this.state.showPermissionsDialog
this.state.showPermissionsDialog ||
this.state.showExportSelectedRowsDialog
);
}

Expand Down Expand Up @@ -1211,6 +1217,95 @@ class Browser extends DashboardView {
}
}

showExportSelectedRowsDialog(rows) {
this.setState({
rowsToExport: rows
});
}

cancelExportSelectedRows() {
this.setState({
rowsToExport: null
});
}

async confirmExportSelectedRows(rows) {
this.setState({ rowsToExport: null });
const className = this.props.params.className;
const query = new Parse.Query(className);

if (rows['*']) {
// Export all
query.limit(10000);
mtrezza marked this conversation as resolved.
Show resolved Hide resolved
} else {
// Export selected
const objectIds = [];
for (const objectId in this.state.rowsToExport) {
objectIds.push(objectId);
}
query.containedIn('objectId', objectIds);
}

const classColumns = this.getClassColumns(className, false);
// create object with classColumns as property keys needed for ColumnPreferences.getOrder function
const columnsObject = {};
classColumns.forEach((column) => {
columnsObject[column.name] = column;
});
// get ordered list of class columns
const columns = ColumnPreferences.getOrder(
columnsObject,
this.context.currentApp.applicationId,
className
).filter(column => column.visible);

const objects = await query.find({ useMasterKey: true });
let csvString = columns.map(column => column.name).join(',') + '\n';
for (const object of objects) {
const row = columns.map(column => {
const type = columnsObject[column.name].type;
if (column.name === 'objectId') {
return object.id;
} else if (type === 'Relation' || type === 'Pointer') {
if (object.get(column.name)) {
return object.get(column.name).id
} else {
return 'undefined'
}
} else {
let colValue = object.get(column.name);
if(typeof colValue === 'string') {
if (colValue.includes('"')) {
// Has quote in data, escape and quote
// If the value contains both a quote and delimiter, adding quotes and escaping will take care of both scenarios
colValue = colValue.split('"').join('""');
return `"${colValue}"`;
} else if (colValue.includes(',')) {
// Has delimiter in data, surround with quote (which the value doesn't already contain)
return `"${colValue}"`;
} else {
// No quote or delimiter, just include plainly
return `${colValue}`;
}
} else {
// value isn't a string, include plainly and let javascript format it
return `${colValue}`;
}
}
}).join(',');
csvString += row + '\n';
}

// Deliver to browser to download file
const element = document.createElement('a');
const file = new Blob([csvString], { type: 'text/csv' });
element.href = URL.createObjectURL(file);
element.download = `${className}.csv`;
document.body.appendChild(element); // Required for this to work in FireFox
element.click();
Vortec4800 marked this conversation as resolved.
Show resolved Hide resolved
document.body.removeChild(element);
}

getClassRelationColumns(className) {
const currentClassName = this.props.params.className;
return this.getClassColumns(className, false)
Expand Down Expand Up @@ -1393,6 +1488,8 @@ class Browser extends DashboardView {
onCloneSelectedRows={this.showCloneSelectedRowsDialog}
onEditSelectedRow={this.showEditRowDialog}
onEditPermissions={this.onDialogToggle}
onExportSelectedRows={this.showExportSelectedRowsDialog}

onSaveNewRow={this.saveNewRow}
onAbortAddRow={this.abortAddRow}
onSaveEditCloneRow={this.saveEditCloneRow}
Expand Down Expand Up @@ -1583,6 +1680,15 @@ class Browser extends DashboardView {
useMasterKey={this.state.useMasterKey}
/>
)
} else if (this.state.rowsToExport) {
extras = (
<ExportSelectedRowsDialog
className={SpecialClasses[className] || className}
selection={this.state.rowsToExport}
onCancel={this.cancelExportSelectedRows}
onConfirm={() => this.confirmExportSelectedRows(this.state.rowsToExport)}
/>
);
}

let notification = null;
Expand Down
11 changes: 11 additions & 0 deletions src/dashboard/Data/Browser/BrowserToolbar.react.js
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@ let BrowserToolbar = ({
onAttachRows,
onAttachSelectedRows,
onCloneSelectedRows,
onExportSelectedRows,
onExport,
onRemoveColumn,
onDeleteRows,
Expand Down Expand Up @@ -138,6 +139,16 @@ let BrowserToolbar = ({
onClick={onCloneSelectedRows}
/>
<Separator />
<MenuItem
disabled={!selectionLength}
text={`Export ${selectionLength <= 1 ? 'this row' : 'these rows'} to CSV`}
Vortec4800 marked this conversation as resolved.
Show resolved Hide resolved
onClick={() => onExportSelectedRows(selection)}
/>
<MenuItem
text={'Export all rows to CSV'}
onClick={() => onExportSelectedRows({ '*': true })}
/>
<Separator />
<MenuItem
disabled={selectionLength === 0}
text={selectionLength === 1 && !selection['*'] ? 'Delete this row' : 'Delete these rows'}
Expand Down
41 changes: 41 additions & 0 deletions src/dashboard/Data/Browser/ExportSelectedRowsDialog.react.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
/*
* Copyright (c) 2016-present, Parse, LLC
* All rights reserved.
*
* This source code is licensed under the license found in the LICENSE file in
* the root directory of this source tree.
*/
import Modal from 'components/Modal/Modal.react';
import React from 'react';

export default class ExportSelectedRowsDialog extends React.Component {
constructor() {
super();

this.state = {
confirmation: ''
};
}

valid() {
return true;
}

render() {
let selectionLength = Object.keys(this.props.selection).length;
return (
<Modal
type={Modal.Types.INFO}
icon='warn-outline'
title={this.props.selection['*'] ? 'Export all rows?' : (selectionLength === 1 ? 'Export this row?' : `Export ${selectionLength} rows?`)}
mtrezza marked this conversation as resolved.
Show resolved Hide resolved
subtitle={this.props.selection['*'] ? 'INFO: Export to CSV has a limit of 10,000 rows.' : ''}
disabled={!this.valid()}
confirmText={'Yes export'}
cancelText={'Never mind, don\u2019t.'}
onCancel={this.props.onCancel}
onConfirm={this.props.onConfirm}>
{}
</Modal>
Vortec4800 marked this conversation as resolved.
Show resolved Hide resolved
);
}
}