Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MAINTENANCE] [MAINTENANCE] Add force_reuse_spark_context to DatasourceConfigSchema #3126

Merged
merged 34 commits into from
Aug 20, 2021
Merged

[MAINTENANCE] [MAINTENANCE] Add force_reuse_spark_context to DatasourceConfigSchema #3126

merged 34 commits into from
Aug 20, 2021

Commits on Jul 28, 2021

  1. [MAINTENANCE] Adds spark_config and force_reuse_spark_context fields … 

    …to DataSourceConfigSchema
    gipaetusb committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    7201b77 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into maintenance/reuse-spark-context-emr

    @pasmavie
    pasmavie authored Jul 28, 2021
    Configuration menu
    Copy the full SHA
    e16462d View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2021

  1. Merge branch 'develop' into maintenance/reuse-spark-context-emr

    @pasmavie
    pasmavie authored Aug 6, 2021
    Configuration menu
    Copy the full SHA
    a4e4ff8 View commit details
    Browse the repository at this point in the history

  2. Adds changes bullet point to docs_rtd/changelog.rst

    @pasmavie
    pasmavie committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    d2c80fa View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2021

  1. Merge remote-tracking branch 'origin/develop' into maintenance/reuse-… 

    …spark-context-emr

# Conflicts:
#	docs_rtd/changelog.rst
    @mbakunze
    mbakunze committed Aug 13, 2021
    Configuration menu
    Copy the full SHA
    e40de89 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into maintenance/reuse-spark-context-emr

    @mbakunze
    mbakunze authored Aug 13, 2021
    Configuration menu
    Copy the full SHA
    1ce2ca1 View commit details
    Browse the repository at this point in the history

  3. remove spark_config from DatasourceConfigSchema

    @mbakunze
    mbakunze committed Aug 13, 2021
    Configuration menu
    Copy the full SHA
    01e5e51 View commit details
    Browse the repository at this point in the history

  4. allow None for force_reuse_spark_context

    @mbakunze
    mbakunze committed Aug 13, 2021
    Configuration menu
    Copy the full SHA
    851cd04 View commit details
    Browse the repository at this point in the history

  5. fix linting

    @mbakunze
    mbakunze committed Aug 13, 2021
    Configuration menu
    Copy the full SHA
    9ec3735 View commit details
    Browse the repository at this point in the history

  6. remove missing entry for force_reuse_spark_context

    @mbakunze
    mbakunze committed Aug 13, 2021
    Configuration menu
    Copy the full SHA
    c170c9b View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2021

  1. adding back spark_config

    @mbakunze
    mbakunze committed Aug 14, 2021
    Configuration menu
    Copy the full SHA
    c5a6c66 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2021

  1. Merge branch 'develop' into maintenance/reuse-spark-context-emr

    @mbakunze
    mbakunze authored Aug 15, 2021
    Configuration menu
    Copy the full SHA
    d5ca8d5 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2021

  1. adding unittests for force_reuse_spark_context

    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    10aca2a View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/maintenance/reuse-spark-context-… 

    …emr' into maintenance/reuse-spark-context-emr
    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    44cd676 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into maintenance/reuse-spark-context-emr

    @mbakunze
    mbakunze authored Aug 16, 2021
    Configuration menu
    Copy the full SHA
    1adde14 View commit details
    Browse the repository at this point in the history

  4. adding unittest for spark_config pass through

    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    cb39f1b View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/maintenance/reuse-spark-context-… 

    …emr' into maintenance/reuse-spark-context-emr
    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    bbc4ec0 View commit details
    Browse the repository at this point in the history

  6. adding unittest for spark_config pass through + run black

    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    cfb8c98 View commit details
    Browse the repository at this point in the history

  7. add docstrings to unittests to clarify intent

    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    82abefe View commit details
    Browse the repository at this point in the history

  8. add isort:skip for spark imports

    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    d336103 View commit details
    Browse the repository at this point in the history

  9. rename test to be more meaningful

    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    3ae3805 View commit details
    Browse the repository at this point in the history

  10. fix TypeError in unittest

    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    16f1c71 View commit details
    Browse the repository at this point in the history

  11. adding a non-default config in order to hopefully see the Py4jError i… 

    …n CI
    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    0a4ff1d View commit details
    Browse the repository at this point in the history

  12. remove explicit P4jError test

    @mbakunze
    mbakunze committed Aug 16, 2021
    Configuration menu
    Copy the full SHA
    6bc4ac7 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2021

  1. Merge branch 'develop' into maintenance/reuse-spark-context-emr

    @mbakunze
    mbakunze authored Aug 17, 2021
    Configuration menu
    Copy the full SHA
    014140c View commit details
    Browse the repository at this point in the history

  2. add explicit test for sparkdf kwargs pass-through

    @mbakunze
    mbakunze committed Aug 17, 2021
    Configuration menu
    Copy the full SHA
    e0a128e View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/maintenance/reuse-spark-context-… 

    …emr' into maintenance/reuse-spark-context-emr
    @mbakunze
    mbakunze committed Aug 17, 2021
    Configuration menu
    Copy the full SHA
    c634a28 View commit details
    Browse the repository at this point in the history

  4. update changelog entry to reflect this is a BUGFIX

    @mbakunze
    mbakunze committed Aug 17, 2021
    Configuration menu
    Copy the full SHA
    ff93e0b View commit details
    Browse the repository at this point in the history

  5. fix linting

    @mbakunze
    mbakunze committed Aug 17, 2021
    Configuration menu
    Copy the full SHA
    3ca3fb1 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2021

  1. Merge branch 'develop' into maintenance/reuse-spark-context-emr

    @mbakunze
    mbakunze authored Aug 19, 2021
    Configuration menu
    Copy the full SHA
    2daf0eb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into maintenance/reuse-spark-context-emr

    @mbakunze
    mbakunze authored Aug 19, 2021
    Configuration menu
    Copy the full SHA
    1ac14a7 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2021

  1. Merge branch 'develop' into maintenance/reuse-spark-context-emr

    @pasmavie
    pasmavie authored Aug 20, 2021
    Configuration menu
    Copy the full SHA
    bb4bbf1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'mbakunze-maintenance/reuse-spark-context-emr' into main… 

    …tenance/reuse-spark-context-emr
    @pasmavie
    pasmavie committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    bc520f4 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'maintenance/reuse-spark-context-emr' of github.com:gipa… 

    …etusb/great_expectations into maintenance/reuse-spark-context-emr
    @pasmavie
    pasmavie committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    a210a83 View commit details
    Browse the repository at this point in the history