Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
author Kartik Gupta <88345179+kartikgupta-db@users.noreply.github.com> 1688609182 +0200 committer Spece <Michael.Spece@Chubb.Com> 1689629188 -0400 gpgsig -----BEGIN PGP SIGNATURE----- iQGzBAABCAAdFiEEmFkdmlNpeHaohb9psG3XEklX7TkFAmS1sgQACgkQsG3XEklX 7Tl6Cgv9GDR+CQVJBr7SrITDS41HgQLIN/s/o3o/gX7htrYC9LTW95hKSUXmirMO 6+ZfI/rJpgB4nwe7fW47mn+nkXS+RrTO+LVZ3mzhiOunNGyGNix8BpjusjSmIxmB kCfgNLjQ9kLVLN1MRrYD4G4eg5zIkjgdNGMpZ1zxOcxue7Vd+qd5nGusUAiBEZIN ok5bw/VrfEBhYFx8S+XS3+OQpXAECc/tO4jmPghq5LIaP3SnlqS3/8MrYZOAP4kT zvmT+l/ySfAtl49I3tV5gDzB1myu717l2rzyE9JovDg4JIpdB+F3ZkYupgKozw8+ RhdM+4NH+0w+A4NhgGKA+fn80cK2ZW9fNLjSqv5JQa2ppb/LJNs+ZiCKQVmNA/jP dYNI++d3sc+lrNlGHjZPQ8NQBJYxMuOC9OKTLC4vEJQ8Cc2hXUKlAYCqIvTFDoKP a21ynsDe8L+CDAKT6u3jSiUbNUlhl8cck4pFsRbVZYiikuBidtlHHLoXmHjeSayZ N8eiCeeh =15Z+ -----END PGP SIGNATURE----- parent befbb42 author Kartik Gupta <88345179+kartikgupta-db@users.noreply.github.com> 1688609182 +0200 committer Spece <Michael.Spece@Chubb.Com> 1689629116 -0400 gpgsig -----BEGIN PGP SIGNATURE----- iQGzBAABCAAdFiEEmFkdmlNpeHaohb9psG3XEklX7TkFAmS1sbwACgkQsG3XEklX 7TnEJgv+PhwF46QO+N5yEQNdzX8sCi/7pkZePiELGSzjkqEL75wNxrYX22PKaW6V 2ThXk7wczONZYozzadZzB72uZ+jqm5xAtr/QaOZhz8h/xJ79IsuGT+rtA198mCjv k+G/2iZzAb5Jcs08X58YrZJCYPQDPTXmElyRUskMhiO2wjmVgcL80JpHk4UKLBfU 2m3ZJY/ZSBFfBdrHCqHUVfyq8KgC7dcxEApgX4ZNb0eE0wC9PbtrfIzgkrTGuMPE lD0Vp7QIAJozWeO5SJe7HHxSQl3qTSiADjZC2wMQQ4a87eKC6g0hDKt7rTGo75s0 p9UO+MUJHh3/QcHkSIzRYOzkPjLOGIhpnMWAufJNOxRVJdiT0xuDFo2bOZ6JMgRV u2BrGa1ujC+sAgmicuAtBZeC5lf8mKpBgW2/VWFZN7UOMeSxZewgSd9G4xLxGOvt C2htT9yH4zsjHZLAlUqQp8LN4QjCo3lSB/0CBXMNq2FjCI2FKhdjScyJ4hxd++Ol M01P9FU/ =F3cq -----END PGP SIGNATURE----- [DECO-1115] Add local implementation for `dbutils.widgets` (databricks#93) * Added a new install group (`pip install 'databricks-sdk[notebook]'`). This allows us to safely pin ipywidgets for local installs. DBR can safely continue using `pip install databricks-sdk` or directly using the default build from master without conflicting dependencies. * OSS implementation of widgets is imported only on first use (possible only through OSS implementation of dbutils - `RemoteDbutils`). * Add a wrapper for ipywidgets to enable interactive widgets when in interactive **IPython** notebooks. https://user-images.githubusercontent.com/88345179/236443693-1c804107-ba21-4296-ba40-2b1e8e062d16.mov * Add default widgets implementation that returns a default value, when not in an interactive environment. https://user-images.githubusercontent.com/88345179/236443729-51185404-4d28-49c6-ade0-a665e154e092.mov <!-- How is this tested? Please see the checklist below and also describe any other relevant tests --> - [x] `make test` run locally - [x] `make fmt` applied - [ ] relevant integration tests applied Fix error message, ExportFormat -> ImportFormat (databricks#220) The proper argument is ImportFormat.AUTO, not ExportFormat.AUTO Correct the error message when `ImportFormat` is not provided to `workspace.upload`. Signed-off-by: Jessica Smith <8505845+NodeJSmith@users.noreply.github.com> Regenerate Python SDK using recent OpenAPI Specification (databricks#229) Spec commit sha: 17a3f7fe6 (7 July 2023) Breaking Changes: * Use CONSTANT_CASE for Enum constants. Many enums already use constant case in their definition, but some constants (like the SCIM Patch schema name) includes symbols `:` and numbers, so the SDK cannot use the enum value as the name. * Replace Query type with AlertQuery in sql.Alert class. * Removal of User.is_db_admin and User.profile_image_url. Changes: * Introduce CleanRooms API * Introduce TablesAPI.update() * Introduce Group.meta property * Fix SCIM Patch implementation * Introduce BaseRun.job_parameters and BaseRun.trigger_info * Introduce CreateJob.parameters * Fix spelling in file arrival trigger configuration * Introduce GitSource.job_source * Introduce RepairRun.rerun_dependent_tasks * Introduce Resolved*Values classes, RunIf, and RunJobTask * Introduce TaskNotificationSettings Later follow-up: * Names should split on Pascal-case word boundaries (see CloudProviderNodeStatus). This is an OpenAPI code gen change that needs to be made. Make workspace client also return runtime dbutils when in dbr (databricks#210) * `workspace_client.dbutils` always returned oss implementation of dbutils. We want it to also use dbr implementation when in dbr. * [x] Manually Test in dbr * [x] Test locally - [x] `make test` run locally - [x] `make fmt` applied - [ ] relevant integration tests applied Use .ConstantName defining target enum states for waiters (databricks#230) Uses of enums in generated code need to be updated to use `{{.ConstantName}}` instead of `{{.Content}}`. - [ ] `make test` run locally - [ ] `make fmt` applied - [ ] relevant integration tests applied Fix enum deserialization (databricks#234) In databricks#230, enums were changed so that enum field names did not necessarily match the enum value itself. However, the `_enum` helper method used during deserialization of a response containing an enum was not updated to handle this case. This PR corrects this method to check through the values of the `__members__` of an enum, as opposed to the keys. <!-- How is this tested? Please see the checklist below and also describe any other relevant tests --> - [ ] `make test` run locally - [ ] `make fmt` applied - [ ] relevant integration tests applied Fix enum deserialization, take 2 (databricks#235) We jumped the gun too quickly on databricks#234. This is the actual change which fixes the integration tests. - [x] The two failing integration tests (test_submitting_jobs and test_proxy_dbfs_mounts) both pass on this PR. Added toolchain configuration to `.codegen.json` (databricks#236) - Added toolchain config for automated releases - Added `CHANGELOG.md` template with OpenAPI SHA prep release changes Make OpenAPI spec location configurable (databricks#237) Introducing `DATABRICKS_OPENAPI_SPEC` environment variable to hold a filesystem location of `all-internal.json` spec. Rearrange imports in `databricks.sdk.runtime` to improve local editor experience (databricks#219) <!-- Summary of your changes that are easy to understand --> The type hinting here means that VSCode does not give useful syntax highlights / code completions. This is the current experience on `main`: <img width="428" alt="image" src="https://github.com/databricks/databricks-sdk-py/assets/17158624/72d2c3eb-cc3a-4f95-9f09-7d43a8f2815e"> <img width="428" alt="image" src="https://github.com/databricks/databricks-sdk-py/assets/17158624/34b04de0-5996-4a2e-a0d2-b26a8c9d3da9"> With these changes this becomes: <img width="428" alt="image" src="https://github.com/databricks/databricks-sdk-py/assets/17158624/99a91d82-f06a-4883-b131-7f96a82edd80"> <img width="818" alt="image" src="https://github.com/databricks/databricks-sdk-py/assets/17158624/ce684fd0-f550-4afe-bc46-1187b6dd4b49"> <!-- How is this tested? Please see the checklist below and also describe any other relevant tests --> - [x] `make test` run locally - [x] `make fmt` applied - [ ] relevant integration tests applied [DECO-1115] Add local implementation for `dbutils.widgets` (databricks#93) * Added a new install group (`pip install 'databricks-sdk[notebook]'`). This allows us to safely pin ipywidgets for local installs. DBR can safely continue using `pip install databricks-sdk` or directly using the default build from master without conflicting dependencies. * OSS implementation of widgets is imported only on first use (possible only through OSS implementation of dbutils - `RemoteDbutils`). * Add a wrapper for ipywidgets to enable interactive widgets when in interactive **IPython** notebooks. https://user-images.githubusercontent.com/88345179/236443693-1c804107-ba21-4296-ba40-2b1e8e062d16.mov * Add default widgets implementation that returns a default value, when not in an interactive environment. https://user-images.githubusercontent.com/88345179/236443729-51185404-4d28-49c6-ade0-a665e154e092.mov <!-- How is this tested? Please see the checklist below and also describe any other relevant tests --> - [x] `make test` run locally - [x] `make fmt` applied - [ ] relevant integration tests applied Fix error message, ExportFormat -> ImportFormat (databricks#220) The proper argument is ImportFormat.AUTO, not ExportFormat.AUTO Correct the error message when `ImportFormat` is not provided to `workspace.upload`. Signed-off-by: Jessica Smith <8505845+NodeJSmith@users.noreply.github.com> Regenerate Python SDK using recent OpenAPI Specification (databricks#229) Spec commit sha: 17a3f7fe6 (7 July 2023) Breaking Changes: * Use CONSTANT_CASE for Enum constants. Many enums already use constant case in their definition, but some constants (like the SCIM Patch schema name) includes symbols `:` and numbers, so the SDK cannot use the enum value as the name. * Replace Query type with AlertQuery in sql.Alert class. * Removal of User.is_db_admin and User.profile_image_url. Changes: * Introduce CleanRooms API * Introduce TablesAPI.update() * Introduce Group.meta property * Fix SCIM Patch implementation * Introduce BaseRun.job_parameters and BaseRun.trigger_info * Introduce CreateJob.parameters * Fix spelling in file arrival trigger configuration * Introduce GitSource.job_source * Introduce RepairRun.rerun_dependent_tasks * Introduce Resolved*Values classes, RunIf, and RunJobTask * Introduce TaskNotificationSettings Later follow-up: * Names should split on Pascal-case word boundaries (see CloudProviderNodeStatus). This is an OpenAPI code gen change that needs to be made. Make workspace client also return runtime dbutils when in dbr (databricks#210) * `workspace_client.dbutils` always returned oss implementation of dbutils. We want it to also use dbr implementation when in dbr. * [x] Manually Test in dbr * [x] Test locally - [x] `make test` run locally - [x] `make fmt` applied - [ ] relevant integration tests applied Use .ConstantName defining target enum states for waiters (databricks#230) Uses of enums in generated code need to be updated to use `{{.ConstantName}}` instead of `{{.Content}}`. - [ ] `make test` run locally - [ ] `make fmt` applied - [ ] relevant integration tests applied Fix enum deserialization, take 2 (databricks#235) We jumped the gun too quickly on databricks#234. This is the actual change which fixes the integration tests. - [x] The two failing integration tests (test_submitting_jobs and test_proxy_dbfs_mounts) both pass on this PR. Added toolchain configuration to `.codegen.json` (databricks#236) - Added toolchain config for automated releases - Added `CHANGELOG.md` template with OpenAPI SHA prep release changes Make OpenAPI spec location configurable (databricks#237) Introducing `DATABRICKS_OPENAPI_SPEC` environment variable to hold a filesystem location of `all-internal.json` spec. Rearrange imports in `databricks.sdk.runtime` to improve local editor experience (databricks#219) <!-- Summary of your changes that are easy to understand --> The type hinting here means that VSCode does not give useful syntax highlights / code completions. This is the current experience on `main`: <img width="428" alt="image" src="https://github.com/databricks/databricks-sdk-py/assets/17158624/72d2c3eb-cc3a-4f95-9f09-7d43a8f2815e"> <img width="428" alt="image" src="https://github.com/databricks/databricks-sdk-py/assets/17158624/34b04de0-5996-4a2e-a0d2-b26a8c9d3da9"> With these changes this becomes: <img width="428" alt="image" src="https://github.com/databricks/databricks-sdk-py/assets/17158624/99a91d82-f06a-4883-b131-7f96a82edd80"> <img width="818" alt="image" src="https://github.com/databricks/databricks-sdk-py/assets/17158624/ce684fd0-f550-4afe-bc46-1187b6dd4b49"> <!-- How is this tested? Please see the checklist below and also describe any other relevant tests --> - [x] `make test` run locally - [x] `make fmt` applied - [ ] relevant integration tests applied
- Loading branch information
1 parent
befbb42
commit 3f9bfb7