Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎉 New Destination: Databricks #5998

Merged
merged 28 commits into from
Sep 14, 2021
Merged

🎉 New Destination: Databricks #5998

Changes from 1 commit
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
942ef2e
skeleton databricks destination
Phlair Aug 25, 2021
4c3e10c
Delete DynamicClassLoader.java
Phlair Aug 25, 2021
3e5ddef
Merge branch 'master' into george/hotload-jar
tuliren Aug 31, 2021
af94c07
Update dependency
tuliren Aug 31, 2021
d7db844
Implement databricks destination as a stream copier (#5748)
tuliren Aug 31, 2021
5779333
Update spec and configs (#5792)
Phlair Sep 2, 2021
e6aa16a
Remove connector definition json
tuliren Sep 2, 2021
74877eb
Depend on local spark jdbc driver
tuliren Sep 8, 2021
f3383f1
Merge branch 'master' into liren/destination-databricks
tuliren Sep 11, 2021
e92f22f
Implement databricks copy destination
tuliren Sep 12, 2021
ee1f165
Fix check method
tuliren Sep 13, 2021
3821dd4
Add ci credential
tuliren Sep 13, 2021
9c7917c
Fix second sync test
tuliren Sep 13, 2021
3dddd3b
Add unit tests
tuliren Sep 13, 2021
5eb3e3b
Format code
tuliren Sep 13, 2021
736975c
Update destination table location
tuliren Sep 13, 2021
c0ef240
Update documentation
tuliren Sep 13, 2021
3895c10
Fix schema deletion bug
tuliren Sep 13, 2021
e310e0b
Update readme
tuliren Sep 13, 2021
8586890
Reuse avro record helper from s3
tuliren Sep 13, 2021
a55e4c0
Add sample config.json
tuliren Sep 13, 2021
7ea6326
Replace s3 config with data source
tuliren Sep 14, 2021
6257848
Update documentation
tuliren Sep 14, 2021
596d5c0
Update doc
tuliren Sep 14, 2021
7cc610f
Update logging of s3 full path
tuliren Sep 14, 2021
294c816
Add comments about driver url
tuliren Sep 14, 2021
9f7f14c
Add purge_data_source parameter for debugging
tuliren Sep 14, 2021
7e7cbf6
Enable automatic optimization
tuliren Sep 14, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'master' into george/hotload-jar
  • Loading branch information
@tuliren
tuliren committed Aug 31, 2021
commit 3e5ddef557276d9f3d212074cf031113410be885

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.