{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":145265409,"defaultBranch":"master","name":"spark","ownerLogin":"jxysoft","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2018-08-19T01:54:08.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/1910567?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1546187187.0","currentOid":""},"activityList":{"items":[{"before":"8cfd5bf1ca4042541232ef1787349ddb876adcfa","after":"39cc4abaff73cb49f9d79d1d844fe5c9fa14c917","ref":"refs/heads/master","pushedAt":"2023-10-10T08:38:40.000Z","pushType":"push","commitsCount":2507,"pusher":{"login":"jxysoft","name":null,"path":"/jxysoft","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1910567?s=80&v=4"},"commit":{"message":"[SPARK-45475][SQL] Uses DataFrame.foreachPartition instead of RDD.foreachPartition in JdbcUtils\n\n### What changes were proposed in this pull request?\n\nThis PR is kind of a followup for https://github.com/apache/spark/pull/39976 that addresses https://github.com/apache/spark/pull/39976#issuecomment-1752930380 comment.\n\n### Why are the changes needed?\n\nIn order to probably assign the SQL execution ID so `df.observe` works with this.\n\n### Does this PR introduce _any_ user-facing change?\n\nYes. `df.observe` will work with JDBC connectors.\n\n### How was this patch tested?\n\nManually tested.\n\n### Was this patch authored or co-authored using generative AI tooling?\n\nUnit test was added.\n\nCloses #43304 from HyukjinKwon/foreachbatch.\n\nAuthored-by: Hyukjin Kwon <gurwls223@apache.org>\nSigned-off-by: Hyukjin Kwon <gurwls223@apache.org>","shortMessageHtmlLink":"[SPARK-45475][SQL] Uses DataFrame.foreachPartition instead of RDD.for…"}}],"hasNextPage":false,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyMy0xMC0xMFQwODozODo0MC4wMDAwMDBazwAAAAOTZtEJ","startCursor":"Y3Vyc29yOnYyOpK7MjAyMy0xMC0xMFQwODozODo0MC4wMDAwMDBazwAAAAOTZtEJ","endCursor":"Y3Vyc29yOnYyOpK7MjAyMy0xMC0xMFQwODozODo0MC4wMDAwMDBazwAAAAOTZtEJ"}},"title":"Activity · jxysoft/spark"}