How to use equality delete in Iceberg v2 table

[wsjz]

Feature Request / Improvement

I want to generate equality delete in EMR spark, but It's all position delete, so how can I use this

Query engine

Spark

[singhpk234]

writing Equality deletes are not supported in spark as of now, I think only flink supports it at the moment

[nastra]

@singhpk234 is it worth documenting this so that it's clearer for users?

[singhpk234]

@singhpk234 is it worth documenting this so that it's clearer for users?

+1 I think we should document this, have seen this come up quite a number of times in slack discussions.
I think adding a note here https://github.com/apache/iceberg/blob/master/docs/spark-writes.md#spark-writes or https://github.com/apache/iceberg/blob/master/docs/spark-writes.md#delete-from should be sufficient thoughts ?

[ajantha-bhat]

@singhpk234, @nastra:

I think we need to add it to this. Without mentioning what is row-level-deletes, we can't add the note in spark writes.
#3432

I pinged @jackye1995 at that time, but he didn't reply. Maybe I can open a new PR by adding him as a co-author.

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'

[tanvn]

@singhpk234 is it worth documenting this so that it's clearer for users?

Actually it took me a while to find this issue to confirm that Equality deletes are not supported in Spark (after spending one hour reading the source code). I think it would be very helpful if this information can be found more easily.

[link3280]

@singhpk234 is it worth documenting this so that it's clearer for users?

Actually it took me a while to find this issue to confirm that Equality deletes are not supported in Spark (after spending one hour reading the source code). I think it would be very helpful if this information can be found more easily.

@tanvn Hi, would you kindly give me a pointer to the code snippet? Thx!