You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Proposal: 12-task privacy-rights category (PR #391) and co-authorship question #392
PR #391 adds a privacy-rights category of 12 tasks in which the agent files a privacy request for the benchmark persona: deletion, access, data portability, correction, opt-out of sale or sharing, and objection to processing.
What it adds to ClawBench:
Write tasks with a real-world purpose. US law lets people authorize an agent to file these requests for them, so whether a browser agent can do it correctly is a practical question.
Jurisdiction handling. The forms default to the location they detect, and the agent has to file under the persona's real one, Ontario. The submitted policy id shows whether it did.
Request-type selection across inconsistent, company-specific labels, with deliberate near misses.
Data minimisation. The persona files hold government, health and financial identifiers, and every rubric fails a request that includes any of them.
The interceptor blocks every submission on each company's form, so a wrong choice by the agent never reaches the company. The request details are graded by the judge. The PR description explains that decision, how the forms were analysed without submitting anything, the offline test coverage, and what is still pending: one human-mode run per task, because most of these forms use a CAPTCHA.
Category
privacy-rights (new; extends the one-task deletion-revocation metaclass in V1)
Is the task behind a payment wall?
No (free action, needs interception)
Questions for the maintainers
Does privacy-rights count as a distinct new category in the sense of CONTRIBUTING.md?
If these 10+ tasks are merged, does the contribution fall under the CONTRIBUTING.md policy of being proposed as a co-author on the relevant follow-up paper or workshop submission, and the README's "co-author invitation on the next paper revision"? I'm asking now so the expectation is clear before review. Merge and authorship of course stay your decision.
Activity