Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AGE-112] [Evaluations] start new evaluation from previous evaluation #1870

Closed
mmabrouk opened this issue Jul 10, 2024 · 1 comment
Closed
Labels
enhancement New feature or request Frontend Medium priority Created by Linear-GitHub Sync UX
Milestone

Comments

@mmabrouk
Copy link
Member

-> Quality-of-life improvements

Motivations for having start from

  • When in focus mode, making changes to variants and using multiple evaluators, I, as a user, don't want to configure each evaluation, every single time. Instead, with the click of one button, I want to run a new evaluation with the same settings, dataset, variants, and evaluators. One click.

Downsides of not having start from

  • When tired, multi-tasking, or working with complex evaluations, I, as a user, might misconfigure an evaluation without noticing.

Considerations for start from

  • Evaluations are immutable, so rerunning an evaluation mean creating a new one.
  • This may evolve if/when datasets and evaluators get variants and revisions.

Elements required for start from

  • A frontend button called start from that would effectively copy an evaluation settings and create a new one, as long as it's still possible, i.e. dataset, variants, and evaluators still exist.

From SyncLinear.com | AGE-112

@dosubot dosubot bot added enhancement New feature or request UX labels Jul 10, 2024
@mmabrouk mmabrouk added this to the Evaluation v2 WIP milestone Aug 11, 2024
@mmabrouk
Copy link
Member Author

Postponed

@mmabrouk mmabrouk modified the milestones: Evaluation v2 WIP, v.64 Nov 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Frontend Medium priority Created by Linear-GitHub Sync UX
Projects
None yet
Development

No branches or pull requests

1 participant