Skip to content

Issues: Agenta-AI/agenta

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

33 Open 573 Closed
33 Open 573 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Support Bedrock , in particular, support bedrock claude models feature request planned
#2165 opened Nov 1, 2024 by yangcheng
2
Integration with Azure OpenAI feature request planned
#2153 opened Oct 28, 2024 by frburrue
1
[Bug] Error while running prompt on gemini flash bug Something isn't working incomplete description
#2142 opened Oct 22, 2024 by praneeth-arintra
2
Allow more authentication types feature request
#1972 opened Aug 7, 2024 by tarunwadhwa13
Make Docker URL for fetching Templates flexible Backend feature request
#1964 opened Aug 5, 2024 by tarunwadhwa-paypay
1
[AGE-452] [bug] create_new_evaluator_config not setting default correct_answer value Backend bug Something isn't working SDK
#1916 opened Jul 19, 2024 by mmabrouk
@bilalqv
2
After local deployment, when creating an app through the page, there is still an error message when opening it http://0.0.0.0:80 How to modify this for accessing bug Something isn't working
#1915 opened Jul 19, 2024 by lsm1103
5
Can I deploy without using port 80 ？ Backend Frontend question Further information is requested
#1909 opened Jul 18, 2024 by lsm1103
6
[AGE-433] [bug] New exact match and JSON evaluators are created with each served variant Backend bug Something isn't working good first issue Good for newcomers Low priority Created by Linear-GitHub Sync
#1901 opened Jul 16, 2024 by mmabrouk
@Dozie2001
4
Add encryption to LLM provider keys before saving it enhancement New feature or request Frontend
#1879 opened Jul 12, 2024 by ashrafchowdury
2
@ashrafchowdury
[AGE-112] [Evaluations] start new evaluation from previous evaluation enhancement New feature or request Frontend Medium priority Created by Linear-GitHub Sync UX
#1870 opened Jul 10, 2024 by mmabrouk Evaluation v2 WIP
Add Exception handling in Agenta Observability feature request SDK UI
#1847 opened Jul 5, 2024 by jp-agenta
1
[AGE-370] Improve reproducibility of AI critique outputs Backend enhancement New feature or request improvement
#1825 opened Jun 28, 2024 by mmabrouk
1
[AGE-357] [bug] Removing a variant used in an A/B test evaluation breaks the human evaluation view Backend bug Something isn't working
#1817 opened Jun 26, 2024 by mmabrouk
@mmabrouk
[AGE-230] [Bug] Start from code can fail if user has a .dockerignore or Dockerfile bug Something isn't working Low priority Created by Linear-GitHub Sync
#1738 opened Jun 2, 2024 by mmabrouk v.64
1
@mmabrouk
Add an option to remove RestrictedPython evaluator in secure environments enhancement New feature or request
#1709 opened May 28, 2024 by LucasTrg
[Bug] Agenta Variant container fails to start due to missing env var bug Something isn't working python Pull requests that update Python code
#1506 opened Apr 12, 2024 by alanmun
1
Add an error message when serving the app with wrong types of the config params bug Something isn't working Frontend low-priority
#1429 opened Mar 7, 2024 by SamMethnani
@aybruhm @bekossy
[Feature] Rerun a single evaluation scenario Backend Frontend
#1396 opened Feb 19, 2024 by mmabrouk
3 tasks done
@aakrem @MohammedMaaz
[Roadmap] Improve Evaluation Workflow and Add new Evaluators evaluation Roadmap
#1393 opened Feb 19, 2024 by mmabrouk
8 of 9 tasks
[Issue] Custom code evaluation is quite limited in the libraries that can be used due to using RestrictedPython dev experience Improvement of the experience using the software. For instance better error messaging improvement
#1365 opened Feb 14, 2024 by mmabrouk
@aybruhm
[Edge case] After editing an evaluator config, new evaluations are not comparable to old evaluations Backend bug Something isn't working evaluation Frontend
#1341 opened Feb 6, 2024 by aakrem
2
[Roadmap] Improvements to Human Evaluation and Annotation View evaluation
#1299 opened Jan 29, 2024 by mmabrouk
2 of 5 tasks
1
Improvement human evaluation view evaluation Frontend
#1295 opened Jan 28, 2024 by mmabrouk
1 task done
@aakrem @bekossy
[AGE-274] Evaluation: Rerun a cancelled job evaluation linear Created by Linear-GitHub Sync stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed
#1249 opened Jan 22, 2024 by aybruhm
@aybruhm
1
ProTip! Exclude everything labeled bug with -label:bug.