-
Notifications
You must be signed in to change notification settings - Fork 447
chore(llmobs): add support for creating experiment #13955
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
7820f7e
to
26b17bd
Compare
Bootstrap import analysisComparison of import times between this PR and base. SummaryThe average import time from this PR is: 274 ± 2 ms. The average import time from base is: 276 ± 2 ms. The import time difference between this PR and base is: -1.86 ± 0.08 ms. Import time breakdownThe following import paths have shrunk:
|
BenchmarksBenchmark execution time: 2025-07-14 22:52:57 Comparing candidate commit 6741cf7 in PR branch Found 0 performance improvements and 2 performance regressions! Performance is the same for 546 metrics, 2 unstable metrics. scenario:iastaspectsospath-ospathbasename_aspect
scenario:iastaspectsospath-ospathsplitext_aspect
|
fc02519
to
c5fb512
Compare
1af7041
to
7a27126
Compare
7a27126
to
482e8d4
Compare
MLOB-3275
Adds support for creating Experiments to Datadog. This isn't a user-facing change, but allows the LLMObs service/writer to send a POST request to LLMObs experiments to create a new experiment object.
Also includes minor type hints, as well as changing the LLMObs service instance to be stored on each Experiment object instead of the LLMObs class. Lastly adds tags as an Experiment attribute.
Checklist
Reviewer Checklist