Skip to content

[MLOB-983] Add LLM Observability and Serverless Compatibility Documentation #24000

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Jul 24, 2024

Conversation

sabrenner
Copy link
Contributor

@sabrenner sabrenner commented Jul 3, 2024

What does this PR do? What is the motivation?

Adds documentation for using LLM Observability in serverless environments. This is following a change in our datadog-lambda-python layer to handle enabling LLM Observability, and providing out-of-the-box force flushing by default, we want users to be able to take advantage of these changes for an easier serverless onboarding experience.

Merge instructions

  • Please merge after reviewing

Copy link
Contributor

github-actions bot commented Jul 3, 2024

@sabrenner sabrenner changed the title [MLOB-983] [MLOB-983] Add LLM Observability and Serverless Compatibility Documentation Jul 3, 2024
@sabrenner sabrenner added the WORK IN PROGRESS No review needed, it's a wip ;) label Jul 3, 2024
@sabrenner sabrenner marked this pull request as ready for review July 9, 2024 19:42
@sabrenner sabrenner requested a review from a team as a code owner July 9, 2024 19:42
@sabrenner sabrenner removed the WORK IN PROGRESS No review needed, it's a wip ;) label Jul 9, 2024
@sabrenner sabrenner marked this pull request as draft July 9, 2024 19:42
@sabrenner sabrenner marked this pull request as ready for review July 24, 2024 14:55
Copy link
Contributor

@alai97 alai97 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, some small suggestions!

sabrenner and others added 3 commits July 24, 2024 14:32
Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>
Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>
Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>
@alai97 alai97 added the editorial review Waiting on a more in-depth review label Jul 24, 2024
Copy link
Contributor

@alai97 alai97 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@alai97 alai97 merged commit 2e5503e into master Jul 24, 2024
16 checks passed
@alai97 alai97 deleted the sambrenner/llmobs-serverless branch July 24, 2024 19:07
cy-moi pushed a commit that referenced this pull request Jul 29, 2024
…tation (#24000)

* documentation changes

* changes

* fixes

* change wording

* move force flushing, update installing layers language

* fix

* Update content/en/llm_observability/sdk.md

Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>

* Update content/en/llm_observability/sdk.md

Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>

* Update content/en/llm_observability/trace_an_llm_application.md

Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>

---------

Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
editorial review Waiting on a more in-depth review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants