Skip to content

datadog_agent source should accept LLMObs telemetry #25441

@xavirg

Description

@xavirg

A note for the community

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment

Use Cases

I would like to send Datadog LLMObs telemetry by instrumenting the code using https://docs.datadoghq.com/llm_observability/instrumentation/sdk?tab=python, and be ingested by Vector as the rest of the telemetry.

Attempted Solutions

Using this Vector config:

sources:
  datadog_agent:
    type: datadog_agent
    address: "0.0.0.0:8080"
    store_api_key: false
    tls:
      enabled: true
      crt_file: "${CERT_PATH}"
      key_file: "${KEY_PATH}"
      key_pass: "${AWS_CERT_PASSPHRASE}"
    multiple_outputs: true

sinks:
  drop_logs:
    type: blackhole
    inputs:
      - datadog_agent.logs
  datadog_metrics:
    type: datadog_metrics
    inputs:
      - tag_metrics
    default_api_key: "${DD_API_KEY_METRICS}"

  datadog_traces:
    type: datadog_traces
    inputs:
      - tag_traces
    default_api_key: "${DD_API_KEY_TRACES}"

Tried to send LLMObs traces, but I'm getting this error on my app:

failed to send 2 LLMObs span events to https://MY_VECTOR_HOST/api/v2/llmobs, got response code 404, status: b''

The response makes me think that the endpoint is not implemented.

Proposal

Accept Datadog traces at /api/v2/llmobs endpoint.

References

No response

Version

0.55

Metadata

Metadata

Assignees

No one assigned

    Labels

    No fields configured for Feature.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions