Added Langfuse as agent observation instrumentation

[elie605]

Added Langfuse as agent observation instrumentation

Langfuse

To use langfuse add the following to your .env

LANGFUSE_SECRET_KEY="CHANGE ME"
LANGFUSE_PUBLIC_KEY="CHANGE ME"
LANGFUSE_BASE_URL="https://cloud.langfuse.com"
LANGFUSE_ENABLED=True

And add "Langfuse" as extra to the orchestrator requirements:

orchestrator-core[celery,search,agent,langfuse]

Setting up Langfuse

You can create a cloud account for free but there are also several self-host options:

Docker-compose

Clone Langfuse Repository

Get a copy of the latest Langfuse repository:

git clone https://github.com/langfuse/langfuse.git
cd langfuse

Start the application

Update the secrets in the docker-compose.yml and then run the langfuse docker compose using:

docker compose up

Watch the containers being started and the logs flowing in. After about 2-3 minutes, the langfuse-web-1 container should log “Ready”. At this point you can proceed to the next step.
Done

And you are ready to go! Open http://localhost:3000 in your browser to access the Langfuse UI.

Production-scale deployments

For production and high-availability deployments, we recommend one of the following options:

• Kubernetes (Helm)
• AWS (Terraform)
• Azure (Terraform)
• GCP (Terraform)
• Railway

[codspeed-hq]

Merging this PR will not alter performance

✅ 13 untouched benchmarks

---

_{Comparing langfuse-poc-clean (b3eaefc) with main (eedd0cd)}

[sentry]

Codecov Report

❌ Patch coverage is 33.33333% with 10 lines in your changes missing coverage. Please review.
✅ Project coverage is 80.27%. Comparing base (eedd0cd) to head (b3eaefc).

Files with missing lines	Patch %	Lines
orchestrator/search/agent/agent.py	9.09%	9 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1375      +/-   ##
==========================================
- Coverage   80.33%   80.27%   -0.06%     
==========================================
  Files         275      275              
  Lines       13854    13869      +15     
  Branches     1369     1372       +3     
==========================================
+ Hits        11129    11134       +5     
- Misses       2410     2419       +9     
- Partials      315      316       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.