Skip to content

Commit

Permalink
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
Browse files Browse the repository at this point in the history
  • Loading branch information
karthikscale3 committed Jul 12, 2024
2 parents edb0f85 + 0401c6c commit 16146a4
Show file tree
Hide file tree
Showing 5 changed files with 31 additions and 22 deletions.
36 changes: 21 additions & 15 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,11 +1,13 @@
# [Langtrace](https://www.langtrace.ai)

Open Source Observability for LLM applications

## Open Source & Open Telemetry(OTEL) Observability for LLM applications

![Static Badge](https://img.shields.io/badge/License-AGPL--3.0-blue)
[![NPM Typescript SDK](https://img.shields.io/npm/v/%40langtrase%2Ftypescript-sdk?style=flat&logo=npm&label=%40langtrase%2Ftypescript-sdk&color=green&link=https%3A%2F%2Fgithub.com%2FScale3-Labs%2Flangtrace-typescript-sdk)](https://github.com/Scale3-Labs/langtrace-typescript-sdk)
[![PyPI Python SDK](https://img.shields.io/pypi/v/langtrace-python-sdk?style=flat&logo=python&label=langtrace-python-sdk&color=green&link=https%3A%2F%2Fgithub.com%2FScale3-Labs%2Flangtrace-python-sdk)](https://github.com/Scale3-Labs/langtrace-python-sdk)
[![Downloads](https://static.pepy.tech/badge/langtrace-python-sdk/month)](https://pepy.tech/project/langtrace-python-sdk)
[![NPM Trace Attributes](https://img.shields.io/npm/v/%40langtrase%2Ftrace-attributes?style=flat&logo=npm&label=%40langtrase%2Ftrace-attributes&color=green&link=https%3A%2F%2Fgithub.com%2FScale3-Labs%2Flangtrace-trace-attributes)](https://github.com/Scale3-Labs/langtrace-trace-attributes)
[![PyPI Trace Attributes](https://img.shields.io/pypi/v/trace-attributes?style=flat&logo=python&label=trace-attributes&color=green&link=https%3A%2F%2Fgithub.com%2FScale3-Labs%2Flangtrace-trace-attributes)](https://github.com/Scale3-Labs/langtrace-trace-attributes)
![Static Badge](https://img.shields.io/badge/Development_status-Active-green)
Expand Down Expand Up @@ -123,21 +125,25 @@ docker compose down -v

Langtrace automatically captures traces from the following vendors:

| Vendor | Type | Typescript SDK | Python SDK |
| ------------ | --------------- | ------------------ | ------------------ |
| OpenAI | LLM | :white_check_mark: | :white_check_mark: |
| Anthropic | LLM | :white_check_mark: | :white_check_mark: |
| Azure OpenAI | LLM | :white_check_mark: | :white_check_mark: |
| Cohere | LLM | :white_check_mark: | :white_check_mark: |
| Groq | LLM | :x: | :white_check_mark: |
| Langchain | Framework | :x: | :white_check_mark: |
| LlamaIndex | Framework | :white_check_mark: | :white_check_mark: |
| DSPy | Framework | :x: | :white_check_mark: |
| CrewAI | Framework | :x: | :white_check_mark: |
| Pinecone | Vector Database | :white_check_mark: | :white_check_mark: |
| ChromaDB | Vector Database | :white_check_mark: | :white_check_mark: |
| QDrant | Vector Database | :white_check_mark: | :white_check_mark: |
| Weaviate | Vector Database | :white_check_mark: | :white_check_mark: |
| Vendor | Type | Typescript SDK | Python SDK |
| ------------ | --------------- | ------------------ | ------------------------------- |
| OpenAI | LLM | :white_check_mark: | :white_check_mark: |
| Anthropic | LLM | :white_check_mark: | :white_check_mark: |
| Azure OpenAI | LLM | :white_check_mark: | :white_check_mark: |
| Cohere | LLM | :white_check_mark: | :white_check_mark: |
| Groq | LLM | :x: | :white_check_mark: |
| Perplexity | LLM | :white_check_mark: | :white_check_mark: |
| Langchain | Framework | :x: | :white_check_mark: |
| LlamaIndex | Framework | :white_check_mark: | :white_check_mark: |
| Langgraph | Framework | :x: | :white_check_mark: |
| DSPy | Framework | :x: | :white_check_mark: |
| CrewAI | Framework | :x: | :white_check_mark: |
| Ollama | Framework | :x: | :white_check_mark: |
| Pinecone | Vector Database | :white_check_mark: | :white_check_mark: |
| ChromaDB | Vector Database | :white_check_mark: | :white_check_mark: |
| QDrant | Vector Database | :white_check_mark: | :white_check_mark: |
| Weaviate | Vector Database | :white_check_mark: | :white_check_mark: |
| PGVector | Vector Database | :white_check_mark: | :white_check_mark: (SQLAlchemy) |

---

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -96,7 +96,7 @@ export default function Dataset() {
<ChevronLeft className="mr-1" />
Back
</Button>
<CreateData datasetId={dataset_id} />
<CreateData projectId={projectId} datasetId={dataset_id} />
<DownloadDataset
projectId={projectId}
datasetId={dataset_id}
Expand All @@ -120,7 +120,7 @@ export default function Dataset() {
<div className="grid grid-cols-5 items-center justify-stretch gap-3 py-3 px-4 bg-muted">
<p className="text-xs font-medium">Created at</p>
<p className="text-xs font-medium">Input</p>
<p className="text-xs font-medium">Output</p>
<p className="text-xs font-medium">Expected Output</p>
<p className="text-xs font-medium text-end">Note</p>
</div>
{fetchDataset.isLoading && currentData?.length === 0 && (
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -180,7 +180,7 @@ export default function Evaluation() {
Input
</th>
<th className="p-2 rounded-md text-sm font-medium">
Target
Target(Expected Output)
</th>
<th className="p-2 rounded-md text-sm font-medium">{`Output - (${experiment.eval.model})`}</th>
<th className="p-2 rounded-md text-sm font-medium">
Expand Down
7 changes: 5 additions & 2 deletions components/project/dataset/create-data.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -28,11 +28,13 @@ import { z } from "zod";

export function CreateData({
datasetId,
projectId,
disabled = false,
variant = "default",
className = "",
}: {
datasetId?: string;
projectId?: string;
disabled?: boolean;
variant?: any;
className?: string;
Expand Down Expand Up @@ -88,6 +90,7 @@ export function CreateData({
},
],
datasetId,
projectId,
}),
});
await queryClient.invalidateQueries(datasetId);
Expand Down Expand Up @@ -133,9 +136,9 @@ export function CreateData({
render={({ field }) => (
<FormItem>
<FormLabel>
Output
Expected Output
<Info
information="Response to the input data by the LLM."
information="Expected response to the input data by the LLM."
className="inline-block ml-2"
/>
</FormLabel>
Expand Down
4 changes: 2 additions & 2 deletions components/project/dataset/edit-data.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -190,9 +190,9 @@ export function EditData({
render={({ field }) => (
<FormItem>
<FormLabel>
Output
Expected Output
<Info
information="Response to the input data by the LLM."
information="Expected response to the input data by the LLM."
className="inline-block ml-2"
/>
</FormLabel>
Expand Down

0 comments on commit 16146a4

Please sign in to comment.