Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 1.7.0 #216

Merged
merged 349 commits into from
Jul 25, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
349 commits
Select commit Hold shift + click to select a range
7d338dc
chore: update github repo badges
darshit-s3 May 10, 2024
0ce5a24
Merge pull request #96 from Scale3-Labs/update-github-badges
darshit-s3 May 10, 2024
a0c9b72
optimizing token count function
dylanzuber-scale3 May 13, 2024
186f82b
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 13, 2024
519cb22
Add GPT4-O Pricing and Playground (#98)
karthikscale3 May 13, 2024
2099f1d
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 13, 2024
dc45189
Dylan/s3en 2234 add perplexity support to playground (#89)
dylanzuber-scale3 May 13, 2024
047f9b6
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 13, 2024
153ac91
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 13, 2024
13f04aa
Merge branch 'development' into release
karthikscale3 May 13, 2024
292a57b
api changes
rohit-kadhe May 13, 2024
a2ad213
add api access to get api and fix all bugs
rohit-kadhe May 14, 2024
5573d3e
bug fix
rohit-kadhe May 14, 2024
5e90a1a
bug fix
rohit-kadhe May 14, 2024
97cf9b5
Merge pull request #101 from Scale3-Labs/rohit/S3EN-2256-user-feedbac…
rohit-kadhe May 14, 2024
5ba0dbf
updating descriptions to optional
dylanzuber-scale3 May 14, 2024
9e980ad
prio python
dylanzuber-scale3 May 14, 2024
4382d65
Merge pull request #103 from Scale3-Labs/dylan/s3en-2279-ux-improvements
dylanzuber-scale3 May 15, 2024
56427c3
cleanup and fixes
rohit-kadhe May 15, 2024
a80fd4d
Merge branch 'development' of github.com:Scale3-Labs/langtrace into r…
rohit-kadhe May 15, 2024
2838cc7
more bug fixes
rohit-kadhe May 15, 2024
ccd42b6
more fixes
rohit-kadhe May 15, 2024
acc5ea5
remove console log
rohit-kadhe May 15, 2024
72fa55b
Merge pull request #104 from Scale3-Labs/rohit/S3EN-2282-remove-redun…
rohit-kadhe May 15, 2024
3e09cc0
Merge pull request #97 from Scale3-Labs/dylan/s3en-2261-optimize-get-…
dylanzuber-scale3 May 15, 2024
cd5e347
updating trace_service functions
dylanzuber-scale3 May 16, 2024
52589fd
add migration
rohit-kadhe May 16, 2024
108baf7
add format function, updating from day to hour
dylanzuber-scale3 May 16, 2024
887021a
Merge pull request #105 from Scale3-Labs/rohit/S3EN-2285-add-missing-…
rohit-kadhe May 16, 2024
a043bd6
adding dropwdown menu
dylanzuber-scale3 May 16, 2024
2944e15
updating query key
dylanzuber-scale3 May 16, 2024
98fb7d7
updating query keys v2
dylanzuber-scale3 May 16, 2024
812e239
clean up
dylanzuber-scale3 May 16, 2024
6baf9a2
Merge remote-tracking branch 'origin/development' into dylan/s3en-226…
dylanzuber-scale3 May 16, 2024
d872bc0
fix bug
rohit-kadhe May 16, 2024
729c164
Merge pull request #107 from Scale3-Labs/rohit/S3EN-2287-bug-fix-eval…
dylanzuber-scale3 May 16, 2024
2fba611
Merge remote-tracking branch 'origin/development' into dylan/s3en-226…
dylanzuber-scale3 May 16, 2024
ed1c2f4
Merge pull request #106 from Scale3-Labs/dylan/s3en-2264-add-date-fil…
dylanzuber-scale3 May 16, 2024
4d8d0a1
Minor bugfix (#102)
karthikscale3 May 17, 2024
194c65e
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 17, 2024
775fd55
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 17, 2024
7725ac1
Merge branch 'development' into release
karthikscale3 May 17, 2024
bbc221c
fixes
dylanzuber-scale3 May 17, 2024
eab02bb
Merge pull request #109 from Scale3-Labs/dylan/s3en-2293-chart-bug-fix
dylanzuber-scale3 May 19, 2024
63eb067
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 20, 2024
f2d9ea5
Bug fixes to Evaluations (#111)
karthikscale3 May 21, 2024
3a44486
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 21, 2024
ba91426
upgrading tiktoken, adding omni to pricing (#110)
dylanzuber-scale3 May 21, 2024
9ad8c44
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 21, 2024
10840e8
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 21, 2024
4a7c307
Merge branch 'development' into release
karthikscale3 May 21, 2024
740a3d6
Update package
karthikscale3 May 21, 2024
ea4cc92
Dataset bugfix (#113)
karthikscale3 May 21, 2024
5605411
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 21, 2024
38f0c1a
Minor linking fix (#114)
karthikscale3 May 21, 2024
eb53696
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 21, 2024
8904b5d
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 21, 2024
7ee9a3a
Merge branch 'development' into release
karthikscale3 May 21, 2024
29bc615
api bug fix (#116)
rohit-kadhe May 22, 2024
b9f140e
fixing dropdown color (#117)
dylanzuber-scale3 May 22, 2024
1d29604
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 22, 2024
d91f619
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 22, 2024
79e62b9
Merge branch 'development' into release
karthikscale3 May 22, 2024
c0ede4b
Support for Image inputs (#119)
karthikscale3 May 22, 2024
c530938
Bug fix Spans with status_code = "ERROR" (#120)
karthikscale3 May 22, 2024
020a3a9
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 22, 2024
20d4132
Dylan/s3en 2265 save prompt and model settings directly from playgrou…
dylanzuber-scale3 May 22, 2024
b9b73db
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 22, 2024
337ac05
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 22, 2024
4187923
Merge branch 'development' into release
karthikscale3 May 22, 2024
e584076
adding image display
dylanzuber-scale3 May 23, 2024
80fc11c
Merge remote-tracking branch 'origin/development' into dylan/s3en-230…
dylanzuber-scale3 May 23, 2024
ce20a07
adding property filtering (#123)
dylanzuber-scale3 May 24, 2024
3eb1132
optimizing cost function
dylanzuber-scale3 May 28, 2024
958946c
optimizing per cost per hour function
dylanzuber-scale3 May 28, 2024
cce94a2
removing console statements
dylanzuber-scale3 May 28, 2024
8671568
Merge pull request #125 from Scale3-Labs/dylan/s3en-2325-bug-gateway-…
dylanzuber-scale3 May 28, 2024
653585a
updating queryKey for datasets
dylanzuber-scale3 May 29, 2024
58a12e7
Merge pull request #126 from Scale3-Labs/dylan/s3en-2319-bugfix-datas…
dylanzuber-scale3 May 29, 2024
7305f9a
init advanced filter dialog
dylanzuber-scale3 May 29, 2024
a6c4652
adding operator combobox
dylanzuber-scale3 May 30, 2024
031e5d5
updating ui
dylanzuber-scale3 May 30, 2024
d24a435
adding attribute type
dylanzuber-scale3 May 30, 2024
bc878cd
bug fixes
dylanzuber-scale3 May 31, 2024
ea94ccb
cleanup
dylanzuber-scale3 May 31, 2024
a39e6af
remove console
dylanzuber-scale3 May 31, 2024
7d8755f
updating queryKeys
dylanzuber-scale3 May 31, 2024
26fe56f
Merge pull request #128 from Scale3-Labs/dylan/s3en-2331-update-langt…
dylanzuber-scale3 May 31, 2024
dcd2cac
adding missing table checks
dylanzuber-scale3 May 31, 2024
ff3166f
adding more checks
dylanzuber-scale3 May 31, 2024
b94dbb2
Merge pull request #129 from Scale3-Labs/dylan/add-table-checl
dylanzuber-scale3 May 31, 2024
2c70a24
chore: update clickhouse docker for user management
darshit-s3 Jun 4, 2024
579b161
style: remove blank space
darshit-s3 Jun 4, 2024
cda1d77
Merge pull request #131 from Scale3-Labs/update-clickhouse-docker
darshit-s3 Jun 4, 2024
8e7176b
updating save prompt button
dylanzuber-scale3 Jun 5, 2024
08b8bbe
Merge pull request #132 from Scale3-Labs/dylan/s3en-2359-save-button-…
dylanzuber-scale3 Jun 6, 2024
29eff4e
Merge pull request #122 from Scale3-Labs/dylan/s3en-2301-render-image…
dylanzuber-scale3 Jun 6, 2024
f520430
Redesign of Manual Evaluations (#134)
karthikscale3 Jun 7, 2024
a41a9f0
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 7, 2024
58431bc
Dylan/s3en 2318 add the ability to import a conversation from the tra…
dylanzuber-scale3 Jun 7, 2024
6111ef5
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 7, 2024
704a98e
Merge remote-tracking branch 'origin/development' into dylan/s3en-227…
dylanzuber-scale3 Jun 7, 2024
0d79362
storing
dylanzuber-scale3 Jun 7, 2024
267fa5d
remove import for images
dylanzuber-scale3 Jun 7, 2024
5b0f985
Merge pull request #135 from Scale3-Labs/dylan/s3en-2394-bugfix-impor…
dylanzuber-scale3 Jun 7, 2024
f5ecb80
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 7, 2024
e63cf2f
fix merge conflict
karthikscale3 Jun 7, 2024
5e2a40a
Merge remote-tracking branch 'origin/development' into dylan/s3en-227…
dylanzuber-scale3 Jun 10, 2024
0ad8b79
importing attribute stuff
dylanzuber-scale3 Jun 11, 2024
a8c1a15
fixing operations display
dylanzuber-scale3 Jun 11, 2024
7e32102
cleaning up advanced filters
dylanzuber-scale3 Jun 11, 2024
68d8f39
cleanup
dylanzuber-scale3 Jun 11, 2024
440017e
docs: update docker instructions
darshit-s3 Jun 11, 2024
3c37313
Merge pull request #137 from Scale3-Labs/update-healthcheck-clickhouse
darshit-s3 Jun 11, 2024
84676cf
removing console, fixing button
dylanzuber-scale3 Jun 11, 2024
c05001f
Merge pull request #127 from Scale3-Labs/dylan/s3en-2278-implement-tr…
dylanzuber-scale3 Jun 11, 2024
663083a
add stars history (#139)
yemiadej Jun 12, 2024
b78cd3f
Dylan/s3en 2401 ability to filter by user for metrics and traces (#138)
dylanzuber-scale3 Jun 13, 2024
3f22fe3
Dylan/s3en 2350 aggregate metrics by models v2 (#141)
dylanzuber-scale3 Jun 13, 2024
b64f734
Automated Evaluations - Support for Inspect AI (#142)
karthikscale3 Jun 13, 2024
77d1bd5
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 13, 2024
948fefe
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 13, 2024
0faf3ab
merge
karthikscale3 Jun 13, 2024
3aa0528
Bugfixes
karthikscale3 Jun 16, 2024
b4527aa
DSPy support (#144)
karthikscale3 Jun 17, 2024
76e1854
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 17, 2024
435f07d
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 17, 2024
ac594bc
Merge branch 'development' into release
karthikscale3 Jun 17, 2024
f04abf1
Prompt registry and Playground integration (#146)
karthikscale3 Jun 20, 2024
a8678f6
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 20, 2024
c88e6c3
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 20, 2024
8dda864
Merge branch 'development' into release
karthikscale3 Jun 20, 2024
0aa4d17
Minor bug fixes (#148)
karthikscale3 Jun 20, 2024
fa7fa4b
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 20, 2024
e52b4ff
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 20, 2024
e731bd1
Merge branch 'development' into release
karthikscale3 Jun 20, 2024
f817fbe
feat: adding example code for starters
darshit-s3 Jun 24, 2024
33b85c0
Merge pull request #150 from Scale3-Labs/add-example-code
darshit-s3 Jun 25, 2024
65700e7
Bugfixes (#152)
karthikscale3 Jun 25, 2024
416540b
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 25, 2024
05d1444
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 25, 2024
47e2398
Merge branch 'development' into release
karthikscale3 Jun 25, 2024
3189372
updating card link to traces
dylanzuber-scale3 Jun 27, 2024
58e892e
Merge pull request #157 from Scale3-Labs/dylan/s3en-2491-make-default…
dylanzuber-scale3 Jun 27, 2024
e6e1918
adding copy to clipboard for prompt id
dylanzuber-scale3 Jun 27, 2024
73e25ce
Merge pull request #158 from Scale3-Labs/dylan/s3en-2492-auto-copy-pr…
dylanzuber-scale3 Jun 27, 2024
b22a296
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 28, 2024
09092a2
Dylan/s3en 2415 expose project creation api for hivenetwork (#156)
dylanzuber-scale3 Jun 28, 2024
2d34b19
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 28, 2024
127b2ca
Dylan/s3en 2393 update UI tracing tab to show the prompt version bein…
dylanzuber-scale3 Jun 28, 2024
4e8a8f4
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 28, 2024
ecd2da3
Merge branch 'development' of github.com:Scale3-Labs/langtrace into r…
karthikscale3 Jun 28, 2024
46c1c8d
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 28, 2024
cc0da10
Merge branch 'development' into release
karthikscale3 Jun 28, 2024
ba2a773
fix for generating api key
dylanzuber-scale3 Jul 1, 2024
d803314
Merge pull request #160 from Scale3-Labs/dylan/s3en-2516-api-key-dial…
dylanzuber-scale3 Jul 1, 2024
933523c
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 2, 2024
df85c41
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 2, 2024
a6c05d0
Merge branch 'development' into release
karthikscale3 Jul 2, 2024
652fb21
dynamically loading attributes and vendors
dylanzuber-scale3 Jul 2, 2024
85b6e8d
updating langtrace attributes sdk
dylanzuber-scale3 Jul 3, 2024
2f3aa0c
Merge pull request #164 from Scale3-Labs/dylan/s3en-2493-update-attri…
dylanzuber-scale3 Jul 3, 2024
089b7a7
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
c16ff66
Fix database migration drift (#166)
karthikscale3 Jul 3, 2024
566fa31
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
a5f80cc
Fix merge
karthikscale3 Jul 3, 2024
1873e00
Dylan/s3en 2507 introduce a settings page for project (#163)
dylanzuber-scale3 Jul 3, 2024
e34cac7
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
bdc91c2
Dylan/s3en 2527 surface project id on project settings page (#165)
dylanzuber-scale3 Jul 3, 2024
01644fb
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
96af1b4
Merge branch 'development' into release
karthikscale3 Jul 3, 2024
94b8969
decreasing popup size, translating right
dylanzuber-scale3 Jul 3, 2024
ce780e2
Merge pull request #168 from Scale3-Labs/dylan/s3en-2529-advanced-fil…
dylanzuber-scale3 Jul 3, 2024
64f360a
scrolling fix
dylanzuber-scale3 Jul 3, 2024
e1ab6fa
Merge remote-tracking branch 'origin/development' into dylan/s3en-253…
dylanzuber-scale3 Jul 3, 2024
c961ca9
fixing scrolling in attributes list
dylanzuber-scale3 Jul 3, 2024
119e754
Merge pull request #169 from Scale3-Labs/dylan/s3en-2528-advanced-fil…
dylanzuber-scale3 Jul 3, 2024
66c2639
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
b9a2385
Support for Azure AD Login for Self Hosted Setups (#170)
obinnascale3 Jul 3, 2024
d9c28d3
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
837595e
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 3, 2024
0e5e121
Update package lock
karthikscale3 Jul 3, 2024
653cbf9
Add migration file
karthikscale3 Jul 3, 2024
5071a30
Add migration file for ext_expires_in (#171)
karthikscale3 Jul 3, 2024
ff62b64
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
b5660fa
Downgrade next (#173)
karthikscale3 Jul 3, 2024
595ae4f
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 3, 2024
65cf040
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
edb0f85
Merge branch 'development' into release
karthikscale3 Jul 3, 2024
a410eb6
sticky footer, visible scroll
dylanzuber-scale3 Jul 8, 2024
0c51ffb
Merge remote-tracking branch 'origin/development' into dylan/s3en-250…
dylanzuber-scale3 Jul 8, 2024
45ce0ef
making project dropdown scrollable
dylanzuber-scale3 Jul 8, 2024
a46bfc9
Merge pull request #178 from Scale3-Labs/dylan/s3en-2508-make-the-scr…
dylanzuber-scale3 Jul 8, 2024
54986c1
Merge pull request #179 from Scale3-Labs/dylan/s3en-2537-another-drop…
dylanzuber-scale3 Jul 8, 2024
997b625
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 8, 2024
84214b9
fixing create data bug
dylanzuber-scale3 Jul 9, 2024
1b7965f
Merge pull request #180 from Scale3-Labs/dylan/s3en-2545-create-data-bug
dylanzuber-scale3 Jul 9, 2024
8f36338
adding loading skeletons to project settings
dylanzuber-scale3 Jul 11, 2024
0e34cdd
Merge pull request #184 from Scale3-Labs/dylan/s3en-2530-add-loading-…
dylanzuber-scale3 Jul 11, 2024
d3d094d
Make client compatible with gen_ai semantics (#185)
karthikscale3 Jul 12, 2024
78257aa
Bugfixes (#186)
karthikscale3 Jul 12, 2024
e8d7126
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 12, 2024
16146a4
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 12, 2024
423a6e3
Merge branch 'development' into release
karthikscale3 Jul 12, 2024
cc1b3aa
add vertexai and gemini to readme (#188)
alizenhom Jul 12, 2024
904a7fd
Gemini Improvements (#189)
karthikscale3 Jul 12, 2024
e197a31
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 12, 2024
20186c5
feat: add slack notification for workflows
darshit-s3 Jul 13, 2024
22cc7d9
feat: add slack notification for workflows
darshit-s3 Jul 13, 2024
001aee5
Traces Filters Bugfix (#191)
karthikscale3 Jul 13, 2024
66a51c1
fixing scroll on prompt dialog
dylanzuber-scale3 Jul 15, 2024
3fe4b4a
Merge pull request #193 from Scale3-Labs/dylan/s3en-2565-make-prompt-…
dylanzuber-scale3 Jul 15, 2024
4e1d292
Merge pull request #190 from Scale3-Labs/add-slack-workflow-alerting
darshit-s3 Jul 15, 2024
eb79dc9
Refactor advanced filters (#195)
karthikscale3 Jul 15, 2024
1797788
adding json view in prompts (#192)
dylanzuber-scale3 Jul 15, 2024
a63974c
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 15, 2024
22be7e5
adding ability to delete detected variables (#194)
dylanzuber-scale3 Jul 15, 2024
caccc0f
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 15, 2024
428897f
fix: checkout before slack alert (#196)
darshit-s3 Jul 15, 2024
bac5dda
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 15, 2024
bc21dac
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 15, 2024
8691757
Update readme
karthikscale3 Jul 15, 2024
dad206b
lock tests in side bar (#199)
obinnascale3 Jul 16, 2024
59929b4
Trace Filter Improvements (#200)
karthikscale3 Jul 16, 2024
71668e7
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 16, 2024
9e53f4a
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 16, 2024
dd74f48
Merge branch 'development' into release
karthikscale3 Jul 16, 2024
37a5386
Advanced filter bugfixes (#202)
karthikscale3 Jul 16, 2024
2a51f9a
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 16, 2024
6335235
Support for zod schema prompt management (#203)
karthikscale3 Jul 17, 2024
8099046
Refactor and bugfix Prompt management (#204)
karthikscale3 Jul 17, 2024
8729fdb
making member inbite more clear
dylanzuber-scale3 Jul 17, 2024
3cb69db
modifiying code example comments
dylanzuber-scale3 Jul 17, 2024
c7e9f2d
updating toast message
dylanzuber-scale3 Jul 17, 2024
b17fada
Merge pull request #206 from Scale3-Labs/dylan/s3en-2577-make-invite-…
dylanzuber-scale3 Jul 18, 2024
c4f0d3b
Merge pull request #205 from Scale3-Labs/dylan/s3en-2564-make-it-clea…
dylanzuber-scale3 Jul 18, 2024
2e3de06
Trace Page Redesign (#208)
karthikscale3 Jul 21, 2024
f29f0d1
adding gpt4o-mini (#207)
dylanzuber-scale3 Jul 21, 2024
ba15052
Minor bug fixes (#209)
karthikscale3 Jul 22, 2024
d27454d
fixing search bug
dylanzuber-scale3 Jul 22, 2024
29dac69
Merge pull request #210 from Scale3-Labs/dylan/s3en-2593-fix-search
dylanzuber-scale3 Jul 22, 2024
b15d242
Make langtrace compatible with OTEL collector (#182)
dylanzuber-scale3 Jul 23, 2024
f4f5e2a
OTLP bug fixes & OTEL semantics (#214)
karthikscale3 Jul 24, 2024
7682278
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 24, 2024
11e0876
Minor Bugfix (#215)
karthikscale3 Jul 24, 2024
61c3604
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 24, 2024
8438958
Fetch trace from root span for user evals (#212)
dylanzuber-scale3 Jul 25, 2024
ed1d122
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 25, 2024
11ab106
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 25, 2024
5365db3
Merge
karthikscale3 Jul 25, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Minor bug fixes (#209)
* Pagination bug

* Bug fix

* Update README.md (#76)

Update screenshot

* Update README.md (#77)

Add reference architecture

* Release  (#80)

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

---------

Co-authored-by: Karthik Kalyanaraman <105607645+karthikscale3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>

* Release 1.3.0 (#85)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>

* Release 1.3.1 (#87)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>

* Release 1.3.2 (#92)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>

* Release 1.3.2 (#95)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>

* Release 1.3.4 (#100)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

* chore: update github repo badges

* Add GPT4-O Pricing and Playground (#98)

* Pagination bug

* Bug fix

* Add GPT4-O support

* Add GPT4-O support

* Update cost

* Dylan/s3en 2234 add perplexity support to playground (#89)

* adding perplexity to playground types

* adding ui stuff:'

* adding perplexity chat api

* fixing perplexity model dropdown

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>

* Release 1.4.0 (#108)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

* chore: update github repo badges

* optimizing token count function

* Add GPT4-O Pricing and Playground (#98)

* Pagination bug

* Bug fix

* Add GPT4-O support

* Add GPT4-O support

* Update cost

* Dylan/s3en 2234 add perplexity support to playground (#89)

* adding perplexity to playground types

* adding ui stuff:'

* adding perplexity chat api

* fixing perplexity model dropdown

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* api changes

* add api access to get api and fix all bugs

* bug fix

* bug fix

* updating descriptions to optional

* prio python

* cleanup and fixes

* more bug fixes

* more fixes

* remove console log

* updating trace_service functions

* add migration

* add format function, updating from day to hour

* adding dropwdown menu

* updating query key

* updating query keys v2

* clean up

* fix bug

* Minor bugfix (#102)

* Pagination bug

* Bug fix

* Minor bugfix

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>

* Bump next from 14.1.0 to 14.1.1 (#93)

Bumps [next](https://github.com/vercel/next.js) from 14.1.0 to 14.1.1.
- [Release notes](https://github.com/vercel/next.js/releases)
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js)
- [Commits](https://github.com/vercel/next.js/compare/v14.1.0...v14.1.1)

---
updated-dependencies:
- dependency-name: next
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Update package

* Release 1.4.2 (#112)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

* chore: update github repo badges

* optimizing token count function

* Add GPT4-O Pricing and Playground (#98)

* Pagination bug

* Bug fix

* Add GPT4-O support

* Add GPT4-O support

* Update cost

* Dylan/s3en 2234 add perplexity support to playground (#89)

* adding perplexity to playground types

* adding ui stuff:'

* adding perplexity chat api

* fixing perplexity model dropdown

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* api changes

* add api access to get api and fix all bugs

* bug fix

* bug fix

* updating descriptions to optional

* prio python

* cleanup and fixes

* more bug fixes

* more fixes

* remove console log

* updating trace_service functions

* add migration

* add format function, updating from day to hour

* adding dropwdown menu

* updating query key

* updating query keys v2

* clean up

* fix bug

* Minor bugfix (#102)

* Pagination bug

* Bug fix

* Minor bugfix

* fixes

* Bug fixes to Evaluations  (#111)

* Pagination bug

* Bug fix

* Bug fixes to evals v2

* Minor fix

* upgrading tiktoken, adding omni to pricing (#110)

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update package

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>

* Release 1.4.3 (#115)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

* chore: update github repo badges

* optimizing token count function

* Add GPT4-O Pricing and Playground (#98)

* Pagination bug

* Bug fix

* Add GPT4-O support

* Add GPT4-O support

* Update cost

* Dylan/s3en 2234 add perplexity support to playground (#89)

* adding perplexity to playground types

* adding ui stuff:'

* adding perplexity chat api

* fixing perplexity model dropdown

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* api changes

* add api access to get api and fix all bugs

* bug fix

* bug fix

* updating descriptions to optional

* prio python

* cleanup and fixes

* more bug fixes

* more fixes

* remove console log

* updating trace_service functions

* add migration

* add format function, updating from day to hour

* adding dropwdown menu

* updating query key

* updating query keys v2

* clean up

* fix bug

* Minor bugfix (#102)

* Pagination bug

* Bug fix

* Minor bugfix

* fixes

* Bug fixes to Evaluations  (#111)

* Pagination bug

* Bug fix

* Bug fixes to evals v2

* Minor fix

* upgrading tiktoken, adding omni to pricing (#110)

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update package

* Dataset bugfix (#113)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor linking fix (#114)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor fix

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>

* Release 1.4.4 (#118)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

* chore: update github repo badges

* optimizing token count function

* Add GPT4-O Pricing and Playground (#98)

* Pagination bug

* Bug fix

* Add GPT4-O support

* Add GPT4-O support

* Update cost

* Dylan/s3en 2234 add perplexity support to playground (#89)

* adding perplexity to playground types

* adding ui stuff:'

* adding perplexity chat api

* fixing perplexity model dropdown

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* api changes

* add api access to get api and fix all bugs

* bug fix

* bug fix

* updating descriptions to optional

* prio python

* cleanup and fixes

* more bug fixes

* more fixes

* remove console log

* updating trace_service functions

* add migration

* add format function, updating from day to hour

* adding dropwdown menu

* updating query key

* updating query keys v2

* clean up

* fix bug

* Minor bugfix (#102)

* Pagination bug

* Bug fix

* Minor bugfix

* fixes

* Bug fixes to Evaluations  (#111)

* Pagination bug

* Bug fix

* Bug fixes to evals v2

* Minor fix

* upgrading tiktoken, adding omni to pricing (#110)

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update package

* Dataset bugfix (#113)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor linking fix (#114)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor fix

* api bug fix (#116)

* fixing dropdown color (#117)

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>

* Release 1.4.5 (#121)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

* chore: update github repo badges

* optimizing token count function

* Add GPT4-O Pricing and Playground (#98)

* Pagination bug

* Bug fix

* Add GPT4-O support

* Add GPT4-O support

* Update cost

* Dylan/s3en 2234 add perplexity support to playground (#89)

* adding perplexity to playground types

* adding ui stuff:'

* adding perplexity chat api

* fixing perplexity model dropdown

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* api changes

* add api access to get api and fix all bugs

* bug fix

* bug fix

* updating descriptions to optional

* prio python

* cleanup and fixes

* more bug fixes

* more fixes

* remove console log

* updating trace_service functions

* add migration

* add format function, updating from day to hour

* adding dropwdown menu

* updating query key

* updating query keys v2

* clean up

* fix bug

* Minor bugfix (#102)

* Pagination bug

* Bug fix

* Minor bugfix

* fixes

* Bug fixes to Evaluations  (#111)

* Pagination bug

* Bug fix

* Bug fixes to evals v2

* Minor fix

* upgrading tiktoken, adding omni to pricing (#110)

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update package

* Dataset bugfix (#113)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor linking fix (#114)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor fix

* api bug fix (#116)

* fixing dropdown color (#117)

* Support for Image inputs (#119)

* Pagination bug

* Bug fix

* Support image inputs

* Bug fix Spans with status_code = "ERROR" (#120)

* Pagination bug

* Bug fix

* Support image inputs

* Bug fixes

* Dylan/s3en 2265 save prompt and model settings directly from playground (#99)

* bug fixes, adding save prompt button in playground

* adding save prompt dialog

* adding create registry dialog

* working registry selection

* Adding new prompt to exist registry

* storing

* button padding fix

* refactor, adding combobox

* increasing dropdwon width

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>

* Update README.md (#124)

* adding table exist checks

* Release 1.5.0 (#136)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

* chore: update github repo badges

* optimizing token count function

* Add GPT4-O Pricing and Playground (#98)

* Pagination bug

* Bug fix

* Add GPT4-O support

* Add GPT4-O support

* Update cost

* Dylan/s3en 2234 add perplexity support to playground (#89)

* adding perplexity to playground types

* adding ui stuff:'

* adding perplexity chat api

* fixing perplexity model dropdown

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* api changes

* add api access to get api and fix all bugs

* bug fix

* bug fix

* updating descriptions to optional

* prio python

* cleanup and fixes

* more bug fixes

* more fixes

* remove console log

* updating trace_service functions

* add migration

* add format function, updating from day to hour

* adding dropwdown menu

* updating query key

* updating query keys v2

* clean up

* fix bug

* Minor bugfix (#102)

* Pagination bug

* Bug fix

* Minor bugfix

* fixes

* Bug fixes to Evaluations  (#111)

* Pagination bug

* Bug fix

* Bug fixes to evals v2

* Minor fix

* upgrading tiktoken, adding omni to pricing (#110)

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update package

* Dataset bugfix (#113)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor linking fix (#114)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor fix

* api bug fix (#116)

* fixing dropdown color (#117)

* Support for Image inputs (#119)

* Pagination bug

* Bug fix

* Support image inputs

* Bug fix Spans with status_code = "ERROR" (#120)

* Pagination bug

* Bug fix

* Support image inputs

* Bug fixes

* Dylan/s3en 2265 save prompt and model settings directly from playground (#99)

* bug fixes, adding save prompt button in playground

* adding save prompt dialog

* adding create registry dialog

* working registry selection

* Adding new prompt to exist registry

* storing

* button padding fix

* refactor, adding combobox

* increasing dropdwon width

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* adding image display

* adding property filtering (#123)

* optimizing cost function

* optimizing per cost per hour function

* removing console statements

* updating queryKey for datasets

* updating queryKeys

* adding missing table checks

* adding more checks

* chore: update clickhouse docker for user management

* style: remove blank space

* updating save prompt button

* Redesign of Manual Evaluations (#134)

* Pagination bug

* Bug fix

* Schema changes for evals

* Fix APIs for evals

* Minor bugfixes

* Bugfix

* Evaluation changes

* Manual eval simplification

* Minor fix

* Manual evaluations UX changes

* Chart title fix

* Disable experiments

* fix

* Dylan/s3en 2318 add the ability to import a conversation from the traces to (#133)

* adding import conversation button

* init import conversation dialog

* adding trace rows

* fixing scroll bug

* adding import prompt to playground

* fixes

* Minor

* Bugfixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>

* Release 1.5.1 (#143)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

* chore: update github repo badges

* optimizing token count function

* Add GPT4-O Pricing and Playground (#98)

* Pagination bug

* Bug fix

* Add GPT4-O support

* Add GPT4-O support

* Update cost

* Dylan/s3en 2234 add perplexity support to playground (#89)

* adding perplexity to playground types

* adding ui stuff:'

* adding perplexity chat api

* fixing perplexity model dropdown

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* api changes

* add api access to get api and fix all bugs

* bug fix

* bug fix

* updating descriptions to optional

* prio python

* cleanup and fixes

* more bug fixes

* more fixes

* remove console log

* updating trace_service functions

* add migration

* add format function, updating from day to hour

* adding dropwdown menu

* updating query key

* updating query keys v2

* clean up

* fix bug

* Minor bugfix (#102)

* Pagination bug

* Bug fix

* Minor bugfix

* fixes

* Bug fixes to Evaluations  (#111)

* Pagination bug

* Bug fix

* Bug fixes to evals v2

* Minor fix

* upgrading tiktoken, adding omni to pricing (#110)

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update package

* Dataset bugfix (#113)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor linking fix (#114)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor fix

* api bug fix (#116)

* fixing dropdown color (#117)

* Support for Image inputs (#119)

* Pagination bug

* Bug fix

* Support image inputs

* Bug fix Spans with status_code = "ERROR" (#120)

* Pagination bug

* Bug fix

* Support image inputs

* Bug fixes

* Dylan/s3en 2265 save prompt and model settings directly from playground (#99)

* bug fixes, adding save prompt button in playground

* adding save prompt dialog

* adding create registry dialog

* working registry selection

* Adding new prompt to exist registry

* storing

* button padding fix

* refactor, adding combobox

* increasing dropdwon width

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* adding image display

* adding property filtering (#123)

* optimizing cost function

* optimizing per cost per hour function

* removing console statements

* updating queryKey for datasets

* init advanced filter dialog

* adding operator combobox

* updating ui

* adding attribute type

* bug fixes

* cleanup

* remove console

* updating queryKeys

* adding missing table checks

* adding more checks

* chore: update clickhouse docker for user management

* style: remove blank space

* updating save prompt button

* Redesign of Manual Evaluations (#134)

* Pagination bug

* Bug fix

* Schema changes for evals

* Fix APIs for evals

* Minor bugfixes

* Bugfix

* Evaluation changes

* Manual eval simplification

* Minor fix

* Manual evaluations UX changes

* Chart title fix

* Disable experiments

* fix

* Dylan/s3en 2318 add the ability to import a conversation from the traces to (#133)

* adding import conversation button

* init import conversation dialog

* adding trace rows

* fixing scroll bug

* adding import prompt to playground

* fixes

* Minor

* Bugfixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* storing

* remove import for images

* importing attribute stuff

* fixing operations display

* cleaning up advanced filters

* cleanup

* docs: update docker instructions

* removing console, fixing button

* add stars history (#139)

* Dylan/s3en 2401 ability to filter by user for metrics and traces (#138)

* adding user id combobox, api

* fixing sql query

* removing user filter on deselect{

* moving user combobox into filter dialog

* adding filtering by user for token charts

* bug fixes, more userId route, function updates

* latency filtering

* updating to alphanumeric

* removing console, comment

* updating default filter operation to and

* adding clear all button, cleanup

* Dylan/s3en 2350 aggregate metrics by models v2 (#141)

* adding user id combobox, api

* fixing sql query

* removing user filter on deselect{

* moving user combobox into filter dialog

* adding filtering by user for token charts

* bug fixes, more userId route, function updates

* latency filtering

* updating to alphanumeric

* removing console, comment

* updating default filter operation to and

* adding clear all button, cleanup

* init commit model combobox

* adding api, updating function, adding to metrics page

* adding model to charts, apis, service

* remove consoles

* Automated Evaluations - Support for Inspect AI (#142)

* Pagination bug

* Bug fix

* Experiments view

* re-order

* Comparison view

* Experiment report

* Experiments - hook up APIs

* Experiments pagination

* deduplicate paginated data

* Fix loading and error states - experiments

* Rename experiments and evaluations

* Add loading spinner

* Link evaluation

* Link to evals

* Fixes

* Minor UI fixes

---------

Co-authored-by: Darshit Suratwala <darshit@scale3labs.com>
Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com>
Co-authored-by: dylan <dylan@scale3labs.com>
Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com>
Co-authored-by: Rohit Kadhe <rohit@scale3labs.com>
Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com>
Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com>
Co-authored-by: yemiscale3 <111706151+yemiadej@users.noreply.github.com>

* Bugfixes

* Release 1.5.1 (#145)

* Pagination bug

* Bug fix

* chore: add docker cmd

* Compatibility fixes for SDK version 2.0.0 (#69)

* Pagination bug

* Bug fix

* Fix for schema changes

* Render tool calling

* Support for Langgraph, Qdrant & Groq  (#73)

* Pagination bug

* Bug fix

* Add langgraph support

* QDrant support

* Add Groq support

* update README

* update README

* feat: optimise docker image for self host setup

* adding api access to traces endpoint

* clean up

* refactor

* feat: add clickhouse db create on app start (#79)

* docs: add railway deploy, fix sdk badges (#81)

* untrack .env

* Revert "untrack .env"

This reverts commit 4551d7eb33a22b4ba94be8eb1e20d620c6e0a567.

* Playground and Prompt Management (#83)

* Pagination bug

* Bug fix

* Playground - basic implementation

* Playground - streaming and nonstreaming

* Move playground inside project

* API key flow

* Api key

* Playground refactor

* Add chat hookup

* anthropic streaming support

* Bug fixes to openai playground

* Anthropic bugfixes

* Anthropic bugfix

* Cohere first iteration

* Cohere role fixes

* Cohere api fix

* Parallel running

* Playground cost calculation non streaming

* playground - streaming token calculation

* latency and cost

* Support for Groq

* Add model name

* Prompt management views

* Remove current promptset flow

* Prompt management API hooks

* Prompt registry final

* Playground bugfixes

* Bug fix playground

* Rearrange project nav

* Fix playground

* Fix prompts

* Bugfixes

* Minor fix

* Prompt versioning bugfix

* Bugfix

* fix: clickhouse table find queries (#82)

* Fix to surface multiple LLM requests inside LLM View (#84)

* Pagination bug

* Bug fix

* Fix for surfacing multiple LLM requests in LLMView

* Minor bugfixes (#86)

* Pagination bug

* Bug fix

* Bugfixes

* api to fetch promptset with prompt filters

* bug fixes

* fix invalid redirect

* fix invalid status code

* Project Switcher (#90)

* Pagination bug

* Bug fix

* Project switcher

* Feat: dataset download (#60)

* API: download dataset

* API: Download dataset

* updated download-dataset api

* Updated: download_dataset api

* Updated download dataset API

* Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500

* updated the download-dataset API: fixed the format and removed redundant lines of code

* Updated download_daatset API: file name and removed 'id' param

* Added the Download dataset button.

* Merged developemnt into my branch

* Updated button size

* Fixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update prompt registry with instructions to fetch prompts (#91)

* Pagination bug

* Bug fix

* Update prompt registry

* Minor bugfix (#94)

* Pagination bug

* Bug fix

* Minor bugfix

* chore: update github repo badges

* optimizing token count function

* Add GPT4-O Pricing and Playground (#98)

* Pagination bug

* Bug fix

* Add GPT4-O support

* Add GPT4-O support

* Update cost

* Dylan/s3en 2234 add perplexity support to playground (#89)

* adding perplexity to playground types

* adding ui stuff:'

* adding perplexity chat api

* fixing perplexity model dropdown

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* api changes

* add api access to get api and fix all bugs

* bug fix

* bug fix

* updating descriptions to optional

* prio python

* cleanup and fixes

* more bug fixes

* more fixes

* remove console log

* updating trace_service functions

* add migration

* add format function, updating from day to hour

* adding dropwdown menu

* updating query key

* updating query keys v2

* clean up

* fix bug

* Minor bugfix (#102)

* Pagination bug

* Bug fix

* Minor bugfix

* fixes

* Bug fixes to Evaluations  (#111)

* Pagination bug

* Bug fix

* Bug fixes to evals v2

* Minor fix

* upgrading tiktoken, adding omni to pricing (#110)

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* Update package

* Dataset bugfix (#113)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor linking fix (#114)

* Pagination bug

* Bug fix

* Dataset bugfix

* Minor fix

* api bug fix (#116)

* fixing dropdown color (#117)

* Support for Image inputs (#119)

* Pagination bug

* Bug fix

* Support image inputs

* Bug fix Spans with status_code = "ERROR" (#120)

* Pagination bug

* Bug fix

* Support image inputs

* Bug fixes

* Dylan/s3en 2265 save prompt and model settings directly from playground (#99)

* bug fixes, adding save prompt button in playground

* adding save prompt dialog

* adding create registry dialog

* working registry selection

* Adding new prompt to exist registry

* storing

* button padding fix

* refactor, adding combobox

* increasing dropdwon width

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* adding image display

* adding property filtering (#123)

* optimizing cost function

* optimizing per cost per hour function

* removing console statements

* updating queryKey for datasets

* init advanced filter dialog

* adding operator combobox

* updating ui

* adding attribute type

* bug fixes

* cleanup

* remove console

* updating queryKeys

* adding missing table checks

* adding more checks

* chore: update clickhouse docker for user management

* style: remove blank space

* updating save prompt button

* Redesign of Manual Evaluations (#134)

* Pagination bug

* Bug fix

* Schema changes for evals

* Fix APIs for evals

* Minor bugfixes

* Bugfix

* Evaluation changes

* Manual eval simplification

* Minor fix

* Manual evaluations UX changes

* Chart title fix

* Disable experiments

* fix

* Dylan/s3en 2318 add the ability to import a conversation from the traces to (#133)

* adding import conversation button

* init import conversation dialog

* adding trace rows

* fixing scroll bug

* adding import prompt to playground

* fixes

* Minor

* Bugfixes

---------

Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com>

* storing

* remove import for images

* importing attribute stuff

* fixing operations display

* cleaning up advanced filters

* cleanup

* docs: update docker instructions

* removing console, fixing button

* add stars history (#139)

* Dylan/s3en 2401 ability to filter by user for metrics and traces (#138)

* adding user id combobox, api

* fixing sql query

* removing user filter on deselect{

* moving user combobox into filter dialog

* adding filtering by user for token charts

* bug fixes, more userId route, function updates

* latency filtering

* updating to alphanumeric

* removing console, comment

* updating default filter operation to and

* adding clear all button, cleanup

* Dylan/s3en 2350 aggregate metrics by models v2 (#141)

* adding user id combobox, api

* fixing sql query

* removing user filter on deselect{

* moving user combobox into filter dialog

* adding filtering by user for token charts

* bug fixes, more userId route, function updates

* latency filtering

* updating to alphanumeric

* removing console, comment

* updating default filter operation to and

* adding clear all button, cleanup

* init commit model combobox

* adding api, updating function, adding to metrics page

* adding model to charts, apis, service

* remove consoles

* Automated Evaluations - Support for Inspect AI (#142)

* Pagination bug

* Bug fix

* Experiments view

* re-order

* Comparison view

* Expe…
  • Loading branch information
10 people authored Jul 22, 2024
commit ba15052b5ff826b3ee6d49076d13cad9e948723d
4 changes: 2 additions & 2 deletions components/project/traces/traces.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -196,7 +196,7 @@ export default function Traces({ email }: { email: string }) {
return (
<div className="flex flex-col gap-3 flex-wrap">
{messages.map((message, i) =>
message.prompts.length > 0
message.prompts && message.prompts.length > 0
? message.prompts.map((prompt, j) => (
<HoverCell
key={j}
Expand Down Expand Up @@ -224,7 +224,7 @@ export default function Traces({ email }: { email: string }) {
return (
<div className="flex flex-col gap-3 flex-wrap">
{messages.map((message, i) =>
message.responses.length > 0
message.responses && message.responses.length > 0
? message.responses.map((response, j) => (
<HoverCell
key={j}
Expand Down
22 changes: 18 additions & 4 deletions lib/trace_util.ts
Original file line number Diff line number Diff line change
Expand Up @@ -148,6 +148,24 @@ export function processTrace(trace: any): Trace {
}
}

// TODO(Karthik): This logic is for handling old traces that were not compatible with the gen_ai conventions.
const message: Record<string, string[]> = {
prompts: [],
responses: [],
};

if (attributes["llm.prompts"]) {
message.prompts.push(attributes["llm.prompts"]);
}

if (attributes["llm.responses"]) {
message.responses.push(attributes["llm.responses"]);
}

if (message.prompts.length > 0 || message.responses.length > 0) {
messages.push(message);
}

if (span.events && span.events !== "[]") {
const events = JSON.parse(span.events);
const inputs = [];
Expand Down Expand Up @@ -184,13 +202,9 @@ export function processTrace(trace: any): Trace {
};
if (inputs.length > 0) {
message.prompts.push(...inputs);
} else {
message.prompts.push("[{}]");
}
if (outputs.length > 0) {
message.responses.push(...outputs);
} else {
message.responses.push("[{}]");
}
if (message.prompts.length > 0 || message.responses.length > 0) {
messages.push(message);
Expand Down