Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 2.0.0 #224

Merged
merged 362 commits into from
Aug 2, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
362 commits
Select commit Hold shift + click to select a range
5e90a1a
bug fix
rohit-kadhe May 14, 2024
97cf9b5
Merge pull request #101 from Scale3-Labs/rohit/S3EN-2256-user-feedbac…
rohit-kadhe May 14, 2024
5ba0dbf
updating descriptions to optional
dylanzuber-scale3 May 14, 2024
9e980ad
prio python
dylanzuber-scale3 May 14, 2024
4382d65
Merge pull request #103 from Scale3-Labs/dylan/s3en-2279-ux-improvements
dylanzuber-scale3 May 15, 2024
56427c3
cleanup and fixes
rohit-kadhe May 15, 2024
a80fd4d
Merge branch 'development' of github.com:Scale3-Labs/langtrace into r…
rohit-kadhe May 15, 2024
2838cc7
more bug fixes
rohit-kadhe May 15, 2024
ccd42b6
more fixes
rohit-kadhe May 15, 2024
acc5ea5
remove console log
rohit-kadhe May 15, 2024
72fa55b
Merge pull request #104 from Scale3-Labs/rohit/S3EN-2282-remove-redun…
rohit-kadhe May 15, 2024
3e09cc0
Merge pull request #97 from Scale3-Labs/dylan/s3en-2261-optimize-get-…
dylanzuber-scale3 May 15, 2024
cd5e347
updating trace_service functions
dylanzuber-scale3 May 16, 2024
52589fd
add migration
rohit-kadhe May 16, 2024
108baf7
add format function, updating from day to hour
dylanzuber-scale3 May 16, 2024
887021a
Merge pull request #105 from Scale3-Labs/rohit/S3EN-2285-add-missing-…
rohit-kadhe May 16, 2024
a043bd6
adding dropwdown menu
dylanzuber-scale3 May 16, 2024
2944e15
updating query key
dylanzuber-scale3 May 16, 2024
98fb7d7
updating query keys v2
dylanzuber-scale3 May 16, 2024
812e239
clean up
dylanzuber-scale3 May 16, 2024
6baf9a2
Merge remote-tracking branch 'origin/development' into dylan/s3en-226…
dylanzuber-scale3 May 16, 2024
d872bc0
fix bug
rohit-kadhe May 16, 2024
729c164
Merge pull request #107 from Scale3-Labs/rohit/S3EN-2287-bug-fix-eval…
dylanzuber-scale3 May 16, 2024
2fba611
Merge remote-tracking branch 'origin/development' into dylan/s3en-226…
dylanzuber-scale3 May 16, 2024
ed1c2f4
Merge pull request #106 from Scale3-Labs/dylan/s3en-2264-add-date-fil…
dylanzuber-scale3 May 16, 2024
4d8d0a1
Minor bugfix (#102)
karthikscale3 May 17, 2024
194c65e
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 17, 2024
775fd55
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 17, 2024
7725ac1
Merge branch 'development' into release
karthikscale3 May 17, 2024
bbc221c
fixes
dylanzuber-scale3 May 17, 2024
eab02bb
Merge pull request #109 from Scale3-Labs/dylan/s3en-2293-chart-bug-fix
dylanzuber-scale3 May 19, 2024
63eb067
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 20, 2024
f2d9ea5
Bug fixes to Evaluations (#111)
karthikscale3 May 21, 2024
3a44486
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 21, 2024
ba91426
upgrading tiktoken, adding omni to pricing (#110)
dylanzuber-scale3 May 21, 2024
9ad8c44
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 21, 2024
10840e8
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 21, 2024
4a7c307
Merge branch 'development' into release
karthikscale3 May 21, 2024
740a3d6
Update package
karthikscale3 May 21, 2024
ea4cc92
Dataset bugfix (#113)
karthikscale3 May 21, 2024
5605411
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 21, 2024
38f0c1a
Minor linking fix (#114)
karthikscale3 May 21, 2024
eb53696
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 21, 2024
8904b5d
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 21, 2024
7ee9a3a
Merge branch 'development' into release
karthikscale3 May 21, 2024
29bc615
api bug fix (#116)
rohit-kadhe May 22, 2024
b9f140e
fixing dropdown color (#117)
dylanzuber-scale3 May 22, 2024
1d29604
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 22, 2024
d91f619
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 22, 2024
79e62b9
Merge branch 'development' into release
karthikscale3 May 22, 2024
c0ede4b
Support for Image inputs (#119)
karthikscale3 May 22, 2024
c530938
Bug fix Spans with status_code = "ERROR" (#120)
karthikscale3 May 22, 2024
020a3a9
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 22, 2024
20d4132
Dylan/s3en 2265 save prompt and model settings directly from playgrou…
dylanzuber-scale3 May 22, 2024
b9b73db
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 May 22, 2024
337ac05
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 May 22, 2024
4187923
Merge branch 'development' into release
karthikscale3 May 22, 2024
e584076
adding image display
dylanzuber-scale3 May 23, 2024
80fc11c
Merge remote-tracking branch 'origin/development' into dylan/s3en-230…
dylanzuber-scale3 May 23, 2024
ce20a07
adding property filtering (#123)
dylanzuber-scale3 May 24, 2024
3eb1132
optimizing cost function
dylanzuber-scale3 May 28, 2024
958946c
optimizing per cost per hour function
dylanzuber-scale3 May 28, 2024
cce94a2
removing console statements
dylanzuber-scale3 May 28, 2024
8671568
Merge pull request #125 from Scale3-Labs/dylan/s3en-2325-bug-gateway-…
dylanzuber-scale3 May 28, 2024
653585a
updating queryKey for datasets
dylanzuber-scale3 May 29, 2024
58a12e7
Merge pull request #126 from Scale3-Labs/dylan/s3en-2319-bugfix-datas…
dylanzuber-scale3 May 29, 2024
7305f9a
init advanced filter dialog
dylanzuber-scale3 May 29, 2024
a6c4652
adding operator combobox
dylanzuber-scale3 May 30, 2024
031e5d5
updating ui
dylanzuber-scale3 May 30, 2024
d24a435
adding attribute type
dylanzuber-scale3 May 30, 2024
bc878cd
bug fixes
dylanzuber-scale3 May 31, 2024
ea94ccb
cleanup
dylanzuber-scale3 May 31, 2024
a39e6af
remove console
dylanzuber-scale3 May 31, 2024
7d8755f
updating queryKeys
dylanzuber-scale3 May 31, 2024
26fe56f
Merge pull request #128 from Scale3-Labs/dylan/s3en-2331-update-langt…
dylanzuber-scale3 May 31, 2024
dcd2cac
adding missing table checks
dylanzuber-scale3 May 31, 2024
ff3166f
adding more checks
dylanzuber-scale3 May 31, 2024
b94dbb2
Merge pull request #129 from Scale3-Labs/dylan/add-table-checl
dylanzuber-scale3 May 31, 2024
2c70a24
chore: update clickhouse docker for user management
darshit-s3 Jun 4, 2024
579b161
style: remove blank space
darshit-s3 Jun 4, 2024
cda1d77
Merge pull request #131 from Scale3-Labs/update-clickhouse-docker
darshit-s3 Jun 4, 2024
8e7176b
updating save prompt button
dylanzuber-scale3 Jun 5, 2024
08b8bbe
Merge pull request #132 from Scale3-Labs/dylan/s3en-2359-save-button-…
dylanzuber-scale3 Jun 6, 2024
29eff4e
Merge pull request #122 from Scale3-Labs/dylan/s3en-2301-render-image…
dylanzuber-scale3 Jun 6, 2024
f520430
Redesign of Manual Evaluations (#134)
karthikscale3 Jun 7, 2024
a41a9f0
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 7, 2024
58431bc
Dylan/s3en 2318 add the ability to import a conversation from the tra…
dylanzuber-scale3 Jun 7, 2024
6111ef5
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 7, 2024
704a98e
Merge remote-tracking branch 'origin/development' into dylan/s3en-227…
dylanzuber-scale3 Jun 7, 2024
0d79362
storing
dylanzuber-scale3 Jun 7, 2024
267fa5d
remove import for images
dylanzuber-scale3 Jun 7, 2024
5b0f985
Merge pull request #135 from Scale3-Labs/dylan/s3en-2394-bugfix-impor…
dylanzuber-scale3 Jun 7, 2024
f5ecb80
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 7, 2024
e63cf2f
fix merge conflict
karthikscale3 Jun 7, 2024
5e2a40a
Merge remote-tracking branch 'origin/development' into dylan/s3en-227…
dylanzuber-scale3 Jun 10, 2024
0ad8b79
importing attribute stuff
dylanzuber-scale3 Jun 11, 2024
a8c1a15
fixing operations display
dylanzuber-scale3 Jun 11, 2024
7e32102
cleaning up advanced filters
dylanzuber-scale3 Jun 11, 2024
68d8f39
cleanup
dylanzuber-scale3 Jun 11, 2024
440017e
docs: update docker instructions
darshit-s3 Jun 11, 2024
3c37313
Merge pull request #137 from Scale3-Labs/update-healthcheck-clickhouse
darshit-s3 Jun 11, 2024
84676cf
removing console, fixing button
dylanzuber-scale3 Jun 11, 2024
c05001f
Merge pull request #127 from Scale3-Labs/dylan/s3en-2278-implement-tr…
dylanzuber-scale3 Jun 11, 2024
663083a
add stars history (#139)
yemiadej Jun 12, 2024
b78cd3f
Dylan/s3en 2401 ability to filter by user for metrics and traces (#138)
dylanzuber-scale3 Jun 13, 2024
3f22fe3
Dylan/s3en 2350 aggregate metrics by models v2 (#141)
dylanzuber-scale3 Jun 13, 2024
b64f734
Automated Evaluations - Support for Inspect AI (#142)
karthikscale3 Jun 13, 2024
77d1bd5
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 13, 2024
948fefe
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 13, 2024
0faf3ab
merge
karthikscale3 Jun 13, 2024
3aa0528
Bugfixes
karthikscale3 Jun 16, 2024
b4527aa
DSPy support (#144)
karthikscale3 Jun 17, 2024
76e1854
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 17, 2024
435f07d
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 17, 2024
ac594bc
Merge branch 'development' into release
karthikscale3 Jun 17, 2024
f04abf1
Prompt registry and Playground integration (#146)
karthikscale3 Jun 20, 2024
a8678f6
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 20, 2024
c88e6c3
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 20, 2024
8dda864
Merge branch 'development' into release
karthikscale3 Jun 20, 2024
0aa4d17
Minor bug fixes (#148)
karthikscale3 Jun 20, 2024
fa7fa4b
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 20, 2024
e52b4ff
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 20, 2024
e731bd1
Merge branch 'development' into release
karthikscale3 Jun 20, 2024
f817fbe
feat: adding example code for starters
darshit-s3 Jun 24, 2024
33b85c0
Merge pull request #150 from Scale3-Labs/add-example-code
darshit-s3 Jun 25, 2024
65700e7
Bugfixes (#152)
karthikscale3 Jun 25, 2024
416540b
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 25, 2024
05d1444
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 25, 2024
47e2398
Merge branch 'development' into release
karthikscale3 Jun 25, 2024
3189372
updating card link to traces
dylanzuber-scale3 Jun 27, 2024
58e892e
Merge pull request #157 from Scale3-Labs/dylan/s3en-2491-make-default…
dylanzuber-scale3 Jun 27, 2024
e6e1918
adding copy to clipboard for prompt id
dylanzuber-scale3 Jun 27, 2024
73e25ce
Merge pull request #158 from Scale3-Labs/dylan/s3en-2492-auto-copy-pr…
dylanzuber-scale3 Jun 27, 2024
b22a296
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 28, 2024
09092a2
Dylan/s3en 2415 expose project creation api for hivenetwork (#156)
dylanzuber-scale3 Jun 28, 2024
2d34b19
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 28, 2024
127b2ca
Dylan/s3en 2393 update UI tracing tab to show the prompt version bein…
dylanzuber-scale3 Jun 28, 2024
4e8a8f4
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jun 28, 2024
ecd2da3
Merge branch 'development' of github.com:Scale3-Labs/langtrace into r…
karthikscale3 Jun 28, 2024
46c1c8d
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jun 28, 2024
cc0da10
Merge branch 'development' into release
karthikscale3 Jun 28, 2024
ba2a773
fix for generating api key
dylanzuber-scale3 Jul 1, 2024
d803314
Merge pull request #160 from Scale3-Labs/dylan/s3en-2516-api-key-dial…
dylanzuber-scale3 Jul 1, 2024
933523c
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 2, 2024
df85c41
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 2, 2024
a6c05d0
Merge branch 'development' into release
karthikscale3 Jul 2, 2024
652fb21
dynamically loading attributes and vendors
dylanzuber-scale3 Jul 2, 2024
85b6e8d
updating langtrace attributes sdk
dylanzuber-scale3 Jul 3, 2024
2f3aa0c
Merge pull request #164 from Scale3-Labs/dylan/s3en-2493-update-attri…
dylanzuber-scale3 Jul 3, 2024
089b7a7
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
c16ff66
Fix database migration drift (#166)
karthikscale3 Jul 3, 2024
566fa31
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
a5f80cc
Fix merge
karthikscale3 Jul 3, 2024
1873e00
Dylan/s3en 2507 introduce a settings page for project (#163)
dylanzuber-scale3 Jul 3, 2024
e34cac7
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
bdc91c2
Dylan/s3en 2527 surface project id on project settings page (#165)
dylanzuber-scale3 Jul 3, 2024
01644fb
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
96af1b4
Merge branch 'development' into release
karthikscale3 Jul 3, 2024
94b8969
decreasing popup size, translating right
dylanzuber-scale3 Jul 3, 2024
ce780e2
Merge pull request #168 from Scale3-Labs/dylan/s3en-2529-advanced-fil…
dylanzuber-scale3 Jul 3, 2024
64f360a
scrolling fix
dylanzuber-scale3 Jul 3, 2024
e1ab6fa
Merge remote-tracking branch 'origin/development' into dylan/s3en-253…
dylanzuber-scale3 Jul 3, 2024
c961ca9
fixing scrolling in attributes list
dylanzuber-scale3 Jul 3, 2024
119e754
Merge pull request #169 from Scale3-Labs/dylan/s3en-2528-advanced-fil…
dylanzuber-scale3 Jul 3, 2024
66c2639
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
b9a2385
Support for Azure AD Login for Self Hosted Setups (#170)
obinnascale3 Jul 3, 2024
d9c28d3
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
837595e
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 3, 2024
0e5e121
Update package lock
karthikscale3 Jul 3, 2024
653cbf9
Add migration file
karthikscale3 Jul 3, 2024
5071a30
Add migration file for ext_expires_in (#171)
karthikscale3 Jul 3, 2024
ff62b64
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
b5660fa
Downgrade next (#173)
karthikscale3 Jul 3, 2024
595ae4f
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 3, 2024
65cf040
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 3, 2024
edb0f85
Merge branch 'development' into release
karthikscale3 Jul 3, 2024
a410eb6
sticky footer, visible scroll
dylanzuber-scale3 Jul 8, 2024
0c51ffb
Merge remote-tracking branch 'origin/development' into dylan/s3en-250…
dylanzuber-scale3 Jul 8, 2024
45ce0ef
making project dropdown scrollable
dylanzuber-scale3 Jul 8, 2024
a46bfc9
Merge pull request #178 from Scale3-Labs/dylan/s3en-2508-make-the-scr…
dylanzuber-scale3 Jul 8, 2024
54986c1
Merge pull request #179 from Scale3-Labs/dylan/s3en-2537-another-drop…
dylanzuber-scale3 Jul 8, 2024
997b625
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 8, 2024
84214b9
fixing create data bug
dylanzuber-scale3 Jul 9, 2024
1b7965f
Merge pull request #180 from Scale3-Labs/dylan/s3en-2545-create-data-bug
dylanzuber-scale3 Jul 9, 2024
8f36338
adding loading skeletons to project settings
dylanzuber-scale3 Jul 11, 2024
0e34cdd
Merge pull request #184 from Scale3-Labs/dylan/s3en-2530-add-loading-…
dylanzuber-scale3 Jul 11, 2024
d3d094d
Make client compatible with gen_ai semantics (#185)
karthikscale3 Jul 12, 2024
78257aa
Bugfixes (#186)
karthikscale3 Jul 12, 2024
e8d7126
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 12, 2024
16146a4
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 12, 2024
423a6e3
Merge branch 'development' into release
karthikscale3 Jul 12, 2024
cc1b3aa
add vertexai and gemini to readme (#188)
alizenhom Jul 12, 2024
904a7fd
Gemini Improvements (#189)
karthikscale3 Jul 12, 2024
e197a31
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 12, 2024
20186c5
feat: add slack notification for workflows
darshit-s3 Jul 13, 2024
22cc7d9
feat: add slack notification for workflows
darshit-s3 Jul 13, 2024
001aee5
Traces Filters Bugfix (#191)
karthikscale3 Jul 13, 2024
66a51c1
fixing scroll on prompt dialog
dylanzuber-scale3 Jul 15, 2024
3fe4b4a
Merge pull request #193 from Scale3-Labs/dylan/s3en-2565-make-prompt-…
dylanzuber-scale3 Jul 15, 2024
4e1d292
Merge pull request #190 from Scale3-Labs/add-slack-workflow-alerting
darshit-s3 Jul 15, 2024
eb79dc9
Refactor advanced filters (#195)
karthikscale3 Jul 15, 2024
1797788
adding json view in prompts (#192)
dylanzuber-scale3 Jul 15, 2024
a63974c
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 15, 2024
22be7e5
adding ability to delete detected variables (#194)
dylanzuber-scale3 Jul 15, 2024
caccc0f
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 15, 2024
428897f
fix: checkout before slack alert (#196)
darshit-s3 Jul 15, 2024
bac5dda
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 15, 2024
bc21dac
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 15, 2024
8691757
Update readme
karthikscale3 Jul 15, 2024
dad206b
lock tests in side bar (#199)
obinnascale3 Jul 16, 2024
59929b4
Trace Filter Improvements (#200)
karthikscale3 Jul 16, 2024
71668e7
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 16, 2024
9e53f4a
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 16, 2024
dd74f48
Merge branch 'development' into release
karthikscale3 Jul 16, 2024
37a5386
Advanced filter bugfixes (#202)
karthikscale3 Jul 16, 2024
2a51f9a
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 16, 2024
6335235
Support for zod schema prompt management (#203)
karthikscale3 Jul 17, 2024
8099046
Refactor and bugfix Prompt management (#204)
karthikscale3 Jul 17, 2024
8729fdb
making member inbite more clear
dylanzuber-scale3 Jul 17, 2024
3cb69db
modifiying code example comments
dylanzuber-scale3 Jul 17, 2024
c7e9f2d
updating toast message
dylanzuber-scale3 Jul 17, 2024
b17fada
Merge pull request #206 from Scale3-Labs/dylan/s3en-2577-make-invite-…
dylanzuber-scale3 Jul 18, 2024
c4f0d3b
Merge pull request #205 from Scale3-Labs/dylan/s3en-2564-make-it-clea…
dylanzuber-scale3 Jul 18, 2024
2e3de06
Trace Page Redesign (#208)
karthikscale3 Jul 21, 2024
f29f0d1
adding gpt4o-mini (#207)
dylanzuber-scale3 Jul 21, 2024
ba15052
Minor bug fixes (#209)
karthikscale3 Jul 22, 2024
d27454d
fixing search bug
dylanzuber-scale3 Jul 22, 2024
29dac69
Merge pull request #210 from Scale3-Labs/dylan/s3en-2593-fix-search
dylanzuber-scale3 Jul 22, 2024
b15d242
Make langtrace compatible with OTEL collector (#182)
dylanzuber-scale3 Jul 23, 2024
f4f5e2a
OTLP bug fixes & OTEL semantics (#214)
karthikscale3 Jul 24, 2024
7682278
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 24, 2024
11e0876
Minor Bugfix (#215)
karthikscale3 Jul 24, 2024
61c3604
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 24, 2024
8438958
Fetch trace from root span for user evals (#212)
dylanzuber-scale3 Jul 25, 2024
ed1d122
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 25, 2024
11ab106
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Jul 25, 2024
5365db3
Merge
karthikscale3 Jul 25, 2024
3f85e00
Trace page bugfixes (#217)
karthikscale3 Jul 25, 2024
1b99bc9
refactor migrations flow for langtrace (#211)
darshit-s3 Jul 26, 2024
24a7082
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 26, 2024
d17d838
Trace page improvements (#218)
karthikscale3 Jul 27, 2024
17cbcfc
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 27, 2024
22e8a83
Improve trace page loading state (#219)
karthikscale3 Jul 28, 2024
34e9695
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Jul 28, 2024
de7c9ba
Trace page improvements (#220)
karthikscale3 Jul 30, 2024
65d1fd8
refactor: change entrypoint file name (#221)
darshit-s3 Aug 1, 2024
19f0447
Redesign of annotations tab (#223)
karthikscale3 Aug 2, 2024
7831f1d
Merge branch 'development' of github.com:Scale3-Labs/langtrace into d…
karthikscale3 Aug 2, 2024
366b07a
Merge branch 'main' of github.com:Scale3-Labs/langtrace into release
karthikscale3 Aug 2, 2024
c2a4608
Merge branch 'development' into release
karthikscale3 Aug 2, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add format function, updating from day to hour
  • Loading branch information
dylanzuber-scale3 committed May 16, 2024
commit 108baf72b611d9cdc23533b78780992cceb82f1b
11 changes: 4 additions & 7 deletions app/api/metrics/latency/trace/route.ts
Original file line number Diff line number Diff line change
Expand Up @@ -22,16 +22,13 @@ export async function GET(req: NextRequest) {
}

const traceService = new TraceService();
const totalTracesPerDay: any =
await traceService.GetTotalTracePerDayPerProject(
projectId,
7 // last 7 days
);
const totalTracesPerHour: any =
await traceService.GetTotalTracePerHourPerProject(projectId, 168); // last 7 days in hours
const { averageLatencies, p99Latencies, p95Latencies } =
await traceService.GetAverageTraceLatenciesPerDayPerProject(projectId);
await traceService.GetAverageTraceLatenciesPerHourPerProject(projectId);
return NextResponse.json(
{
totalTracesPerDay,
totalTracesPerHour,
averageLatencies,
p99Latencies,
p95Latencies,
Expand Down
2 changes: 1 addition & 1 deletion app/api/metrics/usage/cost/route.ts
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ export async function GET(req: NextRequest) {
const projectId = req.nextUrl.searchParams.get("projectId") as string;
const traceService = new TraceService();
const total = await traceService.GetTokensCostPerProject(projectId);
const cost = await traceService.GetTokensCostPerDayPerProject(projectId);
const cost = await traceService.GetTokensCostPerHourPerProject(projectId);
return NextResponse.json(
{
cost,
Expand Down
2 changes: 1 addition & 1 deletion app/api/metrics/usage/span/route.ts
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ export async function GET(req: NextRequest) {
}

const traceService = new TraceService();
const spans: any = await traceService.GetTotalSpansPerDayPerProject(
const spans: any = await traceService.GetTotalSpansPerHourPerProject(
projectId,
7 // last 7 days
);
Expand Down
2 changes: 1 addition & 1 deletion app/api/metrics/usage/token/route.ts
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ export async function GET(req: NextRequest) {

const traceService = new TraceService();
const total = await traceService.GetTokensUsedPerProject(projectId);
const usage = await traceService.GetTokensUsedPerDayPerProject(projectId);
const usage = await traceService.GetTokensUsedPerHourPerProject(projectId);
return NextResponse.json(
{
usage,
Expand Down
2 changes: 1 addition & 1 deletion app/api/metrics/usage/trace/route.ts
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ export async function GET(req: NextRequest) {
}

const traceService = new TraceService();
const traces: any = await traceService.GetTotalTracePerDayPerProject(
const traces: any = await traceService.GetTotalTracePerHourPerProject(
projectId,
7 // last 7 days
);
Expand Down
10 changes: 8 additions & 2 deletions components/charts/token-chart.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,13 @@ import { useQuery } from "react-query";
import { toast } from "sonner";
import SmallChartLoading from "./small-chart-skeleton";

export function TokenChart({ projectId }: { projectId: string }) {
export function TokenChart({
projectId,
lastNHours = 168,
}: {
projectId: string;
lastNHours?: number;
}) {
const {
data: tokenUsage,
isLoading: tokenUsageLoading,
Expand All @@ -14,7 +20,7 @@ export function TokenChart({ projectId }: { projectId: string }) {
queryKey: [`fetch-metrics-usage-token-${projectId}-query`],
queryFn: async () => {
const response = await fetch(
`/api/metrics/usage/token?projectId=${projectId}`
`/api/metrics/usage/token?projectId=${projectId}&lastNHours=${lastNHours}`
);
if (!response.ok) {
const error = await response.json();
Expand Down
28 changes: 14 additions & 14 deletions lib/services/trace_service.ts
Original file line number Diff line number Diff line change
Expand Up @@ -15,23 +15,23 @@ export interface PaginationResult<T> {
}

export interface ITraceService {
GetTotalTracePerDayPerProject: (
GetTotalTracePerHourPerProject: (
project_id: string,
lastNHours?: number
) => Promise<number>;
GetTotalSpansPerDayPerProject: (
GetTotalSpansPerHourPerProject: (
project_id: string,
lastNHours?: number
) => Promise<number>;
GetTokensUsedPerDayPerProject: (
GetTokensUsedPerHourPerProject: (
project_id: string,
lastNHours?: number
) => Promise<number>;
GetTokensCostPerDayPerProject: (
GetTokensCostPerHourPerProject: (
project_id: string,
lastNHours?: number
) => Promise<number>;
GetAverageTraceLatenciesPerDayPerProject(
GetAverageTraceLatenciesPerHourPerProject(
project_id: string,
lastNHours?: number
): Promise<any>;
Expand Down Expand Up @@ -171,7 +171,7 @@ export class TraceService implements ITraceService {
}
}

async GetTotalSpansPerDayPerProject(
async GetTotalSpansPerHourPerProject(
project_id: string,
lastNHours = 168
): Promise<any> {
Expand Down Expand Up @@ -223,7 +223,7 @@ export class TraceService implements ITraceService {
}
}

async GetTotalTracePerDayPerProject(
async GetTotalTracePerHourPerProject(
project_id: string,
lastNHours = 168
): Promise<any> {
Expand Down Expand Up @@ -492,7 +492,7 @@ export class TraceService implements ITraceService {
}
}

async GetAverageTraceLatenciesPerDayPerProject(
async GetAverageTraceLatenciesPerHourPerProject(
project_id: string,
lastNHours = 168
): Promise<any> {
Expand Down Expand Up @@ -581,7 +581,7 @@ export class TraceService implements ITraceService {
}
}

async GetTokensUsedPerDayPerProject(
async GetTokensUsedPerHourPerProject(
project_id: string,
lastNHours = 168
): Promise<any> {
Expand Down Expand Up @@ -611,7 +611,7 @@ export class TraceService implements ITraceService {
const result = await this.client.find<any>(query);

// calculate total tokens used per day
const tokensUsedPerDay = result.map((row: any) => {
const tokensUsedPerHour = result.map((row: any) => {
let totalTokens = 0;
let inputTokens = 0;
let outputTokens = 0;
Expand Down Expand Up @@ -647,15 +647,15 @@ export class TraceService implements ITraceService {
};
});

return tokensUsedPerDay;
return tokensUsedPerHour;
} catch (error) {
throw new Error(
`An error occurred while trying to get the tokens used ${error}`
);
}
}

async GetTokensCostPerDayPerProject(
async GetTokensCostPerHourPerProject(
project_id: string,
lastNHours = 168 // Default to 168 hours (7 days)
): Promise<any> {
Expand Down Expand Up @@ -690,7 +690,7 @@ export class TraceService implements ITraceService {
const result = await this.client.find<any>(query);

// calculate total tokens used per day
const costPerDay = result.map((row: any) => {
const costPerHour = result.map((row: any) => {
let costs = { total: 0, input: 0, output: 0 };
row.attributes_list.forEach((attributes: any) => {
const parsedAttributes = JSON.parse(attributes);
Expand All @@ -711,7 +711,7 @@ export class TraceService implements ITraceService {
};
});

return costPerDay;
return costPerHour;
} catch (error) {
throw new Error(
`An error occurred while trying to get the tokens used ${error}`
Expand Down
22 changes: 18 additions & 4 deletions lib/utils.ts
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ import { createHash, randomBytes } from "crypto";
import { TiktokenEncoding, getEncoding } from "js-tiktoken";
import { NextResponse } from "next/server";
import { prettyPrintJson } from "pretty-print-json";
import qs from "qs";
import { twMerge } from "tailwind-merge";
import { Span } from "./clients/scale3_clickhouse/models/span";
import {
Expand All @@ -15,7 +16,6 @@ import {
PERPLEXITY_PRICING,
SpanStatusCode,
} from "./constants";
import qs from "qs";

export function cn(...inputs: ClassValue[]) {
return twMerge(clsx(inputs));
Expand Down Expand Up @@ -280,14 +280,17 @@ export function prepareForClickhouse(spans: Normalized[]): Span[] {
});
}

export function fillPromptStringTemplate(template: string, variables: { [key: string]: string }): string {
export function fillPromptStringTemplate(
template: string,
variables: { [key: string]: string }
): string {
return template.replace(/\{(\w+)\}/g, (match, key) => {
return variables[key] || match;
return variables[key] || match;
});
}

//TODO: Move to a middleware
export function parseQueryString(url: string): Record<string, any>{
export function parseQueryString(url: string): Record<string, any> {
return qs.parse(url.split("?")[1], {
decoder(str) {
if (str === "true") return true;
Expand Down Expand Up @@ -461,3 +464,14 @@ export function calculateTokens(content: string): number {
return estimateTokens(content); // Fallback method
}
}

export function formatDurationForDisplay(hours: number): string {
if (hours === 12) {
return "Last 12 hours";
} else if (hours % 24 === 0) {
const days = hours / 24;
return `Last ${days} day${days > 1 ? "s" : ""}`;
} else {
return `Last ${hours} hours`;
}
}