feat: prompt playground beta #4775
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
mikeldking
added
feature branch
mikeldking
force-pushed
the
playground
branch
2 times, most recently
from
cf18e34
to
5990585
Compare
* docs: initial playground PRD * feat: playground prototype * add rudamentary messages UI * WIP * routing * add a playground button * cleanup * cleanup routes * Update app/src/pages/playground/PlaygroundTemplate.tsx * Update app/src/pages/playground/spanPlaygroundPageLoader.ts * cleanup store
* add subscriptions * configure relay * playground mvp * align the runs for multiple * add more functionality * cleanup the components --------- Co-authored-by: Mikyo King <mikyo@arize.com>
* feat(playground): Chat message with role * feat(playground): pass in messages and roles * Update app/src/pages/playground/MessageRolePicker.tsx
* feat(playground): Implement message role picker callback * style(playground): Shorten import path for playgroundUtils
…round span replay (#4906) * begin building zod schemas for llm attributes * feat(playground): parse span input messages * move to utils, update role * update initial instance id * update id generation, add todo, add test files * add tests * memoize * move jest-canvas-mock to dev dependencies * update span not found error message * parse roles as strings and corece to ChatMessageRole * update ChatRoleMap comment * fix typos * update prop type to be InitialPlaygroundState * update naming * fix naming conflict
…#4923) * refactor(playground): move run, test input mode selection the top bar * remove unused
* feat(playground): make chat messages match style in traces * small fixes * WIP
…#4951) * WIP * feat(playground): allow up to 4 playground instances, distinguish alphabetically
… and drop (#4945) * fix(playground): ignore keyboard events in template messages for drag and drop * pull default pointer sensor from dnd-kit/dom * update file name casing via git * migrate to non-experimental dnd-kit * remove unused experimental code, update naming and remove unnecessary props * remove strategy * fix forward ref warning
#4954) * feat(playground): provide a back to trace button from the span playground * fix * fix types in tests
* change to vi * ci: fix vitest * remove unnecessary issues
) * feat(playground): accumulate errors while parsing span attributes * update tests to include message id's / tools * update output for runs * update comments / test names * move parsing errors into span playground banners * cleanup spanplaygroundpage * add function to verify zod schema matches type
* Add query for model providers * gql build * Hardcode all models for now
mikeldking
force-pushed
the
playground
branch
from
19dde65
to
0d1c141
Compare
* global declaration of generative * feat(playground): rudamentary model selector * model provider in tests * WIP
…4943) * feat(playground): Implement codemirror based template string editor * Implement mustacheLike Language grammar * Fix top level language definitions * feat(playground): Support template escaping and nesting in fstring template lang * feat(playground): Improve mustache grammar and implement mustache format fn * fix(playground): Allow Enter key within codemirror editor * refactor(playground): Improve comments for mustache like lang * refactor(playground): Refactor variable extraction and lang format funcs into shared utils * test(playground): Test FStringTemplate and MustacheTemplate languages * refactor(playground): Remove debug logging * fix(playground): Correctly parse empty templates, escape slashes, triple braces * fix(playground): Apply parsing fixes to fstring as well * refactor(playground): Remove debug * docs(playground): Add comments to lexer grammars * docs(playground): Add comments to debug fns * docs(playground): Improve comment formatting * refactor(playground): Use named object arguments for variable extractor * refactor(playground): rename lang directories * fix(playground): Add a lightmode theme to template editor * refactor(playground): More detailed typing to variable format record
* feat(playground): add credential storage * organize * reorganize store files * add credentials dropdown * remove unused icon * make credentials inputs unique per provider * update unique logic for providers * migrate to instance.model.provider from instance.provider * move provider in tests
* playground layout * WIP * final changes * fix styles * final fix * cleanup the store * Update app/src/components/resize/styles.tsx
…re new span is refetched (#4991) Co-authored-by: Roger Yang <roger.yang@arize.com>
Co-authored-by: Mikyo King <mikyo@arize.com>
Co-authored-by: Parker Stafford <52351508+Parker-Stafford@users.noreply.github.com>
…lates as "inputs" (#4994) * feat(playground): Extract and display variables from all message templates as "inputs" * docs(playground): Add comments * fix(playground): Switch default language back to Mustache * docs(playground): Add comments and improve typing readability for template utils * feat(playground): Support text completion prompt variable substitution
* feat(playground): add tools ui * add tools back after rebase * update tool type to be partial in store for editing * make tool editor uncontrolled, add tool choice selector * make fields pass through * allow for extra keys in the json schema * support json schema in jsonEditor, remove jsonToolEditor * update descriptions * fix types * fix key collision on choice picker * update comment * more comments * WIP * styling * cleanup --------- Co-authored-by: Mikyo King <mikyo@arize.com>
…#5006) * feat(playground): Implement editable input variable textareas (#4987) * docs(playground): Improve commenting around playground store usage * refactor(playground): Switch to mostly unstyled codemirror for variable editing * fix(playground): Fix styling issues and flickering when rendering playground variable inputs * refactor(playground): Add and use type guards for playground input type * docs(playground): update comment on variable cache mechanics * fix(playground): fix types and tests post rebase
* feat(playground): parse model name and infer provider form span * update azure model selector to be a text field to account for user defined deployment names * add label * move defaults into generative constants, fallback to openai not azure * update defult in test
axiomofjoy
approved these changes
Oct 16, 2024
dosubot
bot
added
the
size:XXL
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The feature branch for the playground feature #3435