Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: prompt playground beta #4775

Merged
merged 42 commits into from
Oct 16, 2024
Merged

feat: prompt playground beta #4775

merged 42 commits into from
Oct 16, 2024

Commits on Oct 11, 2024

  1. Configuration menu
    Copy the full SHA
    2a0ddd9 View commit details
    Browse the repository at this point in the history
  2. feat: Playground UI prototype (#4778)

    * docs: initial playground PRD
    
    * feat: playground prototype
    
    * add rudamentary messages UI
    
    * WIP
    
    * routing
    
    * add a playground button
    
    * cleanup
    
    * cleanup routes
    
    * Update app/src/pages/playground/PlaygroundTemplate.tsx
    
    * Update app/src/pages/playground/spanPlaygroundPageLoader.ts
    
    * cleanup store
    mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    a0a83a2 View commit details
    Browse the repository at this point in the history
  3. feat(playground): streaming chat completions (#4785)

    * add subscriptions
    
    * configure relay
    
    * playground mvp
    
    * align the runs for multiple
    
    * add more functionality
    
    * cleanup the components
    
    ---------
    
    Co-authored-by: Mikyo King <mikyo@arize.com>
    axiomofjoy and mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    5948ea3 View commit details
    Browse the repository at this point in the history
  4. chore: lock pnpm deps

    mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    d83f5f4 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    72f05de View commit details
    Browse the repository at this point in the history
  6. feat(playground): rudimentary graphql support for messages input (#4907)

    * feat(playground): Chat message with role
    
    * feat(playground): pass in messages and roles
    
    * Update app/src/pages/playground/MessageRolePicker.tsx
    mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    ee1f85b View commit details
    Browse the repository at this point in the history
  7. feat(playground): Implement message role picker callback (#4909)

    * feat(playground): Implement message role picker callback
    
    * style(playground): Shorten import path for playgroundUtils
    cephalization authored and mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    b2a8bd0 View commit details
    Browse the repository at this point in the history
  8. feat(playground): parse span attribute llm.input_messages for playg…

    …round span replay (#4906)
    
    * begin building zod schemas for llm attributes
    
    * feat(playground): parse span input messages
    
    * move to utils, update role
    
    * update initial instance id
    
    * update id generation, add todo, add test files
    
    * add tests
    
    * memoize
    
    * move jest-canvas-mock to dev dependencies
    
    * update span not found error message
    
    * parse roles as strings and corece to ChatMessageRole
    
    * update ChatRoleMap comment
    
    * fix typos
    
    * update prop type to be InitialPlaygroundState
    
    * update naming
    
    * fix naming conflict
    Parker-Stafford authored and mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    f4b1d92 View commit details
    Browse the repository at this point in the history
  9. refactor(playground): move run, test input mode selection the top bar (

    …#4923)
    
    * refactor(playground): move run, test input mode selection the top bar
    
    * remove unused
    mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    e83380d View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    4a53e8e View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    784606a View commit details
    Browse the repository at this point in the history
  12. feat(playground): make chat messages match style in traces (#4931)

    * feat(playground): make chat messages match style in traces
    
    * small fixes
    
    * WIP
    mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    ed6e05e View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    ad27394 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    5d45e48 View commit details
    Browse the repository at this point in the history
  15. feat(playground): allow up to 4 instances, distinguish alphabetically (

    …#4951)
    
    * WIP
    
    * feat(playground): allow up to 4 playground instances, distinguish alphabetically
    mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    240bfe8 View commit details
    Browse the repository at this point in the history
  16. fix(playground): ignore keyboard events in template messages for drag…

    … and drop (#4945)
    
    * fix(playground): ignore keyboard events in template messages for drag and drop
    
    * pull default pointer sensor from dnd-kit/dom
    
    * update file name casing via git
    
    * migrate to non-experimental dnd-kit
    
    * remove unused experimental code, update naming and remove unnecessary props
    
    * remove strategy
    
    * fix forward ref warning
    Parker-Stafford authored and mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    2b6529f View commit details
    Browse the repository at this point in the history
  17. feat(playground): provide a back to trace button from the span playgr… (

    #4954)
    
    * feat(playground): provide a back to trace button from the span playground
    
    * fix
    
    * fix types in tests
    mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    01227e2 View commit details
    Browse the repository at this point in the history
  18. chore: update pnpm lock

    mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    08abfce View commit details
    Browse the repository at this point in the history
  19. ci: fix vitest (#4966)

    * change to vi
    
    * ci: fix vitest
    
    * remove unnecessary issues
    mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    dc95649 View commit details
    Browse the repository at this point in the history
  20. feat(playground): accumulate errors while parsing span attributes (#4941

    )
    
    * feat(playground): accumulate errors while parsing span attributes
    
    * update tests to include message id's / tools
    
    * update output for runs
    
    * update comments / test names
    
    * move parsing errors into span playground banners
    
    * cleanup spanplaygroundpage
    
    * add function to verify zod schema matches type
    Parker-Stafford authored and mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    c27dfb1 View commit details
    Browse the repository at this point in the history
  21. feat: Add model listing (#4948)

    * Add query for model providers
    
    * gql build
    
    * Hardcode all models for now
    anticorrelator authored and mikeldking committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    94d92fb View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    0d1c141 View commit details
    Browse the repository at this point in the history
  23. feat(playground): model selector (#4971)

    * global declaration of generative
    
    * feat(playground): rudamentary model selector
    
    * model provider in tests
    
    * WIP
    mikeldking authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    025c33e View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. feat(playground): Implement codemirror based template string editor (#…

    …4943)
    
    * feat(playground): Implement codemirror based template string editor
    
    * Implement mustacheLike Language grammar
    
    * Fix top level language definitions
    
    * feat(playground): Support template escaping and nesting in fstring template lang
    
    * feat(playground): Improve mustache grammar and implement mustache format fn
    
    * fix(playground): Allow Enter key within codemirror editor
    
    * refactor(playground): Improve comments for mustache like lang
    
    * refactor(playground): Refactor variable extraction and lang format funcs into shared utils
    
    * test(playground): Test FStringTemplate and MustacheTemplate languages
    
    * refactor(playground): Remove debug logging
    
    * fix(playground): Correctly parse empty templates, escape slashes, triple braces
    
    * fix(playground): Apply parsing fixes to fstring as well
    
    * refactor(playground): Remove debug
    
    * docs(playground): Add comments to lexer grammars
    
    * docs(playground): Add comments to debug fns
    
    * docs(playground): Improve comment formatting
    
    * refactor(playground): Use named object arguments for variable extractor
    
    * refactor(playground): rename lang directories
    
    * fix(playground): Add a lightmode theme to template editor
    
    * refactor(playground): More detailed typing to variable format record
    cephalization authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    e20716f View commit details
    Browse the repository at this point in the history
  2. feat(playground): add credential storage (#4970)

    * feat(playground): add credential storage
    
    * organize
    
    * reorganize store files
    
    * add credentials dropdown
    
    * remove unused icon
    
    * make credentials inputs unique per provider
    
    * update unique logic for providers
    
    * migrate to instance.model.provider from instance.provider
    
    * move provider in tests
    Parker-Stafford authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    b15f2a4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    39c9940 View commit details
    Browse the repository at this point in the history
  4. feat(playground): playground layout (#4978)

    * playground layout
    
    * WIP
    
    * final changes
    
    * fix styles
    
    * final fix
    
    * cleanup the store
    
    * Update app/src/components/resize/styles.tsx
    mikeldking authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    2c50441 View commit details
    Browse the repository at this point in the history
  5. fix(playground): invalidate cache for playground span project to ensu…

    …re new span is refetched (#4991)
    
    Co-authored-by: Roger Yang <roger.yang@arize.com>
    axiomofjoy and RogerHYang authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    985042c View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    bbbfd22 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    23e9d82 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. fix(playground): plumb through model name and providers (#4999)

    Co-authored-by: Mikyo King <mikyo@arize.com>
    axiomofjoy and mikeldking authored Oct 15, 2024
    Configuration menu
    Copy the full SHA
    23958bd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    716b1c7 View commit details
    Browse the repository at this point in the history
  3. fix(playground): plumb through credentials (#5003)

    Co-authored-by: Parker Stafford <52351508+Parker-Stafford@users.noreply.github.com>
    axiomofjoy and Parker-Stafford authored Oct 15, 2024
    Configuration menu
    Copy the full SHA
    0fa0c87 View commit details
    Browse the repository at this point in the history
  4. feat(playground): Extract and display variables from all message temp…

    …lates as "inputs" (#4994)
    
    * feat(playground): Extract and display variables from all message templates as "inputs"
    
    * docs(playground): Add comments
    
    * fix(playground): Switch default language back to Mustache
    
    * docs(playground): Add comments and improve typing readability for template utils
    
    * feat(playground): Support text completion prompt variable substitution
    cephalization authored Oct 15, 2024
    Configuration menu
    Copy the full SHA
    b8cd777 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    45755bb View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    415ec6f View commit details
    Browse the repository at this point in the history
  7. feat(playground): add tools ui (#5002)

    * feat(playground): add tools ui
    
    * add tools back after rebase
    
    * update tool type to be partial in store for editing
    
    * make tool editor uncontrolled, add tool choice selector
    
    * make fields pass through
    
    * allow for extra keys in the json schema
    
    * support json schema in jsonEditor, remove jsonToolEditor
    
    * update descriptions
    
    * fix types
    
    * fix key collision on choice picker
    
    * update comment
    
    * more comments
    
    * WIP
    
    * styling
    
    * cleanup
    
    ---------
    
    Co-authored-by: Mikyo King <mikyo@arize.com>
    Parker-Stafford and mikeldking authored Oct 15, 2024
    Configuration menu
    Copy the full SHA
    767bd37 View commit details
    Browse the repository at this point in the history
  8. feat(playground): Implement editable input variable textareas (#4987) (

    …#5006)
    
    * feat(playground): Implement editable input variable textareas (#4987)
    
    * docs(playground): Improve commenting around playground store usage
    
    * refactor(playground): Switch to mostly unstyled codemirror for variable editing
    
    * fix(playground): Fix styling issues and flickering when rendering playground variable inputs
    
    * refactor(playground): Add and use type guards for playground input type
    
    * docs(playground): update comment on variable cache mechanics
    
    * fix(playground): fix types and tests post rebase
    cephalization authored Oct 15, 2024
    Configuration menu
    Copy the full SHA
    ab09109 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Configuration menu
    Copy the full SHA
    9d375e5 View commit details
    Browse the repository at this point in the history
  2. feat(playground): parse model name and infer provider form span (#5021)

    * feat(playground): parse model name and infer provider form span
    
    * update azure model selector to be a text field to account for user defined deployment names
    
    * add label
    
    * move defaults into generative constants, fallback to openai not azure
    
    * update defult in test
    Parker-Stafford authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    45973b7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5485c03 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    75b7000 View commit details
    Browse the repository at this point in the history