Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve developer-facing evaluations API #4370

Merged
merged 23 commits into from
Feb 16, 2024
Merged

Improve developer-facing evaluations API #4370

merged 23 commits into from
Feb 16, 2024

Commits on Feb 15, 2024

  1. Merge customEvaluators and evaluators

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    b2b2e19 View commit details
    Browse the repository at this point in the history

  2. Add RunnableTraceable

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    6675c7f View commit details
    Browse the repository at this point in the history

  3. Fix import error

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    25a246a View commit details
    Browse the repository at this point in the history

  4. Add entrypoints

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    d12a7fe View commit details
    Browse the repository at this point in the history

  5. Add alias for evaluators

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    aad9155 View commit details
    Browse the repository at this point in the history

  6. Add option to specify traceable function

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    40377ea View commit details
    Browse the repository at this point in the history

  7. Add config

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    a2c3571 View commit details
    Browse the repository at this point in the history

  8. Add criteria and labeled criteria helpers

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    65c03a2 View commit details
    Browse the repository at this point in the history

  9. Remove RunnableTraceable

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    bb54710 View commit details
    Browse the repository at this point in the history

  10. Remove RunnableTraceable from core

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    3cbed1a View commit details
    Browse the repository at this point in the history

  11. Wrap traceable into a runnable

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    f21ad4a View commit details
    Browse the repository at this point in the history

  12. Accept any traceable function

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    c8e1e95 View commit details
    Browse the repository at this point in the history

  13. Update internals

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    a274881 View commit details
    Browse the repository at this point in the history

  14. Avoid directly importing langsmith/traceable

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    cc2d49a View commit details
    Browse the repository at this point in the history

  15. Update to 0.1.1

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    747fc20 View commit details
    Browse the repository at this point in the history

  16. Fix build

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    2a903a7 View commit details
    Browse the repository at this point in the history

  17. Bump deps to 0.1.1

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    7ff3543 View commit details
    Browse the repository at this point in the history

  18. Update docs

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    42741f1 View commit details
    Browse the repository at this point in the history

  19. expose configurable feedbackKey

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    dcd2a85 View commit details
    Browse the repository at this point in the history

  20. Handle single non-record object being passed properly

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    e3a346f View commit details
    Browse the repository at this point in the history

  21. Still handle existing edge case

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    8901096 View commit details
    Browse the repository at this point in the history

  22. Fix formatting

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    f80c20d View commit details
    Browse the repository at this point in the history

  23. Add missing feedbackKey

    @dqbd
    dqbd committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    8933cf5 View commit details
    Browse the repository at this point in the history