langchain[patch]: Fix run on dataset method for built-in evaluators #4332
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
dosubot
bot
added
the
size:L
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
dosubot
bot
added
the
auto:bug
hinthornw
approved these changes
Feb 7, 2024
|
Noice, was gonna create an issue about this but it seems this is the fix 👍🏻 hope this is released soon. |
|
Thanks @Gr33nLight! Am about to ship another version now, will post here when that's live. |
|
This is now live in langchain@0.1.16 @Gr33nLight |
|
@jacoblee93 Great! Tested it and it works. |
nicolewhite
referenced
this pull request
in autoblocksai/javascript-sdk
Feb 13, 2024
[](https://renovatebot.com) This PR contains the following updates: | Package | Change | Age | Adoption | Passing | Confidence | |---|---|---|---|---|---| | [@types/react](https://togithub.com/DefinitelyTyped/DefinitelyTyped/tree/master/types/react) ([source](https://togithub.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/react)) | [`18.2.53` -> `18.2.55`](https://renovatebot.com/diffs/npm/@types%2freact/18.2.53/18.2.55) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | | [@typescript-eslint/eslint-plugin](https://togithub.com/typescript-eslint/typescript-eslint) ([source](https://togithub.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/eslint-plugin)) | [`6.20.0` -> `6.21.0`](https://renovatebot.com/diffs/npm/@typescript-eslint%2feslint-plugin/6.20.0/6.21.0) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | | [@typescript-eslint/parser](https://togithub.com/typescript-eslint/typescript-eslint) ([source](https://togithub.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/parser)) | [`6.20.0` -> `6.21.0`](https://renovatebot.com/diffs/npm/@typescript-eslint%2fparser/6.20.0/6.21.0) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | | [langchain](https://togithub.com/langchain-ai/langchainjs/tree/main/langchain/) ([source](https://togithub.com/langchain-ai/langchainjs)) | [`0.1.13` -> `0.1.17`](https://renovatebot.com/diffs/npm/langchain/0.1.13/0.1.17) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | | [openai](https://togithub.com/openai/openai-node) | [`4.26.1` -> `4.27.1`](https://renovatebot.com/diffs/npm/openai/4.26.1/4.27.1) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | | [tsup](https://tsup.egoist.dev/) ([source](https://togithub.com/egoist/tsup)) | [`8.0.1` -> `8.0.2`](https://renovatebot.com/diffs/npm/tsup/8.0.1/8.0.2) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | | [tsx](https://togithub.com/privatenumber/tsx) | [`4.7.0` -> `4.7.1`](https://renovatebot.com/diffs/npm/tsx/4.7.0/4.7.1) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | --- ### Release Notes <details> <summary>typescript-eslint/typescript-eslint (@​typescript-eslint/eslint-plugin)</summary> ### [`v6.21.0`](https://togithub.com/typescript-eslint/typescript-eslint/blob/HEAD/packages/eslint-plugin/CHANGELOG.md#6210-2024-02-05) [Compare Source](https://togithub.com/typescript-eslint/typescript-eslint/compare/v6.20.0...v6.21.0) ##### 🚀 Features - export plugin metadata - allow `parserOptions.project: false` - **eslint-plugin:** add rule prefer-find ##### 🩹 Fixes - **eslint-plugin:** \[no-unused-vars] don't report on types referenced in export assignment expression - **eslint-plugin:** \[switch-exhaustiveness-check] better support for intersections, infinite types, non-union values - **eslint-plugin:** \[consistent-type-imports] dont report on types used in export assignment expressions - **eslint-plugin:** \[no-unnecessary-condition] handle left-hand optional with exactOptionalPropertyTypes option - **eslint-plugin:** \[class-literal-property-style] allow getter when same key setter exists - **eslint-plugin:** \[no-unnecessary-type-assertion] provide valid fixes for assertions with extra tokens before `as` keyword ##### ❤️ Thank You - auvred - Brad Zacher - Kirk Waiblinger - Pete Gonzalez - YeonJuan You can read about our [versioning strategy](https://main--typescript-eslint.netlify.app/users/versioning) and [releases](https://main--typescript-eslint.netlify.app/users/releases) on our website. </details> <details> <summary>typescript-eslint/typescript-eslint (@​typescript-eslint/parser)</summary> ### [`v6.21.0`](https://togithub.com/typescript-eslint/typescript-eslint/blob/HEAD/packages/parser/CHANGELOG.md#6210-2024-02-05) [Compare Source](https://togithub.com/typescript-eslint/typescript-eslint/compare/v6.20.0...v6.21.0) ##### 🚀 Features - allow `parserOptions.project: false` ##### ❤️ Thank You - auvred - Brad Zacher - Kirk Waiblinger - Pete Gonzalez - YeonJuan You can read about our [versioning strategy](https://main--typescript-eslint.netlify.app/users/versioning) and [releases](https://main--typescript-eslint.netlify.app/users/releases) on our website. </details> <details> <summary>langchain-ai/langchainjs (langchain)</summary> ### [`v0.1.17`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.17) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.16...0.1.17) #### What's Changed - langchain\[patch]: Release 0.1.16 by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4334](https://togithub.com/langchain-ai/langchainjs/pull/4334) - Correct waitlist instruction in README by [@​eknuth](https://togithub.com/eknuth) in [https://github.com/langchain-ai/langchainjs/pull/4335](https://togithub.com/langchain-ai/langchainjs/pull/4335) - docs\[patch]: Fix broken link by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4336](https://togithub.com/langchain-ai/langchainjs/pull/4336) - langchain\[patch]: Export helper functions from indexing api by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4344](https://togithub.com/langchain-ai/langchainjs/pull/4344) - docs\[minor]: Add Human-in-the-loop to tools use case by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4314](https://togithub.com/langchain-ai/langchainjs/pull/4314) - langchain\[minor],docs\[minor]: Add `SitemapLoader` by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4331](https://togithub.com/langchain-ai/langchainjs/pull/4331) - langchain\[patch]: Rm unwanted build artifacts by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4345](https://togithub.com/langchain-ai/langchainjs/pull/4345) #### New Contributors - [@​eknuth](https://togithub.com/eknuth) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4335](https://togithub.com/langchain-ai/langchainjs/pull/4335) **Full Changelog**: langchain-ai/langchainjs@0.1.16...0.1.17 ### [`v0.1.16`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.16) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.15...0.1.16) #### What's Changed - scripts\[minor],docs\[minor]: Add migration script to scripts package by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4326](https://togithub.com/langchain-ai/langchainjs/pull/4326) - scripts\[patch]: Release 0.0.5 by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4330](https://togithub.com/langchain-ai/langchainjs/pull/4330) - Update aws.mdx by [@​jasel-lewis](https://togithub.com/jasel-lewis) in [https://github.com/langchain-ai/langchainjs/pull/4322](https://togithub.com/langchain-ai/langchainjs/pull/4322) - Updated debugging.mdx by [@​jasonnathan](https://togithub.com/jasonnathan) in [https://github.com/langchain-ai/langchainjs/pull/4319](https://togithub.com/langchain-ai/langchainjs/pull/4319) - langchain\[patch]: Fix run on dataset method for built-in evaluators by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4332](https://togithub.com/langchain-ai/langchainjs/pull/4332) #### New Contributors - [@​jasel-lewis](https://togithub.com/jasel-lewis) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4322](https://togithub.com/langchain-ai/langchainjs/pull/4322) - [@​jasonnathan](https://togithub.com/jasonnathan) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4319](https://togithub.com/langchain-ai/langchainjs/pull/4319) **Full Changelog**: langchain-ai/langchainjs@0.1.15...0.1.16 ### [`v0.1.15`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.15) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.14...0.1.15) #### What's Changed - langchain\[patch]: Release 0.1.14 by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4315](https://togithub.com/langchain-ai/langchainjs/pull/4315) - ci\[minor]: Add new test:unit:ci and build before tests in ci file by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4312](https://togithub.com/langchain-ai/langchainjs/pull/4312) - Revert "langchain\[minor]: Add imports migration script" by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4324](https://togithub.com/langchain-ai/langchainjs/pull/4324) - core\[patch]: Inline more portable SAX parser, remove node-only type import by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4325](https://togithub.com/langchain-ai/langchainjs/pull/4325) - langchain\[patch],community\[patch]: Fix lint warnings by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4323](https://togithub.com/langchain-ai/langchainjs/pull/4323) - core\[patch]: Release 0.1.25 by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4327](https://togithub.com/langchain-ai/langchainjs/pull/4327) - langchain\[patch]: Bump core dep by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4328](https://togithub.com/langchain-ai/langchainjs/pull/4328) - langchain\[patch]: Release 0.1.15 by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4329](https://togithub.com/langchain-ai/langchainjs/pull/4329) **Full Changelog**: langchain-ai/langchainjs@0.1.14...0.1.15 ### [`v0.1.14`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.14) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.13...0.1.14) #### What's Changed - langchain\[patch]: Release 0.1.13 by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4287](https://togithub.com/langchain-ai/langchainjs/pull/4287) - langchain\[patch]: Improve memory vector store tests by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4283](https://togithub.com/langchain-ai/langchainjs/pull/4283) - infra\[minor]: Split unit tests by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4292](https://togithub.com/langchain-ai/langchainjs/pull/4292) - docs\[minor]: Add new QA & RAG use case section by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4211](https://togithub.com/langchain-ai/langchainjs/pull/4211) - docs\[patch]: Fix header typo by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4295](https://togithub.com/langchain-ai/langchainjs/pull/4295) - create-langchain-integration\[patch]: Fix build command + release by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4297](https://togithub.com/langchain-ai/langchainjs/pull/4297) - redis\[major]: Adds new [@​langchain/redis](https://togithub.com/langchain/redis) integration package by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4299](https://togithub.com/langchain-ai/langchainjs/pull/4299) - redis\[patch]: Release 0.0.1 by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4300](https://togithub.com/langchain-ai/langchainjs/pull/4300) - community\[minor]: update CloseVector versions to greatly improve web saving/loading of index files over 5MB. by [@​jo32](https://togithub.com/jo32) in [https://github.com/langchain-ai/langchainjs/pull/4291](https://togithub.com/langchain-ai/langchainjs/pull/4291) - google-genai\[patch]: Extend GoogleGenerativeAIEmbeddings to embed more than 100 documents by [@​imjwang](https://togithub.com/imjwang) in [https://github.com/langchain-ai/langchainjs/pull/4279](https://togithub.com/langchain-ai/langchainjs/pull/4279) - google-genai\[patch]: Release 0.0.10 by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4301](https://togithub.com/langchain-ai/langchainjs/pull/4301) - Fix typos and grammer errors in concepts.mdx by [@​barisbll](https://togithub.com/barisbll) in [https://github.com/langchain-ai/langchainjs/pull/4304](https://togithub.com/langchain-ai/langchainjs/pull/4304) - core\[patch]: Properly export ImagePromptTemplate by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4307](https://togithub.com/langchain-ai/langchainjs/pull/4307) - ci\[patch]: Set concurrency to 1 for unit tests ci by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4310](https://togithub.com/langchain-ai/langchainjs/pull/4310) - core\[minor]: Move remote runnable to core and fix base message serialization format by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4309](https://togithub.com/langchain-ai/langchainjs/pull/4309) - core\[patch]: Update build artifact by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4311](https://togithub.com/langchain-ai/langchainjs/pull/4311) - core\[patch]: Release 0.1.24 by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4313](https://togithub.com/langchain-ai/langchainjs/pull/4313) - docs\[minor]: Add OpenAI tools docs by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4306](https://togithub.com/langchain-ai/langchainjs/pull/4306) - langchain\[patch]: Fix ImagePromptTemplate deserialization, export RemoteRunnable directly from [@​langchain/core](https://togithub.com/langchain/core) by [@​jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4308](https://togithub.com/langchain-ai/langchainjs/pull/4308) - langchain\[minor]: Add imports migration script by [@​bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4103](https://togithub.com/langchain-ai/langchainjs/pull/4103) - langchain\[patch]: update metadata and default expand param for confluence loader by [@​fuleinist](https://togithub.com/fuleinist) in [https://github.com/langchain-ai/langchainjs/pull/4220](https://togithub.com/langchain-ai/langchainjs/pull/4220) #### New Contributors - [@​barisbll](https://togithub.com/barisbll) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4304](https://togithub.com/langchain-ai/langchainjs/pull/4304) **Full Changelog**: langchain-ai/langchainjs@0.1.13...0.1.14 </details> <details> <summary>openai/openai-node (openai)</summary> ### [`v4.27.1`](https://togithub.com/openai/openai-node/blob/HEAD/CHANGELOG.md#4271-2024-02-12) [Compare Source](https://togithub.com/openai/openai-node/compare/v4.27.0...v4.27.1) Full Changelog: [v4.27.0...v4.27.1](https://togithub.com/openai/openai-node/compare/v4.27.0...v4.27.1) ### [`v4.27.0`](https://togithub.com/openai/openai-node/blob/HEAD/CHANGELOG.md#4270-2024-02-08) [Compare Source](https://togithub.com/openai/openai-node/compare/v4.26.1...v4.27.0) Full Changelog: [v4.26.1...v4.27.0](https://togithub.com/openai/openai-node/compare/v4.26.1...v4.27.0) ##### Features - **api:** add `timestamp_granularities`, add `gpt-3.5-turbo-0125` model ([#​661](https://togithub.com/openai/openai-node/issues/661)) ([5016806](https://togithub.com/openai/openai-node/commit/50168066862f66b529bae29f4564741300303246)) ##### Chores - **internal:** fix retry mechanism for ecosystem-test ([#​663](https://togithub.com/openai/openai-node/issues/663)) ([0eb7ed5](https://togithub.com/openai/openai-node/commit/0eb7ed5ca3f7c7b29c316fc7d725d834cee73989)) - respect `application/vnd.api+json` content-type header ([#​664](https://togithub.com/openai/openai-node/issues/664)) ([f4fad54](https://togithub.com/openai/openai-node/commit/f4fad549c5c366d8dd8b936b7699639b895e82a1)) </details> <details> <summary>egoist/tsup (tsup)</summary> ### [`v8.0.2`](https://togithub.com/egoist/tsup/releases/tag/v8.0.2) [Compare Source](https://togithub.com/egoist/tsup/compare/v8.0.1...v8.0.2) ##### Bug Fixes - support swc target for mjs ([#​1081](https://togithub.com/egoist/tsup/issues/1081)) ([83c7c7f](https://togithub.com/egoist/tsup/commit/83c7c7f3131ca6d46aaad4de3111c2fd5e5b5c21)) </details> <details> <summary>privatenumber/tsx (tsx)</summary> ### [`v4.7.1`](https://togithub.com/privatenumber/tsx/releases/tag/v4.7.1) [Compare Source](https://togithub.com/privatenumber/tsx/compare/v4.7.0...v4.7.1) ##### Bug Fixes - escape `import.meta.url` passed to esbuild ([#​474](https://togithub.com/privatenumber/tsx/issues/474)) ([e23592e](https://togithub.com/privatenumber/tsx/commit/e23592ea6485cfecfb6915098fc7423fcc03a3b6)) - remove the pipe file before starting the ipc server ([#​459](https://togithub.com/privatenumber/tsx/issues/459)) ([0ed0097](https://togithub.com/privatenumber/tsx/commit/0ed00976165b45cf7928e582ce1debf9d1133ef3)) *** This release is also available on: - [npm package (@​latest dist-tag)](https://www.npmjs.com/package/tsx/v/4.7.1) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "before 4am on Monday" in timezone America/Chicago, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://togithub.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://developer.mend.io/github/autoblocksai/javascript-sdk). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4xNzMuMCIsInVwZGF0ZWRJblZlciI6IjM3LjE3My4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiJ9--> Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
](https://renovatebot.com){kind=link}
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
CC @agola11 @hinthornw