LangSmith Test Runner #4011

hinthornw · 2024-01-13T02:58:37Z

Implements the runOnDataset functionality for JS.

Implementation + integration tests for KV dataset
Support for custom run evaluators
Deserialization of chat messages, etc.
Tests for LLM / Chat datasets
Support for string evaluators + auto-loading
Add example walkthrough

Known deficiencies:

Doesn't (yet) print out the eval project name
Currently doesn't apply run evaluators at the same time as the prediction step, which is slower
Evaluator runs aren't traced to the evaluators project.

vercel · 2024-01-13T02:58:44Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
langchainjs-api-refs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jan 24, 2024 6:58am
langchainjs-docs	✅ Ready (Inspect)	Visit Preview		Jan 24, 2024 6:58am

dosubot · 2024-01-13T02:59:18Z

langchain/package.json

@@ -1211,7 +1211,7 @@
    "js-yaml": "^4.1.0",


Hey there! I noticed a change in the langsmith dependency version from "~0.0.48" to "~0.0.59" in the package.json file. This comment is to flag the change for maintainers to review, as it may impact peer/dev/hard dependencies. Keep up the great work!

docs/core_docs/docs/guides/langsmith_evaluation.md

jacoblee93 · 2024-01-14T23:18:44Z

docs/core_docs/docs/guides/langsmith_evaluation.md

+const retriever = new TavilySearchAPIRetriever({
+  k: 10,
+});
+const formatDocs = (docs: DocumentInterface[]) =>


Might be better to use just Document for clarity

Hm Document wasn't working with the type system but I'll see

jacoblee93 · 2024-01-14T23:19:38Z

docs/core_docs/docs/guides/langsmith_evaluation.md

+]);
+
+const getString = (input: { input: string }) => input.input;
+const selectInput = new RunnableLambda({


You can do RunnableLambda.from() but you also don't even need this - .pipe will coerce the function to a RunnableLambda

Even if first in the chain though?

The way you're using it now it should I think since it's in a RunnableMap constructor?

docs/core_docs/docs/guides/langsmith_evaluation.md

langchain/Untitled.ipynb

jacoblee93 · 2024-01-14T23:27:32Z

langchain/scripts/create-entrypoints.js

@@ -336,6 +336,8 @@ const entrypoints = {
  "experimental/tools/pyinterpreter": "experimental/tools/pyinterpreter",
  // evaluation
  evaluation: "evaluation/index",
+  // smith (LangSmith Evaluation)
+  smith: "smith/index",


This was the only change in this file right? The rest is just formatting?

More philosophically, does all this really belong in LangChain.js? Could it just be part of the langsmith SDK?

Seems weird to import certain things from langchain/smith vs. langsmith.

Could be its own package maybe. Reason for being here is langsmith can't have a dep on langchain.

langchain/src/smith/config.ts

[![Mend Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com) This PR contains the following updates: | Package | Change | Age | Adoption | Passing | Confidence | |---|---|---|---|---|---| | [@types/jest](https://togithub.com/DefinitelyTyped/DefinitelyTyped/tree/master/types/jest) ([source](https://togithub.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/jest)) | [`29.5.11` -> `29.5.12`](https://renovatebot.com/diffs/npm/@types%2fjest/29.5.11/29.5.12) | [![age](https://developer.mend.io/api/mc/badges/age/npm/@types%2fjest/29.5.12?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/@types%2fjest/29.5.12?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/@types%2fjest/29.5.11/29.5.12?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/@types%2fjest/29.5.11/29.5.12?slim=true)](https://docs.renovatebot.com/merge-confidence/) | | [@types/react](https://togithub.com/DefinitelyTyped/DefinitelyTyped/tree/master/types/react) ([source](https://togithub.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/react)) | [`18.2.48` -> `18.2.53`](https://renovatebot.com/diffs/npm/@types%2freact/18.2.48/18.2.53) | [![age](https://developer.mend.io/api/mc/badges/age/npm/@types%2freact/18.2.53?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/@types%2freact/18.2.53?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/@types%2freact/18.2.48/18.2.53?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/@types%2freact/18.2.48/18.2.53?slim=true)](https://docs.renovatebot.com/merge-confidence/) | | [@typescript-eslint/eslint-plugin](https://togithub.com/typescript-eslint/typescript-eslint) ([source](https://togithub.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/eslint-plugin)) | [`6.19.0` -> `6.20.0`](https://renovatebot.com/diffs/npm/@typescript-eslint%2feslint-plugin/6.19.0/6.20.0) | [![age](https://developer.mend.io/api/mc/badges/age/npm/@typescript-eslint%2feslint-plugin/6.20.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/@typescript-eslint%2feslint-plugin/6.20.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/@typescript-eslint%2feslint-plugin/6.19.0/6.20.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/@typescript-eslint%2feslint-plugin/6.19.0/6.20.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | | [@typescript-eslint/parser](https://togithub.com/typescript-eslint/typescript-eslint) ([source](https://togithub.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/parser)) | [`6.19.0` -> `6.20.0`](https://renovatebot.com/diffs/npm/@typescript-eslint%2fparser/6.19.0/6.20.0) | [![age](https://developer.mend.io/api/mc/badges/age/npm/@typescript-eslint%2fparser/6.20.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/@typescript-eslint%2fparser/6.20.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/@typescript-eslint%2fparser/6.19.0/6.20.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/@typescript-eslint%2fparser/6.19.0/6.20.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | | [ai-jsx](https://ai-jsx.com) ([source](https://togithub.com/fixie-ai/ai-jsx)) | [`^0.28.1` -> `^0.29.0`](https://renovatebot.com/diffs/npm/ai-jsx/0.28.2/0.29.0) | [![age](https://developer.mend.io/api/mc/badges/age/npm/ai-jsx/0.29.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/ai-jsx/0.29.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/ai-jsx/0.28.2/0.29.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/ai-jsx/0.28.2/0.29.0?slim=true)](https://docs.renovatebot.com/merge-confidence/) | | [langchain](https://togithub.com/langchain-ai/langchainjs/tree/main/langchain/) ([source](https://togithub.com/langchain-ai/langchainjs)) | [`0.1.5` -> `0.1.13`](https://renovatebot.com/diffs/npm/langchain/0.1.5/0.1.13) | [![age](https://developer.mend.io/api/mc/badges/age/npm/langchain/0.1.13?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/langchain/0.1.13?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/langchain/0.1.5/0.1.13?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/langchain/0.1.5/0.1.13?slim=true)](https://docs.renovatebot.com/merge-confidence/) | | [lint-staged](https://togithub.com/okonet/lint-staged) | [`15.2.0` -> `15.2.2`](https://renovatebot.com/diffs/npm/lint-staged/15.2.0/15.2.2) | [![age](https://developer.mend.io/api/mc/badges/age/npm/lint-staged/15.2.2?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/lint-staged/15.2.2?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/lint-staged/15.2.0/15.2.2?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/lint-staged/15.2.0/15.2.2?slim=true)](https://docs.renovatebot.com/merge-confidence/) | | [openai](https://togithub.com/openai/openai-node) | [`4.25.0` -> `4.26.1`](https://renovatebot.com/diffs/npm/openai/4.25.0/4.26.1) | [![age](https://developer.mend.io/api/mc/badges/age/npm/openai/4.26.1?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/openai/4.26.1?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/openai/4.25.0/4.26.1?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/openai/4.25.0/4.26.1?slim=true)](https://docs.renovatebot.com/merge-confidence/) | | [prettier](https://prettier.io) ([source](https://togithub.com/prettier/prettier)) | [`3.2.4` -> `3.2.5`](https://renovatebot.com/diffs/npm/prettier/3.2.4/3.2.5) | [![age](https://developer.mend.io/api/mc/badges/age/npm/prettier/3.2.5?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/prettier/3.2.5?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/prettier/3.2.4/3.2.5?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/prettier/3.2.4/3.2.5?slim=true)](https://docs.renovatebot.com/merge-confidence/) | | [ts-jest](https://kulshekhar.github.io/ts-jest) ([source](https://togithub.com/kulshekhar/ts-jest)) | [`29.1.1` -> `29.1.2`](https://renovatebot.com/diffs/npm/ts-jest/29.1.1/29.1.2) | [![age](https://developer.mend.io/api/mc/badges/age/npm/ts-jest/29.1.2?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/npm/ts-jest/29.1.2?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/npm/ts-jest/29.1.1/29.1.2?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/npm/ts-jest/29.1.1/29.1.2?slim=true)](https://docs.renovatebot.com/merge-confidence/) | --- ### Release Notes <details> <summary>typescript-eslint/typescript-eslint (@typescript-eslint/eslint-plugin)</summary> ### [`v6.20.0`](https://togithub.com/typescript-eslint/typescript-eslint/blob/HEAD/packages/eslint-plugin/CHANGELOG.md#6200-2024-01-29) [Compare Source](https://togithub.com/typescript-eslint/typescript-eslint/compare/v6.19.1...v6.20.0) ##### 🚀 Features - **eslint-plugin:** \[member-ordering] allow easy reuse of the default ordering ##### 🩹 Fixes - **eslint-plugin:** \[no-useless-template-literals] incorrect bigint autofix result - **eslint-plugin:** \[prefer-nullish-coalescing] treat any/unknown as non-nullable - **eslint-plugin:** \[no-useless-template-literals] report Infinity & NaN - **eslint-plugin:** \[prefer-readonly] disable checking accessors ##### ❤️ Thank You - Alex Parloti - auvred - James Browning - StyleShit - YeonJuan You can read about our [versioning strategy](https://main--typescript-eslint.netlify.app/users/versioning) and [releases](https://main--typescript-eslint.netlify.app/users/releases) on our website. ### [`v6.19.1`](https://togithub.com/typescript-eslint/typescript-eslint/blob/HEAD/packages/eslint-plugin/CHANGELOG.md#6191-2024-01-22) [Compare Source](https://togithub.com/typescript-eslint/typescript-eslint/compare/v6.19.0...v6.19.1) ##### 🩹 Fixes - **type-utils:** preventing isUnsafeAssignment infinite recursive calls - **eslint-plugin:** \[no-unnecessary-condition] fix false positive for type variable ##### ❤️ Thank You - YeonJuan You can read about our [versioning strategy](https://main--typescript-eslint.netlify.app/users/versioning) and [releases](https://main--typescript-eslint.netlify.app/users/releases) on our website. </details> <details> <summary>typescript-eslint/typescript-eslint (@typescript-eslint/parser)</summary> ### [`v6.20.0`](https://togithub.com/typescript-eslint/typescript-eslint/blob/HEAD/packages/parser/CHANGELOG.md#6200-2024-01-29) [Compare Source](https://togithub.com/typescript-eslint/typescript-eslint/compare/v6.19.1...v6.20.0) This was a version bump only for parser to align it with other projects, there were no code changes. You can read about our [versioning strategy](https://main--typescript-eslint.netlify.app/users/versioning) and [releases](https://main--typescript-eslint.netlify.app/users/releases) on our website. ### [`v6.19.1`](https://togithub.com/typescript-eslint/typescript-eslint/blob/HEAD/packages/parser/CHANGELOG.md#6191-2024-01-22) [Compare Source](https://togithub.com/typescript-eslint/typescript-eslint/compare/v6.19.0...v6.19.1) This was a version bump only for parser to align it with other projects, there were no code changes. You can read about our [versioning strategy](https://main--typescript-eslint.netlify.app/users/versioning) and [releases](https://main--typescript-eslint.netlify.app/users/releases) on our website. </details> <details> <summary>langchain-ai/langchainjs (langchain)</summary> ### [`v0.1.13`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.13) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.12...0.1.13) #### What's Changed - langchain\[patch]: Release 0.1.12 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4247](https://togithub.com/langchain-ai/langchainjs/pull/4247) - community\[patch]: Release 0.0.26 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4248](https://togithub.com/langchain-ai/langchainjs/pull/4248) - weaviate\[major],langchain\[patch],community\[patch]: Adds weaviate vector store integration package by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4077](https://togithub.com/langchain-ai/langchainjs/pull/4077) - weaviate\[patch]: Add build auto-gen missing components by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4250](https://togithub.com/langchain-ai/langchainjs/pull/4250) - weaviate\[patch]: Release 0.0.1 by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4251](https://togithub.com/langchain-ai/langchainjs/pull/4251) - all\[patch]: Add homepage to package.json for proper readmes by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4252](https://togithub.com/langchain-ai/langchainjs/pull/4252) - mistralai\[patch]: Release 0.0.7 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4259](https://togithub.com/langchain-ai/langchainjs/pull/4259) - anthropic\[patch]: Release 0.0.10 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4260](https://togithub.com/langchain-ai/langchainjs/pull/4260) - cloudflare\[patch]: Release 0.0.2 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4261](https://togithub.com/langchain-ai/langchainjs/pull/4261) - cohere\[patch]: Release 0.0.4 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4262](https://togithub.com/langchain-ai/langchainjs/pull/4262) - exa\[patch]: Release 0.0.3 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4263](https://togithub.com/langchain-ai/langchainjs/pull/4263) - google-genai\[patch]: Release 0.0.9 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4264](https://togithub.com/langchain-ai/langchainjs/pull/4264) - pinecone\[patch]: Release 0.0.2 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4265](https://togithub.com/langchain-ai/langchainjs/pull/4265) - azure-openai\[major]: Integration of Azure OpenAI SDK with Langchain by [@sarangan12](https://togithub.com/sarangan12) in [https://github.com/langchain-ai/langchainjs/pull/3919](https://togithub.com/langchain-ai/langchainjs/pull/3919) - azure-openai\[patch]: Update build artifacts by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4266](https://togithub.com/langchain-ai/langchainjs/pull/4266) - core\[patch]: Pass runnable config directly to RunnableLambda by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4267](https://togithub.com/langchain-ai/langchainjs/pull/4267) - core\[patch]: Release 0.1.22 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4270](https://togithub.com/langchain-ai/langchainjs/pull/4270) - examples\[patch],langchain\[patch],community\[patch]: Remove dup fake testing models by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4271](https://togithub.com/langchain-ai/langchainjs/pull/4271) - all\[patch]: Relax Weaviate dependency, add deserialization namespace for messages, fix import map gen by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4274](https://togithub.com/langchain-ai/langchainjs/pull/4274) - create-langchain-integration\[patch]: Release 0.0.9 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4275](https://togithub.com/langchain-ai/langchainjs/pull/4275) - pinecone\[patch]: Add additional namespace customizing by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4254](https://togithub.com/langchain-ai/langchainjs/pull/4254) - pinecone\[patch]: Release 0.0.3 by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4284](https://togithub.com/langchain-ai/langchainjs/pull/4284) - core\[minor]: Add XML output parser by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4258](https://togithub.com/langchain-ai/langchainjs/pull/4258) - core\[patch]: Release 0.1.23 by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4285](https://togithub.com/langchain-ai/langchainjs/pull/4285) - langchain\[patch]: Remove unnecessary peer dep by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4286](https://togithub.com/langchain-ai/langchainjs/pull/4286) #### New Contributors - [@sarangan12](https://togithub.com/sarangan12) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/3919](https://togithub.com/langchain-ai/langchainjs/pull/3919) **Full Changelog**: https://github.com/langchain-ai/langchainjs/compare/0.1.12...0.1.13 ### [`v0.1.12`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.12) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.11...0.1.12) #### What's Changed - langchain\[patch]: Release 0.1.11 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4218](https://togithub.com/langchain-ai/langchainjs/pull/4218) - community\[patch]: Relax peer deps for community for deprecated entrypoints, skip flaky integration tests by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4222](https://togithub.com/langchain-ai/langchainjs/pull/4222) - community\[patch]: Release 0.0.24 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4223](https://togithub.com/langchain-ai/langchainjs/pull/4223) - create-langchain-integration\[patch]: Release 0.0.7 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4227](https://togithub.com/langchain-ai/langchainjs/pull/4227) - community\[minor]: Add support for TogetherAI chat json/tool calling by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4225](https://togithub.com/langchain-ai/langchainjs/pull/4225) - community\[patch]Release 0.0.25 by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4235](https://togithub.com/langchain-ai/langchainjs/pull/4235) - exa\[patch]docs\[patch]: Bump Exa & improve examples by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4226](https://togithub.com/langchain-ai/langchainjs/pull/4226) - exa\[patch] Release 0.0.2 by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4240](https://togithub.com/langchain-ai/langchainjs/pull/4240) - core\[patch]: Emit stream log chunks without awaiting for the first stream chunk by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4241](https://togithub.com/langchain-ai/langchainjs/pull/4241) - Fix missing import_type.js, remove dynamic imports by [@dqbd](https://togithub.com/dqbd) in [https://github.com/langchain-ai/langchainjs/pull/4236](https://togithub.com/langchain-ai/langchainjs/pull/4236) - Emit and add .d.cts definition files to package.json exports by [@dqbd](https://togithub.com/dqbd) in [https://github.com/langchain-ai/langchainjs/pull/4238](https://togithub.com/langchain-ai/langchainjs/pull/4238) - all\[patch]: Bump scripts package versions by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4243](https://togithub.com/langchain-ai/langchainjs/pull/4243) - community\[patch]: support all opensearch term level query type in filter [#4121](https://togithub.com/langchain-ai/langchainjs/issues/4121) by [@fuleinist](https://togithub.com/fuleinist) in [https://github.com/langchain-ai/langchainjs/pull/4157](https://togithub.com/langchain-ai/langchainjs/pull/4157) - langchain\[patch]: adding start arg to confluence loader by [@fuleinist](https://togithub.com/fuleinist) in [https://github.com/langchain-ai/langchainjs/pull/4191](https://togithub.com/langchain-ai/langchainjs/pull/4191) - core\[patch]: Add cancel method for cleanup on iterable readable streams by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4244](https://togithub.com/langchain-ai/langchainjs/pull/4244) - core\[minor],docs\[minor]: Update multi modal prompt template support by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/3682](https://togithub.com/langchain-ai/langchainjs/pull/3682) - core\[patch]: Release 0.1.21 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4245](https://togithub.com/langchain-ai/langchainjs/pull/4245) - openai\[patch]: Release 0.0.14 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4246](https://togithub.com/langchain-ai/langchainjs/pull/4246) **Full Changelog**: https://github.com/langchain-ai/langchainjs/compare/0.1.11...0.1.12 ### [`v0.1.11`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.11) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.10...0.1.11) #### What's Changed - langchain\[patch]: Release 0.1.10 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4205](https://togithub.com/langchain-ai/langchainjs/pull/4205) - Update pgvector docker image by [@mkesper](https://togithub.com/mkesper) in [https://github.com/langchain-ai/langchainjs/pull/4207](https://togithub.com/langchain-ai/langchainjs/pull/4207) - core\[minor]: Refactor the MessageContent type. by [@afirstenberg](https://togithub.com/afirstenberg) in [https://github.com/langchain-ai/langchainjs/pull/3797](https://togithub.com/langchain-ai/langchainjs/pull/3797) - create-langchain-integration\[minor]: Update copied files by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4209](https://togithub.com/langchain-ai/langchainjs/pull/4209) - Initial work implementing Gemini LLM and chat models for both Google AI Studio and Vertex AI by [@afirstenberg](https://togithub.com/afirstenberg) in [https://github.com/langchain-ai/langchainjs/pull/3960](https://togithub.com/langchain-ai/langchainjs/pull/3960) - core\[patch]: Release 0.1.20 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4213](https://togithub.com/langchain-ai/langchainjs/pull/4213) - langchain\[patch]: Add an environment variable for suppressing deprecation warnings by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4212](https://togithub.com/langchain-ai/langchainjs/pull/4212) - docs\[patch]: Fix typo by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4214](https://togithub.com/langchain-ai/langchainjs/pull/4214) - langchain\[patch]: add expand param to ConfluencePagesLoaderParams by [@fuleinist](https://togithub.com/fuleinist) in [https://github.com/langchain-ai/langchainjs/pull/4206](https://togithub.com/langchain-ai/langchainjs/pull/4206) - langchain\[patch]: Loosen output typing by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4216](https://togithub.com/langchain-ai/langchainjs/pull/4216) - community\[minor]: Addded ChatTogetherAI integration by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4215](https://togithub.com/langchain-ai/langchainjs/pull/4215) - community\[patch]: Release 0.0.23 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4217](https://togithub.com/langchain-ai/langchainjs/pull/4217) #### New Contributors - [@mkesper](https://togithub.com/mkesper) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4207](https://togithub.com/langchain-ai/langchainjs/pull/4207) - [@fuleinist](https://togithub.com/fuleinist) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4206](https://togithub.com/langchain-ai/langchainjs/pull/4206) **Full Changelog**: https://github.com/langchain-ai/langchainjs/compare/0.1.10...0.1.11 ### [`v0.1.10`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.10) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.9...0.1.10) #### What's Changed - langchain\[patch]: Release 0.1.9 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4182](https://togithub.com/langchain-ai/langchainjs/pull/4182) - Fix Deprecated Import from docs/agents/quick_start.mdx by [@leonvanzyl](https://togithub.com/leonvanzyl) in [https://github.com/langchain-ai/langchainjs/pull/4192](https://togithub.com/langchain-ai/langchainjs/pull/4192) - langchain\[patch]: Spread document metadata into document prompt by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4198](https://togithub.com/langchain-ai/langchainjs/pull/4198) - langchain\[patch]: Update structured_output to allow parsing using zod by [@ashburnham](https://togithub.com/ashburnham) in [https://github.com/langchain-ai/langchainjs/pull/4162](https://togithub.com/langchain-ai/langchainjs/pull/4162) - cohere\[patch]: Fix use of CohereChat with RunnableWithMessageHistory by [@imjwang](https://togithub.com/imjwang) in [https://github.com/langchain-ai/langchainjs/pull/4188](https://togithub.com/langchain-ai/langchainjs/pull/4188) - cohere\[patch]: Release 0.0.3 by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4199](https://togithub.com/langchain-ai/langchainjs/pull/4199) - community\[patch]: adding cassandra utils by [@mieslep](https://togithub.com/mieslep) in [https://github.com/langchain-ai/langchainjs/pull/4193](https://togithub.com/langchain-ai/langchainjs/pull/4193) - community\[patch]: Release 0.0.22 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4202](https://togithub.com/langchain-ai/langchainjs/pull/4202) - docs\[minor],langchain\[minor]: SQL use cases by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4120](https://togithub.com/langchain-ai/langchainjs/pull/4120) - docs\[minor]: Add chatbot use case by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4201](https://togithub.com/langchain-ai/langchainjs/pull/4201) - core\[patch]: Release 0.1.19 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4204](https://togithub.com/langchain-ai/langchainjs/pull/4204) #### New Contributors - [@leonvanzyl](https://togithub.com/leonvanzyl) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4192](https://togithub.com/langchain-ai/langchainjs/pull/4192) - [@imjwang](https://togithub.com/imjwang) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4188](https://togithub.com/langchain-ai/langchainjs/pull/4188) **Full Changelog**: https://github.com/langchain-ai/langchainjs/compare/0.1.9...0.1.10 ### [`v0.1.9`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.9) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.8...0.1.9) #### What's Changed - community\[patch]: Release 0.0.21 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4179](https://togithub.com/langchain-ai/langchainjs/pull/4179) - langchain\[patch]: Trace in Evaluators Project by [@hinthornw](https://togithub.com/hinthornw) in [https://github.com/langchain-ai/langchainjs/pull/4180](https://togithub.com/langchain-ai/langchainjs/pull/4180) **Full Changelog**: https://github.com/langchain-ai/langchainjs/compare/0.1.8...0.1.9 ### [`v0.1.8`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.8) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.7...0.1.8) #### What's Changed - docs\[patch]: Fix typo by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4150](https://togithub.com/langchain-ai/langchainjs/pull/4150) - core\[minor]: Add streaming for runnable branch by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4159](https://togithub.com/langchain-ai/langchainjs/pull/4159) - core\[patch]: Release 0.1.18 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4160](https://togithub.com/langchain-ai/langchainjs/pull/4160) - docs\[patch]: Remove pinecone node-only warnings by [@erakor](https://togithub.com/erakor) in [https://github.com/langchain-ai/langchainjs/pull/4166](https://togithub.com/langchain-ai/langchainjs/pull/4166) - openai\[patch]: Adds support for dimensions param for OpenAI v3 embeddings by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4169](https://togithub.com/langchain-ai/langchainjs/pull/4169) - openai\[patch]: Release 0.0.13 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4170](https://togithub.com/langchain-ai/langchainjs/pull/4170) - google-genai\[patch]: fixing chat converstaion in the chat model by [@anton-volodko](https://togithub.com/anton-volodko) in [https://github.com/langchain-ai/langchainjs/pull/4144](https://togithub.com/langchain-ai/langchainjs/pull/4144) - ci\[patch]: comment out codecov by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4172](https://togithub.com/langchain-ai/langchainjs/pull/4172) - google-genai\[patch]: Bump SDK version, bugfix by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4171](https://togithub.com/langchain-ai/langchainjs/pull/4171) - google-genai\[patch]: Release 0.0.8 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4173](https://togithub.com/langchain-ai/langchainjs/pull/4173) - all\[minor]: Replace all LC package scripts with `@langchain/scripts` by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4092](https://togithub.com/langchain-ai/langchainjs/pull/4092) - dont build deps by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4175](https://togithub.com/langchain-ai/langchainjs/pull/4175) - docs\[patch]: Add LangGraph docs page by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4174](https://togithub.com/langchain-ai/langchainjs/pull/4174) - community\[minor]: Cassandra: add MMR; split native and Astra connections by [@mieslep](https://togithub.com/mieslep) in [https://github.com/langchain-ai/langchainjs/pull/3910](https://togithub.com/langchain-ai/langchainjs/pull/3910) - community\[minor]: Fix CloseVector similarity score (1.0 - distance) by [@jordi-murgo](https://togithub.com/jordi-murgo) in [https://github.com/langchain-ai/langchainjs/pull/4125](https://togithub.com/langchain-ai/langchainjs/pull/4125) - community\[minor]: Add support for Azure AI Search vector store by [@sinedied](https://togithub.com/sinedied) in [https://github.com/langchain-ai/langchainjs/pull/4044](https://togithub.com/langchain-ai/langchainjs/pull/4044) - langchain\[patch]: Adds chain tool entrypoint by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4177](https://togithub.com/langchain-ai/langchainjs/pull/4177) - langchain\[patch]: Add eval source links by [@hinthornw](https://togithub.com/hinthornw) in [https://github.com/langchain-ai/langchainjs/pull/4176](https://togithub.com/langchain-ai/langchainjs/pull/4176) - langchain\[patch]: Release 0.1.8 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4178](https://togithub.com/langchain-ai/langchainjs/pull/4178) #### New Contributors - [@erakor](https://togithub.com/erakor) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4166](https://togithub.com/langchain-ai/langchainjs/pull/4166) - [@anton-volodko](https://togithub.com/anton-volodko) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4144](https://togithub.com/langchain-ai/langchainjs/pull/4144) **Full Changelog**: https://github.com/langchain-ai/langchainjs/compare/0.1.7...0.1.8 ### [`v0.1.7`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.7) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.6...0.1.7) #### What's Changed - langchain\[patch]: Release 0.1.6 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4141](https://togithub.com/langchain-ai/langchainjs/pull/4141) - langchain\[patch]: Update evaluation docstrings and example by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4146](https://togithub.com/langchain-ai/langchainjs/pull/4146) - community\[minor]: fix Astra db peerDependency by [@mfortman11](https://togithub.com/mfortman11) in [https://github.com/langchain-ai/langchainjs/pull/4147](https://togithub.com/langchain-ai/langchainjs/pull/4147) - exa\[major] Add exa search integration package by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4148](https://togithub.com/langchain-ai/langchainjs/pull/4148) - exa\[patch] Release 0.0.1 by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4149](https://togithub.com/langchain-ai/langchainjs/pull/4149) - Indexing API Port by [@MJDeligan](https://togithub.com/MJDeligan) in [https://github.com/langchain-ai/langchainjs/pull/4064](https://togithub.com/langchain-ai/langchainjs/pull/4064) - langchain\[patch]: Extend function input by [@hinthornw](https://togithub.com/hinthornw) in [https://github.com/langchain-ai/langchainjs/pull/4145](https://togithub.com/langchain-ai/langchainjs/pull/4145) - langchain\[minor]: Add inputKey in conversational retrieval agent by [@jordi-murgo](https://togithub.com/jordi-murgo) in [https://github.com/langchain-ai/langchainjs/pull/4127](https://togithub.com/langchain-ai/langchainjs/pull/4127) - langchain\[patch]: Release 0.1.7 by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4151](https://togithub.com/langchain-ai/langchainjs/pull/4151) #### New Contributors - [@jordi-murgo](https://togithub.com/jordi-murgo) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4127](https://togithub.com/langchain-ai/langchainjs/pull/4127) **Full Changelog**: https://github.com/langchain-ai/langchainjs/compare/0.1.6...0.1.7 ### [`v0.1.6`](https://togithub.com/langchain-ai/langchainjs/releases/tag/0.1.6) [Compare Source](https://togithub.com/langchain-ai/langchainjs/compare/0.1.5...0.1.6) #### What's Changed - In Why use LCEL Page, navigation is not working in docs properly by [@Athesh007](https://togithub.com/Athesh007) in [https://github.com/langchain-ai/langchainjs/pull/4116](https://togithub.com/langchain-ai/langchainjs/pull/4116) - PyInterpreter Import Notes by [@hinthornw](https://togithub.com/hinthornw) in [https://github.com/langchain-ai/langchainjs/pull/4100](https://togithub.com/langchain-ai/langchainjs/pull/4100) - community\[minor]: Add indexes module by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4081](https://togithub.com/langchain-ai/langchainjs/pull/4081) - infra\[minor]: Add codecov to CI & run all unit tests in CI by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4126](https://togithub.com/langchain-ai/langchainjs/pull/4126) - docs\[minor]: Adds deployment guide by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4128](https://togithub.com/langchain-ai/langchainjs/pull/4128) - scritps\[minor]: use config file for scripts package by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4133](https://togithub.com/langchain-ai/langchainjs/pull/4133) - scripts\[patch]: Release 0.0.2 by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4135](https://togithub.com/langchain-ai/langchainjs/pull/4135) - all\[patch]: Drop unused release-branch.sh script by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4134](https://togithub.com/langchain-ai/langchainjs/pull/4134) - Updated "Add message history" documentation page for missing module import by [@pranav-kural](https://togithub.com/pranav-kural) in [https://github.com/langchain-ai/langchainjs/pull/4136](https://togithub.com/langchain-ai/langchainjs/pull/4136) - community\[patch]: Allow for firestore message history with dynamic collections & docs by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4122](https://togithub.com/langchain-ai/langchainjs/pull/4122) - Add Amazon Knowledge Bases retriever support by [@jl4nz](https://togithub.com/jl4nz) in [https://github.com/langchain-ai/langchainjs/pull/4035](https://togithub.com/langchain-ai/langchainjs/pull/4035) - Add Memgraph support by [@katarinasupe](https://togithub.com/katarinasupe) in [https://github.com/langchain-ai/langchainjs/pull/4008](https://togithub.com/langchain-ai/langchainjs/pull/4008) - community\[patch]: Release 0.0.20 by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchainjs/pull/4137](https://togithub.com/langchain-ai/langchainjs/pull/4137) - langchain\[patch]: Relax legacy Pinecone dep by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4139](https://togithub.com/langchain-ai/langchainjs/pull/4139) - LangSmith Test Runner by [@hinthornw](https://togithub.com/hinthornw) in [https://github.com/langchain-ai/langchainjs/pull/4011](https://togithub.com/langchain-ai/langchainjs/pull/4011) - langchain\[patch]: Remove some formatting in eval progress bar display by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchainjs/pull/4140](https://togithub.com/langchain-ai/langchainjs/pull/4140) #### New Contributors - [@Athesh007](https://togithub.com/Athesh007) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4116](https://togithub.com/langchain-ai/langchainjs/pull/4116) - [@pranav-kural](https://togithub.com/pranav-kural) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4136](https://togithub.com/langchain-ai/langchainjs/pull/4136) - [@katarinasupe](https://togithub.com/katarinasupe) made their first contribution in [https://github.com/langchain-ai/langchainjs/pull/4008](https://togithub.com/langchain-ai/langchainjs/pull/4008) **Full Changelog**: https://github.com/langchain-ai/langchainjs/compare/0.1.5...0.1.6 </details> <details> <summary>okonet/lint-staged (lint-staged)</summary> ### [`v15.2.2`](https://togithub.com/okonet/lint-staged/blob/HEAD/CHANGELOG.md#1522) [Compare Source](https://togithub.com/okonet/lint-staged/compare/v15.2.1...v15.2.2) ##### Patch Changes - [#1391](https://togithub.com/lint-staged/lint-staged/pull/1391) [`fdcdad4`](https://togithub.com/lint-staged/lint-staged/commit/fdcdad42ff96fea3c05598e378d3c44ad4a51bde) Thanks [@iiroj](https://togithub.com/iiroj)! - *Lint-staged* no longer tries to load configuration from files that are not checked out. This might happen when using sparse-checkout. ### [`v15.2.1`](https://togithub.com/okonet/lint-staged/blob/HEAD/CHANGELOG.md#1521) [Compare Source](https://togithub.com/okonet/lint-staged/compare/v15.2.0...v15.2.1) ##### Patch Changes - [#1387](https://togithub.com/lint-staged/lint-staged/pull/1387) [`e4023f6`](https://togithub.com/lint-staged/lint-staged/commit/e4023f687616dcf4816545b8eefbcce50e255c9c) Thanks [@iiroj](https://togithub.com/iiroj)! - Ignore stdin of spawned commands so that they don't get stuck waiting. Until now, *lint-staged* has used the default settings to spawn linter commands. This means the `stdin` of the spawned commands has accepted input, and essentially gotten stuck waiting. Now the `stdin` is ignored and commands will no longer get stuck. If you relied on this behavior, please open a new issue and describe how; the behavior has not been intended. </details> <details> <summary>openai/openai-node (openai)</summary> ### [`v4.26.1`](https://togithub.com/openai/openai-node/blob/HEAD/CHANGELOG.md#4261-2024-02-05) [Compare Source](https://togithub.com/openai/openai-node/compare/v4.26.0...v4.26.1) Full Changelog: [v4.26.0...v4.26.1](https://togithub.com/openai/openai-node/compare/v4.26.0...v4.26.1) ##### Chores - **internal:** enable building when git installed ([#657](https://togithub.com/openai/openai-node/issues/657)) ([8c80a7d](https://togithub.com/openai/openai-node/commit/8c80a7d6d36155901a19d1f9cd1fec17b89e261e)) - **internal:** re-order pagination import ([#656](https://togithub.com/openai/openai-node/issues/656)) ([21ae54e](https://togithub.com/openai/openai-node/commit/21ae54ea2cc2779e440909782a6ac8b70f88ec1f)) - **internal:** support pre-release versioning ([#653](https://togithub.com/openai/openai-node/issues/653)) ([0c3859f](https://togithub.com/openai/openai-node/commit/0c3859f88164ae3eb6ec8c29e8889a50861cb35b)) - **test:** add delay between ecosystem tests retry ([#651](https://togithub.com/openai/openai-node/issues/651)) ([6a4cc5c](https://togithub.com/openai/openai-node/commit/6a4cc5cea36ae408c8c1eb2ea0ea02f96ffb77b7)) ##### Documentation - add a CONTRIBUTING.md ([#659](https://togithub.com/openai/openai-node/issues/659)) ([8ea58b0](https://togithub.com/openai/openai-node/commit/8ea58b0b9e7382a3b3af852a9a3a288a485ad33a)) ### [`v4.26.0`](https://togithub.com/openai/openai-node/blob/HEAD/CHANGELOG.md#4260-2024-01-25) [Compare Source](https://togithub.com/openai/openai-node/compare/v4.25.0...v4.26.0) Full Changelog: [v4.25.0...v4.26.0](https://togithub.com/openai/openai-node/compare/v4.25.0...v4.26.0) ##### Features - **api:** add text embeddings dimensions param ([#650](https://togithub.com/openai/openai-node/issues/650)) ([1b5a977](https://togithub.com/openai/openai-node/commit/1b5a977d0eef7f5cf97daf27333cbbeb6bb479f3)) ##### Chores - **internal:** add internal helpers & improve build scripts ([#643](https://togithub.com/openai/openai-node/issues/643)) ([9392f50](https://togithub.com/openai/openai-node/commit/9392f50e47f26b16632c9eb12187ea7f8a565e09)) - **internal:** adjust ecosystem-tests logging in CI ([#646](https://togithub.com/openai/openai-node/issues/646)) ([156084b](https://togithub.com/openai/openai-node/commit/156084b8734194a5856612378115b948c82ec6e4)) - **internal:** don't re-export streaming type ([#648](https://togithub.com/openai/openai-node/issues/648)) ([4c4be94](https://togithub.com/openai/openai-node/commit/4c4be945fa3f54036183e2d0877060db47ea564b)) - **internal:** fix binary files ([#645](https://togithub.com/openai/openai-node/issues/645)) ([e1fbc39](https://togithub.com/openai/openai-node/commit/e1fbc396f4d1dd8ba980c25ba03b670dfed887a0)) - **internal:** minor streaming updates ([#647](https://togithub.com/openai/openai-node/issues/647)) ([2f073e4](https://togithub.com/openai/openai-node/commit/2f073e4e6c9cd0ff3ad434907da710704765a005)) - **internal:** pin deno version ([#649](https://togithub.com/openai/openai-node/issues/649)) ([7e4b903](https://togithub.com/openai/openai-node/commit/7e4b9039320e4ccbafb45f57dce273bedc9b7cb3)) </details> <details> <summary>prettier/prettier (prettier)</summary> ### [`v3.2.5`](https://togithub.com/prettier/prettier/blob/HEAD/CHANGELOG.md#325) [Compare Source](https://togithub.com/prettier/prettier/compare/3.2.4...3.2.5) [diff](https://togithub.com/prettier/prettier/compare/3.2.4...3.2.5) ##### Support Angular inline styles as single template literal ([#15968](https://togithub.com/prettier/prettier/pull/15968) by [@sosukesuzuki](https://togithub.com/sosukesuzuki)) [Angular v17](https://blog.angular.io/introducing-angular-v17-4d7033312e4b) supports single string inline styles.  ```ts // Input @Component({ template: `<div>...</div>`, styles: `h1 { color: blue; }`, }) export class AppComponent {} // Prettier 3.2.4 @Component({ template: `<div>...</div>`, styles: `h1 { color: blue; }`, }) export class AppComponent {} // Prettier 3.2.5 @Component({ template: `<div>...</div>`, styles: ` h1 { color: blue; } `, }) export class AppComponent {} ``` ##### Unexpected embedded formatting for Angular template ([#15969](https://togithub.com/prettier/prettier/pull/15969) by [@JounQin](https://togithub.com/JounQin)) Computed template should not be considered as Angular component template  ```ts // Input const template = "foobar"; @Component({ [template]: `<h1>{{ hello }}</h1>`, }) export class AppComponent {} // Prettier 3.2.4 const template = "foobar"; @Component({ [template]: `<h1>{{ hello }}</h1>`, }) export class AppComponent {} // Prettier 3.2.5 const template = "foobar"; @Component({ [template]: `<h1>{{ hello }}</h1>`, }) export class AppComponent {} ``` ##### Use `"json"` parser for `tsconfig.json` by default ([#16012](https://togithub.com/prettier/prettier/pull/16012) by [@sosukesuzuki](https://togithub.com/sosukesuzuki)) In [v2.3.0](https://prettier.io/blog/2024/01/12/3.2.0#new-jsonc-parser-added-15831httpsgithubcomprettierprettierpull15831-by-fiskerhttpsgithubcomfisker), we introduced `"jsonc"` parser which adds trialing comma **by default**. When adding a new parser we also define how it will be used based on the [`linguist-languages`](https://www.npmjs.com/package/linguist-languages) data. `tsconfig.json` is a special file used by [TypeScript](https://www.typescriptlang.org/docs/handbook/tsconfig-json.html#using-tsconfigjson-or-jsconfigjson), it uses `.json` file extension, but it actually uses the [JSON with Comments](https://code.visualstudio.com/docs/languages/json#\_json-with-comments) syntax. However, we found that there are many third-party tools not recognize it correctly because of the confusing `.json` file extension. We decide to treat it as a JSON file for now to avoid the extra configuration step. To keep using the `"jsonc"` parser for your `tsconfig.json` files, add the following to your `.pretterrc` file ```json { "overrides": [ { "files": ["tsconfig.json", "jsconfig.json"], "options": { "parser": "jsonc" } } ] } ```  ``` ``` </details> <details> <summary>kulshekhar/ts-jest (ts-jest)</summary> ### [`v29.1.2`](https://togithub.com/kulshekhar/ts-jest/blob/HEAD/CHANGELOG.md#2912-2024-01-22) [Compare Source](https://togithub.com/kulshekhar/ts-jest/compare/v29.1.1...v29.1.2) ##### Bug Fixes - calculated cache key based on `supportsStaticESM` ([a5d6f2d](https://togithub.com/kulshekhar/ts-jest/commit/a5d6f2d4f4bfa1c7c217f6faf9310958797b436f)) - correct error handling in `processAsync` ([e7be4bf](https://togithub.com/kulshekhar/ts-jest/commit/e7be4bf6a863cd76efec28f40fdd5193b2f50bad)), closes [#4207](https://togithub.com/kulshekhar/ts-jest/issues/4207) - use `Config.ProjectConfig` ([918312b](https://togithub.com/kulshekhar/ts-jest/commit/918312bee22a795ec6bb347f95df4c1ff0a054de)), closes [#4028](https://togithub.com/kulshekhar/ts-jest/issues/4028) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "before 4am on Monday" in timezone America/Chicago, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://togithub.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://developer.mend.io/github/autoblocksai/javascript-sdk).  Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>

hinthornw added 4 commits January 12, 2024 17:49

Add run_on_dataset

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.

GPG key ID: B5690EEEBB952194

Verified
Learn about vigilant mode

92610bd

Add stacktrace to tracer errors

7663162

Merge branch 'wfh/add_stacktrace' into wfh/run_on_dataset

aac2301

Add test runner

7841d92

dosubot bot added the size:XXL label Jan 13, 2024

dosubot bot added the auto:enhancement label Jan 13, 2024

dosubot bot reviewed Jan 13, 2024

View reviewed changes

bump

dee5918

vercel bot had a problem deploying to Preview – langchainjs-api-refs January 13, 2024 05:06 Failure

vercel bot had a problem deploying to Preview – langchainjs-docs January 13, 2024 05:07 Failure

Fixup

d495783

vercel bot had a problem deploying to Preview – langchainjs-api-refs January 13, 2024 09:18 Failure

vercel bot had a problem deploying to Preview – langchainjs-docs January 13, 2024 09:18 Failure

vercel bot deployed to Preview – langchainjs-docs January 14, 2024 07:25 View deployment

vercel bot deployed to Preview – langchainjs-api-refs January 14, 2024 07:26 View deployment

hinthornw force-pushed the wfh/run_on_dataset branch from 9c33ca4 to 96aab04 Compare January 14, 2024 07:51

vercel bot deployed to Preview – langchainjs-docs January 14, 2024 08:01 View deployment

vercel bot deployed to Preview – langchainjs-api-refs January 14, 2024 08:01 View deployment

hinthornw force-pushed the wfh/run_on_dataset branch from 96aab04 to 1061e6b Compare January 14, 2024 08:02

vercel bot deployed to Preview – langchainjs-api-refs January 14, 2024 08:12 View deployment

vercel bot deployed to Preview – langchainjs-docs January 14, 2024 08:12 View deployment

Add example walkthrough

e3f01d4

hinthornw force-pushed the wfh/run_on_dataset branch from 1061e6b to e3f01d4 Compare January 14, 2024 08:21

vercel bot deployed to Preview – langchainjs-api-refs January 14, 2024 08:30 View deployment

vercel bot deployed to Preview – langchainjs-docs January 14, 2024 08:31 View deployment

rename

ba36bc9

vercel bot deployed to Preview – langchainjs-api-refs January 14, 2024 08:44 View deployment

vercel bot deployed to Preview – langchainjs-docs January 14, 2024 08:45 View deployment

Add doc

c0b829d

vercel bot deployed to Preview – langchainjs-api-refs January 14, 2024 09:30 View deployment

vercel bot deployed to Preview – langchainjs-docs January 14, 2024 09:30 View deployment