Add remove_comments option (default True): do not extract html comments #13259

petervandenabeele · 2023-11-12T18:22:31Z

Description: add remove_comments option (default: ~~True~~ False): remove html comments,
Issue: None,
Dependencies: None,
Tag maintainer: @nfcampos ,
Twitter handle: peter_v

I ran make format, make lint and make test.

Discussion: I my use case, I prefer to not have the comments in the extracted text:

e.g. from a Google tag that is added in the html as comment
e.g. content that the authors have temporarily hidden to make it non visible to the regular reader

Removing the comments makes the extracted text more alike the intended text to be seen by the reader.

Choice to make: do we prefer to make the default for this remove_comments option to be True or False?
I have changed it to True in a second commit, since that is how I would prefer to use it by default. Have the
cleaned text (without technical Google tags etc.) and also closer to the actually visible and intended content.
I am not sure what is best aligned with the conventions of langchain in general ...

INITIAL VERSION (new version above):
Choice to make: do we prefer to make the default for this ignore_comments option to be True or False?
I have set it to False now to be backwards compatible. On the other hand, I would use it mostly with True.
I am not sure what is best aligned with the conventions of langchain in general ...

vercel · 2023-11-12T18:22:34Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
langchain	⬜️ Ignored (Inspect)	Visit Preview		Apr 2, 2024 0:17am

This makes the name "remove_comments" more similar to the existing "remove_lines" parameter. Making this the default (also similar to remove_lines), since we typically want "cleaned text" (and not the Google tag stuff and text that is hidden from view by the web side owner).

baskaryan · 2023-11-13T17:09:57Z

libs/langchain/langchain/document_transformers/beautiful_soup_transformer.py

@@ -134,12 +137,14 @@ async def atransform_documents(
        raise NotImplementedError


-def get_navigable_strings(element: Any) -> Iterator[str]:
-    from bs4 import NavigableString, Tag
+def get_navigable_strings(element: Any, remove_comments: bool) -> Iterator[str]:


nit: since this is technically a public method could we avoid breaking changes and give remove_comments a default value?

This is a public method we introduced only a few days ago, so probably fine to leave as is, but up to you

Thanks for the fast review. Good remark. For me this method get_navigable_strings should not really be public (it seems only intended to be used deep inside this code, not generally ?).

Could we make it more "private" (not really private in Python, but anyway), and bring inside the BeautifulSoupTransformer class? Maybe as a static method inside the class, like the other methods?

Then we could also do the import only once in the init, or re-use the import bs4 command that is already present there?

If you think that is better, I could try to adapt the code in that direction (to a class_method inside the class).

My more fundamental question on "breaking interface" is the question if the "remove_comments" should be default True , like in my current proposal (but I am open to the alternatives as well ...).

id minorly prefer to make it default to False (to your point about backwards compat) and also to add a default here (seems easy)

petervandenabeele · 2024-01-30T17:44:56Z

Thanks for Closing, it is not very important.

Sorry that I let this linger, all good now :-)

baskaryan · 2024-01-30T18:03:41Z

not intentional, we can't reopen at the moment but will do so as soon as we can :/ See #16796

petervandenabeele · 2024-04-02T07:30:56Z

Thank you very much @baskaryan for pulling this one through. I agree with all changes you made to improve the PR :-) Thanks :-D

@nfcampos

…xtract html comments (langchain-ai#13259) - **Description:** add `remove_comments` option (default: True): do not extract html _comments_, - **Issue:** None, - **Dependencies:** None, - **Tag maintainer:** @nfcampos , - **Twitter handle:** peter_v I ran `make format`, `make lint` and `make test`. Discussion: I my use case, I prefer to not have the comments in the extracted text: * e.g. from a Google tag that is added in the html as comment * e.g. content that the authors have temporarily hidden to make it non visible to the regular reader Removing the comments makes the extracted text more alike the intended text to be seen by the reader. **Choice to make:** do we prefer to make the default for this `remove_comments` option to be True or False? I have changed it to True in a second commit, since that is how I would prefer to use it by default. Have the cleaned text (without technical Google tags etc.) and also closer to the actually visible and intended content. I am not sure what is best aligned with the conventions of langchain in general ... INITIAL VERSION (new version above): ~**Choice to make:** do we prefer to make the default for this `ignore_comments` option to be True or False? I have set it to False now to be backwards compatible. On the other hand, I would use it mostly with True. I am not sure what is best aligned with the conventions of langchain in general ...~ --------- Co-authored-by: Bagatur <baskaryan@gmail.com>

[![Mend Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com) This PR contains the following updates: | Package | Change | Age | Adoption | Passing | Confidence | |---|---|---|---|---|---| | [langchain](https://togithub.com/langchain-ai/langchain) | `==0.1.12` -> `==0.1.16` | [![age](https://developer.mend.io/api/mc/badges/age/pypi/langchain/0.1.16?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/pypi/langchain/0.1.16?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/pypi/langchain/0.1.12/0.1.16?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/pypi/langchain/0.1.12/0.1.16?slim=true)](https://docs.renovatebot.com/merge-confidence/) | --- ### Release Notes <details> <summary>langchain-ai/langchain (langchain)</summary> ### [`v0.1.16`](https://togithub.com/langchain-ai/langchain/releases/tag/v0.1.16) [Compare Source](https://togithub.com/langchain-ai/langchain/compare/v0.1.15...v0.1.16) ##### What's Changed - openai\[patch]: Release 0.1.2 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20241](https://togithub.com/langchain-ai/langchain/pull/20241) - docs: fix external repo partner docs by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20238](https://togithub.com/langchain-ai/langchain/pull/20238) - groq\[patch]: Release 0.1.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20242](https://togithub.com/langchain-ai/langchain/pull/20242) - experimental\[patch]: Release 0.0.57 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20243](https://togithub.com/langchain-ai/langchain/pull/20243) - groq: xfail tool_choice tests by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20247](https://togithub.com/langchain-ai/langchain/pull/20247) - \[core]: add tool calls message by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/18947](https://togithub.com/langchain-ai/langchain/pull/18947) - core\[patch]: Pre-release 0.1.42-rc.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20248](https://togithub.com/langchain-ai/langchain/pull/20248) - openai\[patch]: pre-release 0.1.3-rc.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20249](https://togithub.com/langchain-ai/langchain/pull/20249) - anthropic\[patch]: Pre-release 0.1.8-rc.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20250](https://togithub.com/langchain-ai/langchain/pull/20250) - mistralai\[patch]: Pre-release 0.1.2-rc.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20251](https://togithub.com/langchain-ai/langchain/pull/20251) - infra, multiple: rc release versions by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20252](https://togithub.com/langchain-ai/langchain/pull/20252) - update agents to use tool call messages by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/20074](https://togithub.com/langchain-ai/langchain/pull/20074) - openai\[patch]: Fix langchain-openai unknown parameter error with gpt-4-turbo by [@os1ma](https://togithub.com/os1ma) in [https://github.com/langchain-ai/langchain/pull/20271](https://togithub.com/langchain-ai/langchain/pull/20271) - community: import flattening fix by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/20110](https://togithub.com/langchain-ai/langchain/pull/20110) - core: mustache prompt templates by [@nfcampos](https://togithub.com/nfcampos) in [https://github.com/langchain-ai/langchain/pull/19980](https://togithub.com/langchain-ai/langchain/pull/19980) - docs: update tool calling cookbook by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/20290](https://togithub.com/langchain-ai/langchain/pull/20290) - core\[patch]: fix duplicated kwargs in `_load_sql_databse_chain` by [@B-Step62](https://togithub.com/B-Step62) in [https://github.com/langchain-ai/langchain/pull/19908](https://togithub.com/langchain-ai/langchain/pull/19908) - partners: Add chroma partner package by [@killind-dev](https://togithub.com/killind-dev) in [https://github.com/langchain-ai/langchain/pull/19292](https://togithub.com/langchain-ai/langchain/pull/19292) - chroma: add optional fastapi dep to restrict to <1 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20295](https://togithub.com/langchain-ai/langchain/pull/20295) - chroma: add required fastapi dep to restrict to <1 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20297](https://togithub.com/langchain-ai/langchain/pull/20297) - chroma: bump rc, keep optional by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20298](https://togithub.com/langchain-ai/langchain/pull/20298) - core\[patch]: include tool_calls in ai msg chunk serialization by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20291](https://togithub.com/langchain-ai/langchain/pull/20291) - core\[patch]: fix ChatGeneration.text with content blocks by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20294](https://togithub.com/langchain-ai/langchain/pull/20294) - langchain\[patch]: agents check prompt partial vars by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20303](https://togithub.com/langchain-ai/langchain/pull/20303) - openai\[patch]: use tool_calls in request by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20272](https://togithub.com/langchain-ai/langchain/pull/20272) - docs: added backtick on RunnablePassthrough by [@spike-spiegel-21](https://togithub.com/spike-spiegel-21) in [https://github.com/langchain-ai/langchain/pull/20310](https://togithub.com/langchain-ai/langchain/pull/20310) - core\[patch]: For now remove user warning by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20321](https://togithub.com/langchain-ai/langchain/pull/20321) - community\[patch]: Add deprecation warnings to postgres implementation by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20222](https://togithub.com/langchain-ai/langchain/pull/20222) - mistral: add IDs to tool calls by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/20299](https://togithub.com/langchain-ai/langchain/pull/20299) - core\[patch]: Release 0.1.42 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20332](https://togithub.com/langchain-ai/langchain/pull/20332) - release anthropic, fireworks, openai, groq, mistral by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20333](https://togithub.com/langchain-ai/langchain/pull/20333) - docs: Update documentation for custom LLMs by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19972](https://togithub.com/langchain-ai/langchain/pull/19972) - Testing list of tool calling providers by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20330](https://togithub.com/langchain-ai/langchain/pull/20330) - langchain\[patch]: Release 0.1.16 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20335](https://togithub.com/langchain-ai/langchain/pull/20335) - docs: add component page for tool calls by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/20282](https://togithub.com/langchain-ai/langchain/pull/20282) - docs: add tool-calling agent by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20328](https://togithub.com/langchain-ai/langchain/pull/20328) - docs: update chat openai by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20331](https://togithub.com/langchain-ai/langchain/pull/20331) ##### New Contributors - [@killind-dev](https://togithub.com/killind-dev) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19292](https://togithub.com/langchain-ai/langchain/pull/19292) **Full Changelog**: https://github.com/langchain-ai/langchain/compare/v0.1.15...v0.1.16 ### [`v0.1.15`](https://togithub.com/langchain-ai/langchain/releases/tag/v0.1.15) [Compare Source](https://togithub.com/langchain-ai/langchain/compare/v0.1.14...v0.1.15) #### What's Changed - experimental\[patch]: Release 0.0.56 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19840](https://togithub.com/langchain-ai/langchain/pull/19840) - docs: remove unnecessary args from the pip install by [@cyai](https://togithub.com/cyai) in [https://github.com/langchain-ai/langchain/pull/19823](https://togithub.com/langchain-ai/langchain/pull/19823) - Update cross_encoder_reranker.ipynb by [@eltociear](https://togithub.com/eltociear) in [https://github.com/langchain-ai/langchain/pull/19846](https://togithub.com/langchain-ai/langchain/pull/19846) - core: generate mermaid syntax and render visual graph by [@angeligareta](https://togithub.com/angeligareta) in [https://github.com/langchain-ai/langchain/pull/19599](https://togithub.com/langchain-ai/langchain/pull/19599) - ai21\[patch]: release 0.1.3 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19867](https://togithub.com/langchain-ai/langchain/pull/19867) - 👥 Update LangChain people data by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/19858](https://togithub.com/langchain-ai/langchain/pull/19858) - community\[patch]: Revert " Fix the bug that Chroma does not specify \`e… by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19866](https://togithub.com/langchain-ai/langchain/pull/19866) - openai\[patch]: fix azure embedding length check by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19870](https://togithub.com/langchain-ai/langchain/pull/19870) - Partially Revert "openai\[patch]: Update openai chat model to new base class interface" by [@nfcampos](https://togithub.com/nfcampos) in [https://github.com/langchain-ai/langchain/pull/19871](https://togithub.com/langchain-ai/langchain/pull/19871) - ai21\[patch]: fix core dep by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19874](https://togithub.com/langchain-ai/langchain/pull/19874) - community\[patch]: Release 0.0.31 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19873](https://togithub.com/langchain-ai/langchain/pull/19873) - community: Update ChatZhipuAI to support GLM-4 model by [@zhangch9](https://togithub.com/zhangch9) in [https://github.com/langchain-ai/langchain/pull/16695](https://togithub.com/langchain-ai/langchain/pull/16695) - openai\[patch]: remove openai chunk size validation by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19878](https://togithub.com/langchain-ai/langchain/pull/19878) - Add OpenVINO rerank model support by [@OpenVINO-dev-contest](https://togithub.com/OpenVINO-dev-contest) in [https://github.com/langchain-ai/langchain/pull/19791](https://togithub.com/langchain-ai/langchain/pull/19791) - robocorp\[patch]: Fix nested arguments descriptors and tool names by [@mkorpela](https://togithub.com/mkorpela) in [https://github.com/langchain-ai/langchain/pull/19707](https://togithub.com/langchain-ai/langchain/pull/19707) - robocorp\[patch]: fix core min version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19879](https://togithub.com/langchain-ai/langchain/pull/19879) - community: Add Dria retriever by [@anilaltuner](https://togithub.com/anilaltuner) in [https://github.com/langchain-ai/langchain/pull/17098](https://togithub.com/langchain-ai/langchain/pull/17098) - docs\[patch]: Revert quarto update by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchain/pull/19880](https://togithub.com/langchain-ai/langchain/pull/19880) - docs: Fix link in Unstructured notebook by [@northern-64bit](https://togithub.com/northern-64bit) in [https://github.com/langchain-ai/langchain/pull/19851](https://togithub.com/langchain-ai/langchain/pull/19851) - cli\[minor]: Add **version** to integration package template by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19876](https://togithub.com/langchain-ai/langchain/pull/19876) - langchain: Adding a new section aware splitter to langchain by [@msetbar](https://togithub.com/msetbar) in [https://github.com/langchain-ai/langchain/pull/16526](https://togithub.com/langchain-ai/langchain/pull/16526) - docs: Add docs for RunnableConfigurableFields by [@spike-spiegel-21](https://togithub.com/spike-spiegel-21) in [https://github.com/langchain-ai/langchain/pull/19849](https://togithub.com/langchain-ai/langchain/pull/19849) - feat(partners): support request timeout in BaseCohere by [@mspronesti](https://togithub.com/mspronesti) in [https://github.com/langchain-ai/langchain/pull/19641](https://togithub.com/langchain-ai/langchain/pull/19641) - docs\[patch]: Hide google from function calling docs by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchain/pull/19887](https://togithub.com/langchain-ai/langchain/pull/19887) - community: add Layerup Security integration by [@JamsheedMistri](https://togithub.com/JamsheedMistri) in [https://github.com/langchain-ai/langchain/pull/19787](https://togithub.com/langchain-ai/langchain/pull/19787) - Add remove_comments option (default True): do not extract html comments by [@petervandenabeele](https://togithub.com/petervandenabeele) in [https://github.com/langchain-ai/langchain/pull/13259](https://togithub.com/langchain-ai/langchain/pull/13259) - core: Assign missing message ids in BaseChatModel by [@nfcampos](https://togithub.com/nfcampos) in [https://github.com/langchain-ai/langchain/pull/19863](https://togithub.com/langchain-ai/langchain/pull/19863) - Core\[major]: Base Tracer to propagate raw output from tool for on_tool_end by [@keenborder786](https://togithub.com/keenborder786) in [https://github.com/langchain-ai/langchain/pull/18932](https://togithub.com/langchain-ai/langchain/pull/18932) - core\[patch]: Release 0.1.38 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19895](https://togithub.com/langchain-ai/langchain/pull/19895) - langchain: fix ElasticsearchStore reference for self query by [@maxjakob](https://togithub.com/maxjakob) in [https://github.com/langchain-ai/langchain/pull/19907](https://togithub.com/langchain-ai/langchain/pull/19907) - Cohere: Add multihop tool agent by [@harry-cohere](https://togithub.com/harry-cohere) in [https://github.com/langchain-ai/langchain/pull/19919](https://togithub.com/langchain-ai/langchain/pull/19919) - cohere\[patch]: release 0.1.0 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19924](https://togithub.com/langchain-ai/langchain/pull/19924) - cohere, docs: update imports and installs to langchain_cohere by [@billytrend-cohere](https://togithub.com/billytrend-cohere) in [https://github.com/langchain-ai/langchain/pull/19918](https://togithub.com/langchain-ai/langchain/pull/19918) - cohere: simplify integration test by [@harry-cohere](https://togithub.com/harry-cohere) in [https://github.com/langchain-ai/langchain/pull/19928](https://togithub.com/langchain-ai/langchain/pull/19928) - cohere: Improve integration test stability, fix documents bug by [@harry-cohere](https://togithub.com/harry-cohere) in [https://github.com/langchain-ai/langchain/pull/19929](https://togithub.com/langchain-ai/langchain/pull/19929) - docs: mention caveats with CacheBackedEmbeddings.embed_query by [@jokester](https://togithub.com/jokester) in [https://github.com/langchain-ai/langchain/pull/19926](https://togithub.com/langchain-ai/langchain/pull/19926) - pinecone\[patch]: source tag by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19739](https://togithub.com/langchain-ai/langchain/pull/19739) - core\[patch]: remove requests by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19891](https://togithub.com/langchain-ai/langchain/pull/19891) - deprecating integrations moved to langchain_google_community by [@lkuligin](https://togithub.com/lkuligin) in [https://github.com/langchain-ai/langchain/pull/19841](https://togithub.com/langchain-ai/langchain/pull/19841) - docs: update cohere documentation by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19700](https://togithub.com/langchain-ai/langchain/pull/19700) - core: BaseChatModel modify chat message before passing to run_manager by [@nfcampos](https://togithub.com/nfcampos) in [https://github.com/langchain-ai/langchain/pull/19939](https://togithub.com/langchain-ai/langchain/pull/19939) - core\[patch]: Release 0.1.39 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19940](https://togithub.com/langchain-ai/langchain/pull/19940) - core: fix return of draw_mermaid_png and change to not save image by default by [@angeligareta](https://togithub.com/angeligareta) in [https://github.com/langchain-ai/langchain/pull/19950](https://togithub.com/langchain-ai/langchain/pull/19950) - core\[minor]: Add aload to document loader by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19936](https://togithub.com/langchain-ai/langchain/pull/19936) - langchain-postgres: Initial package with postgres chat history implementation by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19884](https://togithub.com/langchain-ai/langchain/pull/19884) - Support weight only quantization with intel-extension-for-transformers. by [@PenghuiCheng](https://togithub.com/PenghuiCheng) in [https://github.com/langchain-ai/langchain/pull/14504](https://togithub.com/langchain-ai/langchain/pull/14504) - comunity: Implement delete method and all async methods in opensearch_vector_search by [@2jimoo](https://togithub.com/2jimoo) in [https://github.com/langchain-ai/langchain/pull/17321](https://togithub.com/langchain-ai/langchain/pull/17321) - Update metadata filtering examples of documents by [@tomasonjo](https://togithub.com/tomasonjo) in [https://github.com/langchain-ai/langchain/pull/19963](https://togithub.com/langchain-ai/langchain/pull/19963) - core: 0.1.40, fix try_load_from_hub for older langchain versions load_chain by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19964](https://togithub.com/langchain-ai/langchain/pull/19964) - docs: Custom Document Loaders by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19935](https://togithub.com/langchain-ai/langchain/pull/19935) - cli\[minor]: Add disable sockets in unit tests by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19877](https://togithub.com/langchain-ai/langchain/pull/19877) - langchain_groq\[feat]: Add tool calling support by [@gradenr](https://togithub.com/gradenr) in [https://github.com/langchain-ai/langchain/pull/19971](https://togithub.com/langchain-ai/langchain/pull/19971) - groq: release 0.1.0 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19975](https://togithub.com/langchain-ai/langchain/pull/19975) - groq: fix core version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19976](https://togithub.com/langchain-ai/langchain/pull/19976) - groq: handle streaming tool call case by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19978](https://togithub.com/langchain-ai/langchain/pull/19978) - Jacob/docs new by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/19765](https://togithub.com/langchain-ai/langchain/pull/19765) - cohere: Add citations to agent, flexibility to tool parsing, fix SDK issue by [@harry-cohere](https://togithub.com/harry-cohere) in [https://github.com/langchain-ai/langchain/pull/19965](https://togithub.com/langchain-ai/langchain/pull/19965) - core\[Patch]: mypy ignore fixes [#17048](https://togithub.com/langchain-ai/langchain/issues/17048) by [@UtkarshaGupte](https://togithub.com/UtkarshaGupte) in [https://github.com/langchain-ai/langchain/pull/19931](https://togithub.com/langchain-ai/langchain/pull/19931) - core\[minor]: Add aformat to FewShotPromptTemplate by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/19652](https://togithub.com/langchain-ai/langchain/pull/19652) - core: support pydantic V2 for JSONOutputParser, allow for other sources of JSON schemas by [@jnis23](https://togithub.com/jnis23) in [https://github.com/langchain-ai/langchain/pull/19716](https://togithub.com/langchain-ai/langchain/pull/19716) - \[docs]\[minor]: Fix typo in Custom Document Loader doc by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20003](https://togithub.com/langchain-ai/langchain/pull/20003) - community: Implement Async OpenSearch `afrom_texts` & `afrom_embeddings` by [@crispyricepc](https://togithub.com/crispyricepc) in [https://github.com/langchain-ai/langchain/pull/20009](https://togithub.com/langchain-ai/langchain/pull/20009) - community\[minor]: Add metadata filtering support for neo4j vector by [@tomasonjo](https://togithub.com/tomasonjo) in [https://github.com/langchain-ai/langchain/pull/20001](https://togithub.com/langchain-ai/langchain/pull/20001) - langchain: enhance `LocalFileStore` to allow directory/file permissions to be specified by [@chrispy-snps](https://togithub.com/chrispy-snps) in [https://github.com/langchain-ai/langchain/pull/18857](https://togithub.com/langchain-ai/langchain/pull/18857) - docs\[patch]: Make Docusaurus and Vercel add trailing slashes when navigating by default by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/20014](https://togithub.com/langchain-ai/langchain/pull/20014) - community\[minor]: added missed class to **all** by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19888](https://togithub.com/langchain-ai/langchain/pull/19888) - anthropic\[minor]: tool use by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20016](https://togithub.com/langchain-ai/langchain/pull/20016) - anthropic\[patch]: bump core dep by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20019](https://togithub.com/langchain-ai/langchain/pull/20019) - Add cookbook for Anthropic .with_structured_output() by [@rlancemartin](https://togithub.com/rlancemartin) in [https://github.com/langchain-ai/langchain/pull/20017](https://togithub.com/langchain-ai/langchain/pull/20017) - anthropic\[patch]: fix experimental tests by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20021](https://togithub.com/langchain-ai/langchain/pull/20021) - docs: `graphs` update by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19675](https://togithub.com/langchain-ai/langchain/pull/19675) - docs `integrations/providers` update 10 by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19970](https://togithub.com/langchain-ai/langchain/pull/19970) - anthropic\[patch]: use anthropic 0.23 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20022](https://togithub.com/langchain-ai/langchain/pull/20022) - anthropic\[patch]: Release 0.1.6 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20026](https://togithub.com/langchain-ai/langchain/pull/20026) - docs: `integrations/providers/unstructured` update by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19892](https://togithub.com/langchain-ai/langchain/pull/19892) - docs: mark anthropic tools wrapper as deprecated by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20024](https://togithub.com/langchain-ai/langchain/pull/20024) - docs: `integrations/providers` update 9 by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19941](https://togithub.com/langchain-ai/langchain/pull/19941) - Update example cookbook for Anthropic tool use by [@rlancemartin](https://togithub.com/rlancemartin) in [https://github.com/langchain-ai/langchain/pull/20029](https://togithub.com/langchain-ai/langchain/pull/20029) - docs: hide experimental anthropic by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20030](https://togithub.com/langchain-ai/langchain/pull/20030) - docs: fixing typo in argument name by [@0ssamaak0](https://togithub.com/0ssamaak0) in [https://github.com/langchain-ai/langchain/pull/20028](https://togithub.com/langchain-ai/langchain/pull/20028) - docs\[patch]: Fix Model I/O quickstart by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/20031](https://togithub.com/langchain-ai/langchain/pull/20031) - docs: fix together model tab by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20032](https://togithub.com/langchain-ai/langchain/pull/20032) - docs: weaviate docs by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20042](https://togithub.com/langchain-ai/langchain/pull/20042) - Docs: Update custom chat model by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19967](https://togithub.com/langchain-ai/langchain/pull/19967) - docs: fix title cap by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20048](https://togithub.com/langchain-ai/langchain/pull/20048) - core: Implement aformat_messages for ChatMessagePromptTemplate by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20038](https://togithub.com/langchain-ai/langchain/pull/20038) - core: Add async aformat_document method by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20037](https://togithub.com/langchain-ai/langchain/pull/20037) - core: Implement aformat_prompt and ainvoke in BasePromptTemplate by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20035](https://togithub.com/langchain-ai/langchain/pull/20035) - core\[patch]: Document BaseCache abstraction in code by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20046](https://togithub.com/langchain-ai/langchain/pull/20046) - langchain-core\[minor]: Allow passing local cache to language models by [@liugddx](https://togithub.com/liugddx) in [https://github.com/langchain-ai/langchain/pull/19331](https://togithub.com/langchain-ai/langchain/pull/19331) - community\[patch]: Improve import callbacks to make it IDE friendly by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20050](https://togithub.com/langchain-ai/langchain/pull/20050) - docs\[patch]: Add missing redirects by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/20076](https://togithub.com/langchain-ai/langchain/pull/20076) - cohere: move package to external repo by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20081](https://togithub.com/langchain-ai/langchain/pull/20081) - docs: anthropic tool docstring by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20091](https://togithub.com/langchain-ai/langchain/pull/20091) - template: add rag azure search template by [@kristapratico](https://togithub.com/kristapratico) in [https://github.com/langchain-ai/langchain/pull/18143](https://togithub.com/langchain-ai/langchain/pull/18143) - partners\[anthropic]: fix anthropic chat model message type lookup keys by [@maximeperrindev](https://togithub.com/maximeperrindev) in [https://github.com/langchain-ai/langchain/pull/19034](https://togithub.com/langchain-ai/langchain/pull/19034) - templates: migrate to langchain_anthropic package to support Claude 3 models by [@donbr](https://togithub.com/donbr) in [https://github.com/langchain-ai/langchain/pull/19393](https://togithub.com/langchain-ai/langchain/pull/19393) - pinecone\[patch]: release 0.1.0 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20109](https://togithub.com/langchain-ai/langchain/pull/20109) - Documentation: Fixed the typo of Discord -> Telegram by [@TAAGECH9](https://togithub.com/TAAGECH9) in [https://github.com/langchain-ai/langchain/pull/20008](https://togithub.com/langchain-ai/langchain/pull/20008) - \[core] fix: manually specifying run_id for chat models.invoke() and .ainvoke() by [@hinthornw](https://togithub.com/hinthornw) in [https://github.com/langchain-ai/langchain/pull/20082](https://togithub.com/langchain-ai/langchain/pull/20082) - postgres\[minor]: add postgres checkpoint implementation by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20025](https://togithub.com/langchain-ai/langchain/pull/20025) - postgres\[minor]: Add pgvector community as is by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20096](https://togithub.com/langchain-ai/langchain/pull/20096) - community\[minor]: Add support for Pebblo cloud_api_key in PebbloSafeLoader by [@rahul-trip](https://togithub.com/rahul-trip) in [https://github.com/langchain-ai/langchain/pull/19855](https://togithub.com/langchain-ai/langchain/pull/19855) - Community: Updating Azure Retriever and Docs to be Azure AI Search instead of Azure Cognitive Search by [@marlenezw](https://togithub.com/marlenezw) in [https://github.com/langchain-ai/langchain/pull/19925](https://togithub.com/langchain-ai/langchain/pull/19925) - community: Add PHP language parser to document_loaders by [@david02871](https://togithub.com/david02871) in [https://github.com/langchain-ai/langchain/pull/19850](https://togithub.com/langchain-ai/langchain/pull/19850) - docs: use standard openai params by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20160](https://togithub.com/langchain-ai/langchain/pull/20160) - docs: standardize fireworks params by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20162](https://togithub.com/langchain-ai/langchain/pull/20162) - mistralai\[patch]: standardize model params by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20163](https://togithub.com/langchain-ai/langchain/pull/20163) - anthropic\[patch]: standardize init args by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20161](https://togithub.com/langchain-ai/langchain/pull/20161) - community: extend Predibase integration to support fine-tuned LLM adapters by [@alexsherstinsky](https://togithub.com/alexsherstinsky) in [https://github.com/langchain-ai/langchain/pull/19979](https://togithub.com/langchain-ai/langchain/pull/19979) - langchain: fix pinecone upsert when async_req is set to False by [@harryhaibojiang](https://togithub.com/harryhaibojiang) in [https://github.com/langchain-ai/langchain/pull/19793](https://togithub.com/langchain-ai/langchain/pull/19793) - pinecone\[patch]: fix core min version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20177](https://togithub.com/langchain-ai/langchain/pull/20177) - Adding MongoDB Cookbook for Chat history and semantic cache by [@RichmondAlake](https://togithub.com/RichmondAlake) in [https://github.com/langchain-ai/langchain/pull/19998](https://togithub.com/langchain-ai/langchain/pull/19998) - community: add request_timeout and max_retries to ChatAnthropic by [@kaijietti](https://togithub.com/kaijietti) in [https://github.com/langchain-ai/langchain/pull/19402](https://togithub.com/langchain-ai/langchain/pull/19402) - docs: add vertexai to structured output by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20171](https://togithub.com/langchain-ai/langchain/pull/20171) - community: `cross_encoders` flatten namespaces by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/20183](https://togithub.com/langchain-ai/langchain/pull/20183) - docs: TogetherAI as a drop-in replacement for OpenAI by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19900](https://togithub.com/langchain-ai/langchain/pull/19900) - Community: Add support for MLX models (chat & llm) by [@Blaizzy](https://togithub.com/Blaizzy) in [https://github.com/langchain-ai/langchain/pull/18152](https://togithub.com/langchain-ai/langchain/pull/18152) - community: add bedrock anthropic callback for token usage counting by [@Sukitly](https://togithub.com/Sukitly) in [https://github.com/langchain-ai/langchain/pull/19864](https://togithub.com/langchain-ai/langchain/pull/19864) - Fix pr 19772 by [@3coins](https://togithub.com/3coins) in [https://github.com/langchain-ai/langchain/pull/20047](https://togithub.com/langchain-ai/langchain/pull/20047) - baichuan\[patch]: standardize init args by [@liugddx](https://togithub.com/liugddx) in [https://github.com/langchain-ai/langchain/pull/20209](https://togithub.com/langchain-ai/langchain/pull/20209) - docs: Fix the class links in openai_tools and openai_functions description in output parser documentations by [@Haris-Ali007](https://togithub.com/Haris-Ali007) in [https://github.com/langchain-ai/langchain/pull/20197](https://togithub.com/langchain-ai/langchain/pull/20197) - community\[patch]: pass through sql agent kwargs by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19962](https://togithub.com/langchain-ai/langchain/pull/19962) - community: Enhance Tencent Cloud VectorDB, langchain: make Tencent Cloud VectorDB self query retrieve compatible by [@jeffkit](https://togithub.com/jeffkit) in [https://github.com/langchain-ai/langchain/pull/19651](https://togithub.com/langchain-ai/langchain/pull/19651) - GCSDirectoryLoader bugfix by [@timothywong731](https://togithub.com/timothywong731) in [https://github.com/langchain-ai/langchain/pull/20005](https://togithub.com/langchain-ai/langchain/pull/20005) - doc:(sharememory\&bittensor) Get rid of ZeroShotAgent and use create_react_agent instead by [@liugddx](https://togithub.com/liugddx) in [https://github.com/langchain-ai/langchain/pull/20157](https://togithub.com/langchain-ai/langchain/pull/20157) - community: add allow_dangerous_requests for OpenAPI toolkits by [@daviddwlee84](https://togithub.com/daviddwlee84) in [https://github.com/langchain-ai/langchain/pull/19493](https://togithub.com/langchain-ai/langchain/pull/19493) - docs: Add documentation of `ElasticsearchStore.BM25RetrievalStrategy` by [@g-votte](https://togithub.com/g-votte) in [https://github.com/langchain-ai/langchain/pull/20098](https://togithub.com/langchain-ai/langchain/pull/20098) - openai: wrap stream code in context manager blocks by [@snopoke](https://togithub.com/snopoke) in [https://github.com/langchain-ai/langchain/pull/18013](https://togithub.com/langchain-ai/langchain/pull/18013) - Remove postgres package by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20207](https://togithub.com/langchain-ai/langchain/pull/20207) - langchain-postgres: Remove remaining README.md file by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20221](https://togithub.com/langchain-ai/langchain/pull/20221) - together: release 0.1.0 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20225](https://togithub.com/langchain-ai/langchain/pull/20225) - standard-tests: a standard unit and integration test set by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20182](https://togithub.com/langchain-ai/langchain/pull/20182) - core: Implement aformat for FewShotPromptWithTemplates by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20039](https://togithub.com/langchain-ai/langchain/pull/20039) - core: Implement aformat_messages for \_StringImageMessagePromptTemplate by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20036](https://togithub.com/langchain-ai/langchain/pull/20036) - community: switch to falkordb python client by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20229](https://togithub.com/langchain-ai/langchain/pull/20229) - community\[patch]: OpenLLM Async Client Fixes and Timeout Parameter by [@charlod](https://togithub.com/charlod) in [https://github.com/langchain-ai/langchain/pull/20007](https://togithub.com/langchain-ai/langchain/pull/20007) - langchain\[patch]: make BooleanOutputParser check words not substrings by [@casperdcl](https://togithub.com/casperdcl) in [https://github.com/langchain-ai/langchain/pull/20064](https://togithub.com/langchain-ai/langchain/pull/20064) - langchain\[patch]: Update unit test by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20228](https://togithub.com/langchain-ai/langchain/pull/20228) - docs: Fix typo in citations example by [@sjnarmstrong](https://togithub.com/sjnarmstrong) in [https://github.com/langchain-ai/langchain/pull/20218](https://togithub.com/langchain-ai/langchain/pull/20218) - community: fixed multithreading returning List\[List\[Documents]] instead of List\[Documents] by [@chip-davis](https://togithub.com/chip-davis) in [https://github.com/langchain-ai/langchain/pull/20230](https://togithub.com/langchain-ai/langchain/pull/20230) - core\[patch]: Release 0.1.41 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20233](https://togithub.com/langchain-ai/langchain/pull/20233) - community\[patch]: Release 0.0.32 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20236](https://togithub.com/langchain-ai/langchain/pull/20236) - langchain\[patch]: Release 0.1.15 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20237](https://togithub.com/langchain-ai/langchain/pull/20237) - mistralai\[patch]: Release 0.1.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20239](https://togithub.com/langchain-ai/langchain/pull/20239) - anthropic\[patch]: Release 0.1.7 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20240](https://togithub.com/langchain-ai/langchain/pull/20240) #### New Contributors - [@angeligareta](https://togithub.com/angeligareta) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19599](https://togithub.com/langchain-ai/langchain/pull/19599) - [@zhangch9](https://togithub.com/zhangch9) made their first contribution in [https://github.com/langchain-ai/langchain/pull/16695](https://togithub.com/langchain-ai/langchain/pull/16695) - [@mkorpela](https://togithub.com/mkorpela) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19707](https://togithub.com/langchain-ai/langchain/pull/19707) - [@anilaltuner](https://togithub.com/anilaltuner) made their first contribution in [https://github.com/langchain-ai/langchain/pull/17098](https://togithub.com/langchain-ai/langchain/pull/17098) - [@spike-spiegel-21](https://togithub.com/spike-spiegel-21) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19849](https://togithub.com/langchain-ai/langchain/pull/19849) - [@JamsheedMistri](https://togithub.com/JamsheedMistri) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19787](https://togithub.com/langchain-ai/langchain/pull/19787) - [@jokester](https://togithub.com/jokester) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19926](https://togithub.com/langchain-ai/langchain/pull/19926) - [@PenghuiCheng](https://togithub.com/PenghuiCheng) made their first contribution in [https://github.com/langchain-ai/langchain/pull/14504](https://togithub.com/langchain-ai/langchain/pull/14504) - [@UtkarshaGupte](https://togithub.com/UtkarshaGupte) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19931](https://togithub.com/langchain-ai/langchain/pull/19931) - [@crispyricepc](https://togithub.com/crispyricepc) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20009](https://togithub.com/langchain-ai/langchain/pull/20009) - [@0ssamaak0](https://togithub.com/0ssamaak0) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20028](https://togithub.com/langchain-ai/langchain/pull/20028) - [@donbr](https://togithub.com/donbr) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19393](https://togithub.com/langchain-ai/langchain/pull/19393) - [@TAAGECH9](https://togithub.com/TAAGECH9) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20008](https://togithub.com/langchain-ai/langchain/pull/20008) - [@rahul-trip](https://togithub.com/rahul-trip) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19855](https://togithub.com/langchain-ai/langchain/pull/19855) - [@david02871](https://togithub.com/david02871) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19850](https://togithub.com/langchain-ai/langchain/pull/19850) - [@harryhaibojiang](https://togithub.com/harryhaibojiang) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19793](https://togithub.com/langchain-ai/langchain/pull/19793) - [@RichmondAlake](https://togithub.com/RichmondAlake) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19998](https://togithub.com/langchain-ai/langchain/pull/19998) - [@Blaizzy](https://togithub.com/Blaizzy) made their first contribution in [https://github.com/langchain-ai/langchain/pull/18152](https://togithub.com/langchain-ai/langchain/pull/18152) - [@Haris-Ali007](https://togithub.com/Haris-Ali007) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20197](https://togithub.com/langchain-ai/langchain/pull/20197) - [@jeffkit](https://togithub.com/jeffkit) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19651](https://togithub.com/langchain-ai/langchain/pull/19651) - [@daviddwlee84](https://togithub.com/daviddwlee84) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19493](https://togithub.com/langchain-ai/langchain/pull/19493) - [@snopoke](https://togithub.com/snopoke) made their first contribution in [https://github.com/langchain-ai/langchain/pull/18013](https://togithub.com/langchain-ai/langchain/pull/18013) - [@charlod](https://togithub.com/charlod) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20007](https://togithub.com/langchain-ai/langchain/pull/20007) - [@casperdcl](https://togithub.com/casperdcl) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20064](https://togithub.com/langchain-ai/langchain/pull/20064) - [@sjnarmstrong](https://togithub.com/sjnarmstrong) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20218](https://togithub.com/langchain-ai/langchain/pull/20218) **Full Changelog**: https://github.com/langchain-ai/langchain/compare/v0.1.14...v0.1.15 ### [`v0.1.14`](https://togithub.com/langchain-ai/langchain/releases/tag/v0.1.14) [Compare Source](https://togithub.com/langchain-ai/langchain/compare/v0.1.13...v0.1.14) #### What's Changed - robocorp\[patch]: release 0.0.4 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19357](https://togithub.com/langchain-ai/langchain/pull/19357) - robocorp\[patch]: run integration tests on release by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19358](https://togithub.com/langchain-ai/langchain/pull/19358) - experimental\[patch]: Release 0.0.55 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19353](https://togithub.com/langchain-ai/langchain/pull/19353) - openai\[patch]: release 0.1.0, message id and name support by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19363](https://togithub.com/langchain-ai/langchain/pull/19363) - openai\[patch]: fix name param by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19365](https://togithub.com/langchain-ai/langchain/pull/19365) - openai\[patch]: fix core min version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19366](https://togithub.com/langchain-ai/langchain/pull/19366) - feat: update base_url of anthropic by [@enfeng](https://togithub.com/enfeng) in [https://github.com/langchain-ai/langchain/pull/18634](https://togithub.com/langchain-ai/langchain/pull/18634) - community:Replace positional argument with text=text for cohere>=5 compatibility by [@billytrend-cohere](https://togithub.com/billytrend-cohere) in [https://github.com/langchain-ai/langchain/pull/19407](https://togithub.com/langchain-ai/langchain/pull/19407) - core\[patch]: allow "placeholder" type in from_messages tuples by [@hinthornw](https://togithub.com/hinthornw) in [https://github.com/langchain-ai/langchain/pull/19152](https://togithub.com/langchain-ai/langchain/pull/19152) - mistralai\[minor]: 0.1.0rc0, remove mistral sdk by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19420](https://togithub.com/langchain-ai/langchain/pull/19420) - core\[minor]: Add utility code to create tool examples by [@hwchase17](https://togithub.com/hwchase17) in [https://github.com/langchain-ai/langchain/pull/18602](https://togithub.com/langchain-ai/langchain/pull/18602) - \[langchain] fix OpenAIAssistantRunnable.create_assistant by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/19081](https://togithub.com/langchain-ai/langchain/pull/19081) - cookbook\[patch]: add strip of quotes by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19452](https://togithub.com/langchain-ai/langchain/pull/19452) - mistralai: update tool calling by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/19451](https://togithub.com/langchain-ai/langchain/pull/19451) - community\[patch]: invoke callback prior to yielding token (llama.cpp) by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19392](https://togithub.com/langchain-ai/langchain/pull/19392) - mistralai\[patch]: release 0.1.0rc1 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19453](https://togithub.com/langchain-ai/langchain/pull/19453) - mistralai\[patch]: fix core version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19454](https://togithub.com/langchain-ai/langchain/pull/19454) - docs: delete mistralai embeddings doc from incorrect location by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19432](https://togithub.com/langchain-ai/langchain/pull/19432) - langchain_openai: \[URGENT REGRESSION FIX] Don't fail if tool message already doesn't contain name by [@ldorigo](https://togithub.com/ldorigo) in [https://github.com/langchain-ai/langchain/pull/19435](https://togithub.com/langchain-ai/langchain/pull/19435) - openai\[patch]: release 0.1.1 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19458](https://togithub.com/langchain-ai/langchain/pull/19458) - openai\[patch]: integration test structured output by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19459](https://togithub.com/langchain-ai/langchain/pull/19459) - openai\[patch]: tool use integration test by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19460](https://togithub.com/langchain-ai/langchain/pull/19460) - docs: use invoke instead of run by [@raybellwaves](https://togithub.com/raybellwaves) in [https://github.com/langchain-ai/langchain/pull/19457](https://togithub.com/langchain-ai/langchain/pull/19457) - docs: point to titantic dataset on web by [@raybellwaves](https://togithub.com/raybellwaves) in [https://github.com/langchain-ai/langchain/pull/19455](https://togithub.com/langchain-ai/langchain/pull/19455) - community:Modified regular expression by [@igeni](https://togithub.com/igeni) in [https://github.com/langchain-ai/langchain/pull/19449](https://togithub.com/langchain-ai/langchain/pull/19449) - openai\[patch]: add test coverage to output by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19462](https://togithub.com/langchain-ai/langchain/pull/19462) - community: RecursiveUrlLoader: add base_url option by [@germankrause](https://togithub.com/germankrause) in [https://github.com/langchain-ai/langchain/pull/19421](https://togithub.com/langchain-ai/langchain/pull/19421) - docarray requires hnsw installation by [@lucifertrj](https://togithub.com/lucifertrj) in [https://github.com/langchain-ai/langchain/pull/19416](https://togithub.com/langchain-ai/langchain/pull/19416) - langchain: Add async methods to VectorStoreRetrieverMemory by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/19408](https://togithub.com/langchain-ai/langchain/pull/19408) - makefile `api_docs_clean` fix by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19405](https://togithub.com/langchain-ai/langchain/pull/19405) - docs: moving FireworksEmbeddings documentation to docs folder by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19398](https://togithub.com/langchain-ai/langchain/pull/19398) - community\[patch]: invoke callback prior to yielding token (fireworks) by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19388](https://togithub.com/langchain-ai/langchain/pull/19388) - community\[patch]: invoke callback prior to yielding token (openai) by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19389](https://togithub.com/langchain-ai/langchain/pull/19389) - docs: Add `partition` parameter to DashVector by [@wangcailin](https://togithub.com/wangcailin) in [https://github.com/langchain-ai/langchain/pull/19385](https://togithub.com/langchain-ai/langchain/pull/19385) - community: fix bugs in baiduvectordb as vectorstore by [@fengjial](https://togithub.com/fengjial) in [https://github.com/langchain-ai/langchain/pull/19380](https://togithub.com/langchain-ai/langchain/pull/19380) - docs: update import paths and move to lcel for llama.cpp examples by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19391](https://togithub.com/langchain-ai/langchain/pull/19391) - docs: update module imports for fireworks documentation by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19377](https://togithub.com/langchain-ai/langchain/pull/19377) - docs: fix error bilibili url by [@Undertone0809](https://togithub.com/Undertone0809) in [https://github.com/langchain-ai/langchain/pull/19375](https://togithub.com/langchain-ai/langchain/pull/19375) - docs: adding voyageai to the list of partner packages by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19376](https://togithub.com/langchain-ai/langchain/pull/19376) - mistralai\[patch]: streaming tool calls by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19469](https://togithub.com/langchain-ai/langchain/pull/19469) - Remove non-rendering images & output spamming from doc ntbks by [@rlancemartin](https://togithub.com/rlancemartin) in [https://github.com/langchain-ai/langchain/pull/19475](https://togithub.com/langchain-ai/langchain/pull/19475) - Use async memory in Chain when needed by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/19429](https://togithub.com/langchain-ai/langchain/pull/19429) - code\[patch]: Add in code documentation to core Runnable `pipe` and `pick` methods (docs only) by [@liugddx](https://togithub.com/liugddx) in [https://github.com/langchain-ai/langchain/pull/19395](https://togithub.com/langchain-ai/langchain/pull/19395) - community\[minor]: S3FileLoader to use expose mode and post_processors arguments of unstructured loader by [@preak95](https://togithub.com/preak95) in [https://github.com/langchain-ai/langchain/pull/19270](https://togithub.com/langchain-ai/langchain/pull/19270) - Add OpenVINO llms docs by [@OpenVINO-dev-contest](https://togithub.com/OpenVINO-dev-contest) in [https://github.com/langchain-ai/langchain/pull/19489](https://togithub.com/langchain-ai/langchain/pull/19489) - community\[minor]: Add `DuckDB` as a vectorstore by [@Hugoberry](https://togithub.com/Hugoberry) in [https://github.com/langchain-ai/langchain/pull/18916](https://togithub.com/langchain-ai/langchain/pull/18916) - infra: Update package version to apply CVE-related patch by [@JacobLezberg](https://togithub.com/JacobLezberg) in [https://github.com/langchain-ai/langchain/pull/19490](https://togithub.com/langchain-ai/langchain/pull/19490) - langchain-community: Dappier chat model integration by [@IgorMunizS](https://togithub.com/IgorMunizS) in [https://github.com/langchain-ai/langchain/pull/19370](https://togithub.com/langchain-ai/langchain/pull/19370) - Update docs for `HuggingFacePipeline` by [@nikhilkmr300](https://togithub.com/nikhilkmr300) in [https://github.com/langchain-ai/langchain/pull/19306](https://togithub.com/langchain-ai/langchain/pull/19306) - add kwargs by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/19519](https://togithub.com/langchain-ai/langchain/pull/19519) - langchain: Passthrough batch_size on index()/aindex() calls by [@znwilkins](https://togithub.com/znwilkins) in [https://github.com/langchain-ai/langchain/pull/19443](https://togithub.com/langchain-ai/langchain/pull/19443) - core\[patch]: Use defusedxml in XMLOutputParser by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19526](https://togithub.com/langchain-ai/langchain/pull/19526) - langchain_cohere: add cohere as a partner package by [@billytrend-cohere]( </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://developer.mend.io/github/GoogleCloudPlatform/generative-ai).

@nfcampos

…xtract html comments (#13259) - **Description:** add `remove_comments` option (default: True): do not extract html _comments_, - **Issue:** None, - **Dependencies:** None, - **Tag maintainer:** @nfcampos , - **Twitter handle:** peter_v I ran `make format`, `make lint` and `make test`. Discussion: I my use case, I prefer to not have the comments in the extracted text: * e.g. from a Google tag that is added in the html as comment * e.g. content that the authors have temporarily hidden to make it non visible to the regular reader Removing the comments makes the extracted text more alike the intended text to be seen by the reader. **Choice to make:** do we prefer to make the default for this `remove_comments` option to be True or False? I have changed it to True in a second commit, since that is how I would prefer to use it by default. Have the cleaned text (without technical Google tags etc.) and also closer to the actually visible and intended content. I am not sure what is best aligned with the conventions of langchain in general ... INITIAL VERSION (new version above): ~**Choice to make:** do we prefer to make the default for this `ignore_comments` option to be True or False? I have set it to False now to be backwards compatible. On the other hand, I would use it mostly with True. I am not sure what is best aligned with the conventions of langchain in general ...~ --------- Co-authored-by: Bagatur <baskaryan@gmail.com>

…orm#586) [![Mend Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com) This PR contains the following updates: | Package | Change | Age | Adoption | Passing | Confidence | |---|---|---|---|---|---| | [langchain](https://togithub.com/langchain-ai/langchain) | `==0.1.12` -> `==0.1.16` | [![age](https://developer.mend.io/api/mc/badges/age/pypi/langchain/0.1.16?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/pypi/langchain/0.1.16?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/pypi/langchain/0.1.12/0.1.16?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/pypi/langchain/0.1.12/0.1.16?slim=true)](https://docs.renovatebot.com/merge-confidence/) | --- ### Release Notes <details> <summary>langchain-ai/langchain (langchain)</summary> ### [`v0.1.16`](https://togithub.com/langchain-ai/langchain/releases/tag/v0.1.16) [Compare Source](https://togithub.com/langchain-ai/langchain/compare/v0.1.15...v0.1.16) ##### What's Changed - openai\[patch]: Release 0.1.2 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20241](https://togithub.com/langchain-ai/langchain/pull/20241) - docs: fix external repo partner docs by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20238](https://togithub.com/langchain-ai/langchain/pull/20238) - groq\[patch]: Release 0.1.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20242](https://togithub.com/langchain-ai/langchain/pull/20242) - experimental\[patch]: Release 0.0.57 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20243](https://togithub.com/langchain-ai/langchain/pull/20243) - groq: xfail tool_choice tests by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20247](https://togithub.com/langchain-ai/langchain/pull/20247) - \[core]: add tool calls message by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/18947](https://togithub.com/langchain-ai/langchain/pull/18947) - core\[patch]: Pre-release 0.1.42-rc.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20248](https://togithub.com/langchain-ai/langchain/pull/20248) - openai\[patch]: pre-release 0.1.3-rc.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20249](https://togithub.com/langchain-ai/langchain/pull/20249) - anthropic\[patch]: Pre-release 0.1.8-rc.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20250](https://togithub.com/langchain-ai/langchain/pull/20250) - mistralai\[patch]: Pre-release 0.1.2-rc.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20251](https://togithub.com/langchain-ai/langchain/pull/20251) - infra, multiple: rc release versions by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20252](https://togithub.com/langchain-ai/langchain/pull/20252) - update agents to use tool call messages by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/20074](https://togithub.com/langchain-ai/langchain/pull/20074) - openai\[patch]: Fix langchain-openai unknown parameter error with gpt-4-turbo by [@os1ma](https://togithub.com/os1ma) in [https://github.com/langchain-ai/langchain/pull/20271](https://togithub.com/langchain-ai/langchain/pull/20271) - community: import flattening fix by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/20110](https://togithub.com/langchain-ai/langchain/pull/20110) - core: mustache prompt templates by [@nfcampos](https://togithub.com/nfcampos) in [https://github.com/langchain-ai/langchain/pull/19980](https://togithub.com/langchain-ai/langchain/pull/19980) - docs: update tool calling cookbook by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/20290](https://togithub.com/langchain-ai/langchain/pull/20290) - core\[patch]: fix duplicated kwargs in `_load_sql_databse_chain` by [@B-Step62](https://togithub.com/B-Step62) in [https://github.com/langchain-ai/langchain/pull/19908](https://togithub.com/langchain-ai/langchain/pull/19908) - partners: Add chroma partner package by [@killind-dev](https://togithub.com/killind-dev) in [https://github.com/langchain-ai/langchain/pull/19292](https://togithub.com/langchain-ai/langchain/pull/19292) - chroma: add optional fastapi dep to restrict to <1 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20295](https://togithub.com/langchain-ai/langchain/pull/20295) - chroma: add required fastapi dep to restrict to <1 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20297](https://togithub.com/langchain-ai/langchain/pull/20297) - chroma: bump rc, keep optional by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20298](https://togithub.com/langchain-ai/langchain/pull/20298) - core\[patch]: include tool_calls in ai msg chunk serialization by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20291](https://togithub.com/langchain-ai/langchain/pull/20291) - core\[patch]: fix ChatGeneration.text with content blocks by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20294](https://togithub.com/langchain-ai/langchain/pull/20294) - langchain\[patch]: agents check prompt partial vars by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20303](https://togithub.com/langchain-ai/langchain/pull/20303) - openai\[patch]: use tool_calls in request by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20272](https://togithub.com/langchain-ai/langchain/pull/20272) - docs: added backtick on RunnablePassthrough by [@spike-spiegel-21](https://togithub.com/spike-spiegel-21) in [https://github.com/langchain-ai/langchain/pull/20310](https://togithub.com/langchain-ai/langchain/pull/20310) - core\[patch]: For now remove user warning by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20321](https://togithub.com/langchain-ai/langchain/pull/20321) - community\[patch]: Add deprecation warnings to postgres implementation by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20222](https://togithub.com/langchain-ai/langchain/pull/20222) - mistral: add IDs to tool calls by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/20299](https://togithub.com/langchain-ai/langchain/pull/20299) - core\[patch]: Release 0.1.42 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20332](https://togithub.com/langchain-ai/langchain/pull/20332) - release anthropic, fireworks, openai, groq, mistral by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20333](https://togithub.com/langchain-ai/langchain/pull/20333) - docs: Update documentation for custom LLMs by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19972](https://togithub.com/langchain-ai/langchain/pull/19972) - Testing list of tool calling providers by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20330](https://togithub.com/langchain-ai/langchain/pull/20330) - langchain\[patch]: Release 0.1.16 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20335](https://togithub.com/langchain-ai/langchain/pull/20335) - docs: add component page for tool calls by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/20282](https://togithub.com/langchain-ai/langchain/pull/20282) - docs: add tool-calling agent by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20328](https://togithub.com/langchain-ai/langchain/pull/20328) - docs: update chat openai by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20331](https://togithub.com/langchain-ai/langchain/pull/20331) ##### New Contributors - [@killind-dev](https://togithub.com/killind-dev) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19292](https://togithub.com/langchain-ai/langchain/pull/19292) **Full Changelog**: https://github.com/langchain-ai/langchain/compare/v0.1.15...v0.1.16 ### [`v0.1.15`](https://togithub.com/langchain-ai/langchain/releases/tag/v0.1.15) [Compare Source](https://togithub.com/langchain-ai/langchain/compare/v0.1.14...v0.1.15) #### What's Changed - experimental\[patch]: Release 0.0.56 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19840](https://togithub.com/langchain-ai/langchain/pull/19840) - docs: remove unnecessary args from the pip install by [@cyai](https://togithub.com/cyai) in [https://github.com/langchain-ai/langchain/pull/19823](https://togithub.com/langchain-ai/langchain/pull/19823) - Update cross_encoder_reranker.ipynb by [@eltociear](https://togithub.com/eltociear) in [https://github.com/langchain-ai/langchain/pull/19846](https://togithub.com/langchain-ai/langchain/pull/19846) - core: generate mermaid syntax and render visual graph by [@angeligareta](https://togithub.com/angeligareta) in [https://github.com/langchain-ai/langchain/pull/19599](https://togithub.com/langchain-ai/langchain/pull/19599) - ai21\[patch]: release 0.1.3 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19867](https://togithub.com/langchain-ai/langchain/pull/19867) - 👥 Update LangChain people data by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/19858](https://togithub.com/langchain-ai/langchain/pull/19858) - community\[patch]: Revert " Fix the bug that Chroma does not specify \`e… by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19866](https://togithub.com/langchain-ai/langchain/pull/19866) - openai\[patch]: fix azure embedding length check by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19870](https://togithub.com/langchain-ai/langchain/pull/19870) - Partially Revert "openai\[patch]: Update openai chat model to new base class interface" by [@nfcampos](https://togithub.com/nfcampos) in [https://github.com/langchain-ai/langchain/pull/19871](https://togithub.com/langchain-ai/langchain/pull/19871) - ai21\[patch]: fix core dep by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19874](https://togithub.com/langchain-ai/langchain/pull/19874) - community\[patch]: Release 0.0.31 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19873](https://togithub.com/langchain-ai/langchain/pull/19873) - community: Update ChatZhipuAI to support GLM-4 model by [@zhangch9](https://togithub.com/zhangch9) in [https://github.com/langchain-ai/langchain/pull/16695](https://togithub.com/langchain-ai/langchain/pull/16695) - openai\[patch]: remove openai chunk size validation by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19878](https://togithub.com/langchain-ai/langchain/pull/19878) - Add OpenVINO rerank model support by [@OpenVINO-dev-contest](https://togithub.com/OpenVINO-dev-contest) in [https://github.com/langchain-ai/langchain/pull/19791](https://togithub.com/langchain-ai/langchain/pull/19791) - robocorp\[patch]: Fix nested arguments descriptors and tool names by [@mkorpela](https://togithub.com/mkorpela) in [https://github.com/langchain-ai/langchain/pull/19707](https://togithub.com/langchain-ai/langchain/pull/19707) - robocorp\[patch]: fix core min version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19879](https://togithub.com/langchain-ai/langchain/pull/19879) - community: Add Dria retriever by [@anilaltuner](https://togithub.com/anilaltuner) in [https://github.com/langchain-ai/langchain/pull/17098](https://togithub.com/langchain-ai/langchain/pull/17098) - docs\[patch]: Revert quarto update by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchain/pull/19880](https://togithub.com/langchain-ai/langchain/pull/19880) - docs: Fix link in Unstructured notebook by [@northern-64bit](https://togithub.com/northern-64bit) in [https://github.com/langchain-ai/langchain/pull/19851](https://togithub.com/langchain-ai/langchain/pull/19851) - cli\[minor]: Add **version** to integration package template by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19876](https://togithub.com/langchain-ai/langchain/pull/19876) - langchain: Adding a new section aware splitter to langchain by [@msetbar](https://togithub.com/msetbar) in [https://github.com/langchain-ai/langchain/pull/16526](https://togithub.com/langchain-ai/langchain/pull/16526) - docs: Add docs for RunnableConfigurableFields by [@spike-spiegel-21](https://togithub.com/spike-spiegel-21) in [https://github.com/langchain-ai/langchain/pull/19849](https://togithub.com/langchain-ai/langchain/pull/19849) - feat(partners): support request timeout in BaseCohere by [@mspronesti](https://togithub.com/mspronesti) in [https://github.com/langchain-ai/langchain/pull/19641](https://togithub.com/langchain-ai/langchain/pull/19641) - docs\[patch]: Hide google from function calling docs by [@bracesproul](https://togithub.com/bracesproul) in [https://github.com/langchain-ai/langchain/pull/19887](https://togithub.com/langchain-ai/langchain/pull/19887) - community: add Layerup Security integration by [@JamsheedMistri](https://togithub.com/JamsheedMistri) in [https://github.com/langchain-ai/langchain/pull/19787](https://togithub.com/langchain-ai/langchain/pull/19787) - Add remove_comments option (default True): do not extract html comments by [@petervandenabeele](https://togithub.com/petervandenabeele) in [https://github.com/langchain-ai/langchain/pull/13259](https://togithub.com/langchain-ai/langchain/pull/13259) - core: Assign missing message ids in BaseChatModel by [@nfcampos](https://togithub.com/nfcampos) in [https://github.com/langchain-ai/langchain/pull/19863](https://togithub.com/langchain-ai/langchain/pull/19863) - Core\[major]: Base Tracer to propagate raw output from tool for on_tool_end by [@keenborder786](https://togithub.com/keenborder786) in [https://github.com/langchain-ai/langchain/pull/18932](https://togithub.com/langchain-ai/langchain/pull/18932) - core\[patch]: Release 0.1.38 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19895](https://togithub.com/langchain-ai/langchain/pull/19895) - langchain: fix ElasticsearchStore reference for self query by [@maxjakob](https://togithub.com/maxjakob) in [https://github.com/langchain-ai/langchain/pull/19907](https://togithub.com/langchain-ai/langchain/pull/19907) - Cohere: Add multihop tool agent by [@harry-cohere](https://togithub.com/harry-cohere) in [https://github.com/langchain-ai/langchain/pull/19919](https://togithub.com/langchain-ai/langchain/pull/19919) - cohere\[patch]: release 0.1.0 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19924](https://togithub.com/langchain-ai/langchain/pull/19924) - cohere, docs: update imports and installs to langchain_cohere by [@billytrend-cohere](https://togithub.com/billytrend-cohere) in [https://github.com/langchain-ai/langchain/pull/19918](https://togithub.com/langchain-ai/langchain/pull/19918) - cohere: simplify integration test by [@harry-cohere](https://togithub.com/harry-cohere) in [https://github.com/langchain-ai/langchain/pull/19928](https://togithub.com/langchain-ai/langchain/pull/19928) - cohere: Improve integration test stability, fix documents bug by [@harry-cohere](https://togithub.com/harry-cohere) in [https://github.com/langchain-ai/langchain/pull/19929](https://togithub.com/langchain-ai/langchain/pull/19929) - docs: mention caveats with CacheBackedEmbeddings.embed_query by [@jokester](https://togithub.com/jokester) in [https://github.com/langchain-ai/langchain/pull/19926](https://togithub.com/langchain-ai/langchain/pull/19926) - pinecone\[patch]: source tag by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19739](https://togithub.com/langchain-ai/langchain/pull/19739) - core\[patch]: remove requests by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19891](https://togithub.com/langchain-ai/langchain/pull/19891) - deprecating integrations moved to langchain_google_community by [@lkuligin](https://togithub.com/lkuligin) in [https://github.com/langchain-ai/langchain/pull/19841](https://togithub.com/langchain-ai/langchain/pull/19841) - docs: update cohere documentation by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19700](https://togithub.com/langchain-ai/langchain/pull/19700) - core: BaseChatModel modify chat message before passing to run_manager by [@nfcampos](https://togithub.com/nfcampos) in [https://github.com/langchain-ai/langchain/pull/19939](https://togithub.com/langchain-ai/langchain/pull/19939) - core\[patch]: Release 0.1.39 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19940](https://togithub.com/langchain-ai/langchain/pull/19940) - core: fix return of draw_mermaid_png and change to not save image by default by [@angeligareta](https://togithub.com/angeligareta) in [https://github.com/langchain-ai/langchain/pull/19950](https://togithub.com/langchain-ai/langchain/pull/19950) - core\[minor]: Add aload to document loader by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19936](https://togithub.com/langchain-ai/langchain/pull/19936) - langchain-postgres: Initial package with postgres chat history implementation by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19884](https://togithub.com/langchain-ai/langchain/pull/19884) - Support weight only quantization with intel-extension-for-transformers. by [@PenghuiCheng](https://togithub.com/PenghuiCheng) in [https://github.com/langchain-ai/langchain/pull/14504](https://togithub.com/langchain-ai/langchain/pull/14504) - comunity: Implement delete method and all async methods in opensearch_vector_search by [@2jimoo](https://togithub.com/2jimoo) in [https://github.com/langchain-ai/langchain/pull/17321](https://togithub.com/langchain-ai/langchain/pull/17321) - Update metadata filtering examples of documents by [@tomasonjo](https://togithub.com/tomasonjo) in [https://github.com/langchain-ai/langchain/pull/19963](https://togithub.com/langchain-ai/langchain/pull/19963) - core: 0.1.40, fix try_load_from_hub for older langchain versions load_chain by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19964](https://togithub.com/langchain-ai/langchain/pull/19964) - docs: Custom Document Loaders by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19935](https://togithub.com/langchain-ai/langchain/pull/19935) - cli\[minor]: Add disable sockets in unit tests by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19877](https://togithub.com/langchain-ai/langchain/pull/19877) - langchain_groq\[feat]: Add tool calling support by [@gradenr](https://togithub.com/gradenr) in [https://github.com/langchain-ai/langchain/pull/19971](https://togithub.com/langchain-ai/langchain/pull/19971) - groq: release 0.1.0 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19975](https://togithub.com/langchain-ai/langchain/pull/19975) - groq: fix core version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19976](https://togithub.com/langchain-ai/langchain/pull/19976) - groq: handle streaming tool call case by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19978](https://togithub.com/langchain-ai/langchain/pull/19978) - Jacob/docs new by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/19765](https://togithub.com/langchain-ai/langchain/pull/19765) - cohere: Add citations to agent, flexibility to tool parsing, fix SDK issue by [@harry-cohere](https://togithub.com/harry-cohere) in [https://github.com/langchain-ai/langchain/pull/19965](https://togithub.com/langchain-ai/langchain/pull/19965) - core\[Patch]: mypy ignore fixes [#17048](https://togithub.com/langchain-ai/langchain/issues/17048) by [@UtkarshaGupte](https://togithub.com/UtkarshaGupte) in [https://github.com/langchain-ai/langchain/pull/19931](https://togithub.com/langchain-ai/langchain/pull/19931) - core\[minor]: Add aformat to FewShotPromptTemplate by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/19652](https://togithub.com/langchain-ai/langchain/pull/19652) - core: support pydantic V2 for JSONOutputParser, allow for other sources of JSON schemas by [@jnis23](https://togithub.com/jnis23) in [https://github.com/langchain-ai/langchain/pull/19716](https://togithub.com/langchain-ai/langchain/pull/19716) - \[docs]\[minor]: Fix typo in Custom Document Loader doc by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20003](https://togithub.com/langchain-ai/langchain/pull/20003) - community: Implement Async OpenSearch `afrom_texts` & `afrom_embeddings` by [@crispyricepc](https://togithub.com/crispyricepc) in [https://github.com/langchain-ai/langchain/pull/20009](https://togithub.com/langchain-ai/langchain/pull/20009) - community\[minor]: Add metadata filtering support for neo4j vector by [@tomasonjo](https://togithub.com/tomasonjo) in [https://github.com/langchain-ai/langchain/pull/20001](https://togithub.com/langchain-ai/langchain/pull/20001) - langchain: enhance `LocalFileStore` to allow directory/file permissions to be specified by [@chrispy-snps](https://togithub.com/chrispy-snps) in [https://github.com/langchain-ai/langchain/pull/18857](https://togithub.com/langchain-ai/langchain/pull/18857) - docs\[patch]: Make Docusaurus and Vercel add trailing slashes when navigating by default by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/20014](https://togithub.com/langchain-ai/langchain/pull/20014) - community\[minor]: added missed class to **all** by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19888](https://togithub.com/langchain-ai/langchain/pull/19888) - anthropic\[minor]: tool use by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20016](https://togithub.com/langchain-ai/langchain/pull/20016) - anthropic\[patch]: bump core dep by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20019](https://togithub.com/langchain-ai/langchain/pull/20019) - Add cookbook for Anthropic .with_structured_output() by [@rlancemartin](https://togithub.com/rlancemartin) in [https://github.com/langchain-ai/langchain/pull/20017](https://togithub.com/langchain-ai/langchain/pull/20017) - anthropic\[patch]: fix experimental tests by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20021](https://togithub.com/langchain-ai/langchain/pull/20021) - docs: `graphs` update by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19675](https://togithub.com/langchain-ai/langchain/pull/19675) - docs `integrations/providers` update 10 by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19970](https://togithub.com/langchain-ai/langchain/pull/19970) - anthropic\[patch]: use anthropic 0.23 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20022](https://togithub.com/langchain-ai/langchain/pull/20022) - anthropic\[patch]: Release 0.1.6 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20026](https://togithub.com/langchain-ai/langchain/pull/20026) - docs: `integrations/providers/unstructured` update by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19892](https://togithub.com/langchain-ai/langchain/pull/19892) - docs: mark anthropic tools wrapper as deprecated by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20024](https://togithub.com/langchain-ai/langchain/pull/20024) - docs: `integrations/providers` update 9 by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19941](https://togithub.com/langchain-ai/langchain/pull/19941) - Update example cookbook for Anthropic tool use by [@rlancemartin](https://togithub.com/rlancemartin) in [https://github.com/langchain-ai/langchain/pull/20029](https://togithub.com/langchain-ai/langchain/pull/20029) - docs: hide experimental anthropic by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20030](https://togithub.com/langchain-ai/langchain/pull/20030) - docs: fixing typo in argument name by [@0ssamaak0](https://togithub.com/0ssamaak0) in [https://github.com/langchain-ai/langchain/pull/20028](https://togithub.com/langchain-ai/langchain/pull/20028) - docs\[patch]: Fix Model I/O quickstart by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/20031](https://togithub.com/langchain-ai/langchain/pull/20031) - docs: fix together model tab by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20032](https://togithub.com/langchain-ai/langchain/pull/20032) - docs: weaviate docs by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20042](https://togithub.com/langchain-ai/langchain/pull/20042) - Docs: Update custom chat model by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19967](https://togithub.com/langchain-ai/langchain/pull/19967) - docs: fix title cap by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20048](https://togithub.com/langchain-ai/langchain/pull/20048) - core: Implement aformat_messages for ChatMessagePromptTemplate by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20038](https://togithub.com/langchain-ai/langchain/pull/20038) - core: Add async aformat_document method by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20037](https://togithub.com/langchain-ai/langchain/pull/20037) - core: Implement aformat_prompt and ainvoke in BasePromptTemplate by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20035](https://togithub.com/langchain-ai/langchain/pull/20035) - core\[patch]: Document BaseCache abstraction in code by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20046](https://togithub.com/langchain-ai/langchain/pull/20046) - langchain-core\[minor]: Allow passing local cache to language models by [@liugddx](https://togithub.com/liugddx) in [https://github.com/langchain-ai/langchain/pull/19331](https://togithub.com/langchain-ai/langchain/pull/19331) - community\[patch]: Improve import callbacks to make it IDE friendly by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20050](https://togithub.com/langchain-ai/langchain/pull/20050) - docs\[patch]: Add missing redirects by [@jacoblee93](https://togithub.com/jacoblee93) in [https://github.com/langchain-ai/langchain/pull/20076](https://togithub.com/langchain-ai/langchain/pull/20076) - cohere: move package to external repo by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20081](https://togithub.com/langchain-ai/langchain/pull/20081) - docs: anthropic tool docstring by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20091](https://togithub.com/langchain-ai/langchain/pull/20091) - template: add rag azure search template by [@kristapratico](https://togithub.com/kristapratico) in [https://github.com/langchain-ai/langchain/pull/18143](https://togithub.com/langchain-ai/langchain/pull/18143) - partners\[anthropic]: fix anthropic chat model message type lookup keys by [@maximeperrindev](https://togithub.com/maximeperrindev) in [https://github.com/langchain-ai/langchain/pull/19034](https://togithub.com/langchain-ai/langchain/pull/19034) - templates: migrate to langchain_anthropic package to support Claude 3 models by [@donbr](https://togithub.com/donbr) in [https://github.com/langchain-ai/langchain/pull/19393](https://togithub.com/langchain-ai/langchain/pull/19393) - pinecone\[patch]: release 0.1.0 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20109](https://togithub.com/langchain-ai/langchain/pull/20109) - Documentation: Fixed the typo of Discord -> Telegram by [@TAAGECH9](https://togithub.com/TAAGECH9) in [https://github.com/langchain-ai/langchain/pull/20008](https://togithub.com/langchain-ai/langchain/pull/20008) - \[core] fix: manually specifying run_id for chat models.invoke() and .ainvoke() by [@hinthornw](https://togithub.com/hinthornw) in [https://github.com/langchain-ai/langchain/pull/20082](https://togithub.com/langchain-ai/langchain/pull/20082) - postgres\[minor]: add postgres checkpoint implementation by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20025](https://togithub.com/langchain-ai/langchain/pull/20025) - postgres\[minor]: Add pgvector community as is by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20096](https://togithub.com/langchain-ai/langchain/pull/20096) - community\[minor]: Add support for Pebblo cloud_api_key in PebbloSafeLoader by [@rahul-trip](https://togithub.com/rahul-trip) in [https://github.com/langchain-ai/langchain/pull/19855](https://togithub.com/langchain-ai/langchain/pull/19855) - Community: Updating Azure Retriever and Docs to be Azure AI Search instead of Azure Cognitive Search by [@marlenezw](https://togithub.com/marlenezw) in [https://github.com/langchain-ai/langchain/pull/19925](https://togithub.com/langchain-ai/langchain/pull/19925) - community: Add PHP language parser to document_loaders by [@david02871](https://togithub.com/david02871) in [https://github.com/langchain-ai/langchain/pull/19850](https://togithub.com/langchain-ai/langchain/pull/19850) - docs: use standard openai params by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20160](https://togithub.com/langchain-ai/langchain/pull/20160) - docs: standardize fireworks params by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20162](https://togithub.com/langchain-ai/langchain/pull/20162) - mistralai\[patch]: standardize model params by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20163](https://togithub.com/langchain-ai/langchain/pull/20163) - anthropic\[patch]: standardize init args by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20161](https://togithub.com/langchain-ai/langchain/pull/20161) - community: extend Predibase integration to support fine-tuned LLM adapters by [@alexsherstinsky](https://togithub.com/alexsherstinsky) in [https://github.com/langchain-ai/langchain/pull/19979](https://togithub.com/langchain-ai/langchain/pull/19979) - langchain: fix pinecone upsert when async_req is set to False by [@harryhaibojiang](https://togithub.com/harryhaibojiang) in [https://github.com/langchain-ai/langchain/pull/19793](https://togithub.com/langchain-ai/langchain/pull/19793) - pinecone\[patch]: fix core min version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20177](https://togithub.com/langchain-ai/langchain/pull/20177) - Adding MongoDB Cookbook for Chat history and semantic cache by [@RichmondAlake](https://togithub.com/RichmondAlake) in [https://github.com/langchain-ai/langchain/pull/19998](https://togithub.com/langchain-ai/langchain/pull/19998) - community: add request_timeout and max_retries to ChatAnthropic by [@kaijietti](https://togithub.com/kaijietti) in [https://github.com/langchain-ai/langchain/pull/19402](https://togithub.com/langchain-ai/langchain/pull/19402) - docs: add vertexai to structured output by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20171](https://togithub.com/langchain-ai/langchain/pull/20171) - community: `cross_encoders` flatten namespaces by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/20183](https://togithub.com/langchain-ai/langchain/pull/20183) - docs: TogetherAI as a drop-in replacement for OpenAI by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19900](https://togithub.com/langchain-ai/langchain/pull/19900) - Community: Add support for MLX models (chat & llm) by [@Blaizzy](https://togithub.com/Blaizzy) in [https://github.com/langchain-ai/langchain/pull/18152](https://togithub.com/langchain-ai/langchain/pull/18152) - community: add bedrock anthropic callback for token usage counting by [@Sukitly](https://togithub.com/Sukitly) in [https://github.com/langchain-ai/langchain/pull/19864](https://togithub.com/langchain-ai/langchain/pull/19864) - Fix pr 19772 by [@3coins](https://togithub.com/3coins) in [https://github.com/langchain-ai/langchain/pull/20047](https://togithub.com/langchain-ai/langchain/pull/20047) - baichuan\[patch]: standardize init args by [@liugddx](https://togithub.com/liugddx) in [https://github.com/langchain-ai/langchain/pull/20209](https://togithub.com/langchain-ai/langchain/pull/20209) - docs: Fix the class links in openai_tools and openai_functions description in output parser documentations by [@Haris-Ali007](https://togithub.com/Haris-Ali007) in [https://github.com/langchain-ai/langchain/pull/20197](https://togithub.com/langchain-ai/langchain/pull/20197) - community\[patch]: pass through sql agent kwargs by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19962](https://togithub.com/langchain-ai/langchain/pull/19962) - community: Enhance Tencent Cloud VectorDB, langchain: make Tencent Cloud VectorDB self query retrieve compatible by [@jeffkit](https://togithub.com/jeffkit) in [https://github.com/langchain-ai/langchain/pull/19651](https://togithub.com/langchain-ai/langchain/pull/19651) - GCSDirectoryLoader bugfix by [@timothywong731](https://togithub.com/timothywong731) in [https://github.com/langchain-ai/langchain/pull/20005](https://togithub.com/langchain-ai/langchain/pull/20005) - doc:(sharememory\&bittensor) Get rid of ZeroShotAgent and use create_react_agent instead by [@liugddx](https://togithub.com/liugddx) in [https://github.com/langchain-ai/langchain/pull/20157](https://togithub.com/langchain-ai/langchain/pull/20157) - community: add allow_dangerous_requests for OpenAPI toolkits by [@daviddwlee84](https://togithub.com/daviddwlee84) in [https://github.com/langchain-ai/langchain/pull/19493](https://togithub.com/langchain-ai/langchain/pull/19493) - docs: Add documentation of `ElasticsearchStore.BM25RetrievalStrategy` by [@g-votte](https://togithub.com/g-votte) in [https://github.com/langchain-ai/langchain/pull/20098](https://togithub.com/langchain-ai/langchain/pull/20098) - openai: wrap stream code in context manager blocks by [@snopoke](https://togithub.com/snopoke) in [https://github.com/langchain-ai/langchain/pull/18013](https://togithub.com/langchain-ai/langchain/pull/18013) - Remove postgres package by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20207](https://togithub.com/langchain-ai/langchain/pull/20207) - langchain-postgres: Remove remaining README.md file by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20221](https://togithub.com/langchain-ai/langchain/pull/20221) - together: release 0.1.0 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20225](https://togithub.com/langchain-ai/langchain/pull/20225) - standard-tests: a standard unit and integration test set by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20182](https://togithub.com/langchain-ai/langchain/pull/20182) - core: Implement aformat for FewShotPromptWithTemplates by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20039](https://togithub.com/langchain-ai/langchain/pull/20039) - core: Implement aformat_messages for \_StringImageMessagePromptTemplate by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/20036](https://togithub.com/langchain-ai/langchain/pull/20036) - community: switch to falkordb python client by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/20229](https://togithub.com/langchain-ai/langchain/pull/20229) - community\[patch]: OpenLLM Async Client Fixes and Timeout Parameter by [@charlod](https://togithub.com/charlod) in [https://github.com/langchain-ai/langchain/pull/20007](https://togithub.com/langchain-ai/langchain/pull/20007) - langchain\[patch]: make BooleanOutputParser check words not substrings by [@casperdcl](https://togithub.com/casperdcl) in [https://github.com/langchain-ai/langchain/pull/20064](https://togithub.com/langchain-ai/langchain/pull/20064) - langchain\[patch]: Update unit test by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/20228](https://togithub.com/langchain-ai/langchain/pull/20228) - docs: Fix typo in citations example by [@sjnarmstrong](https://togithub.com/sjnarmstrong) in [https://github.com/langchain-ai/langchain/pull/20218](https://togithub.com/langchain-ai/langchain/pull/20218) - community: fixed multithreading returning List\[List\[Documents]] instead of List\[Documents] by [@chip-davis](https://togithub.com/chip-davis) in [https://github.com/langchain-ai/langchain/pull/20230](https://togithub.com/langchain-ai/langchain/pull/20230) - core\[patch]: Release 0.1.41 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20233](https://togithub.com/langchain-ai/langchain/pull/20233) - community\[patch]: Release 0.0.32 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20236](https://togithub.com/langchain-ai/langchain/pull/20236) - langchain\[patch]: Release 0.1.15 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20237](https://togithub.com/langchain-ai/langchain/pull/20237) - mistralai\[patch]: Release 0.1.1 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20239](https://togithub.com/langchain-ai/langchain/pull/20239) - anthropic\[patch]: Release 0.1.7 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/20240](https://togithub.com/langchain-ai/langchain/pull/20240) #### New Contributors - [@angeligareta](https://togithub.com/angeligareta) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19599](https://togithub.com/langchain-ai/langchain/pull/19599) - [@zhangch9](https://togithub.com/zhangch9) made their first contribution in [https://github.com/langchain-ai/langchain/pull/16695](https://togithub.com/langchain-ai/langchain/pull/16695) - [@mkorpela](https://togithub.com/mkorpela) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19707](https://togithub.com/langchain-ai/langchain/pull/19707) - [@anilaltuner](https://togithub.com/anilaltuner) made their first contribution in [https://github.com/langchain-ai/langchain/pull/17098](https://togithub.com/langchain-ai/langchain/pull/17098) - [@spike-spiegel-21](https://togithub.com/spike-spiegel-21) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19849](https://togithub.com/langchain-ai/langchain/pull/19849) - [@JamsheedMistri](https://togithub.com/JamsheedMistri) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19787](https://togithub.com/langchain-ai/langchain/pull/19787) - [@jokester](https://togithub.com/jokester) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19926](https://togithub.com/langchain-ai/langchain/pull/19926) - [@PenghuiCheng](https://togithub.com/PenghuiCheng) made their first contribution in [https://github.com/langchain-ai/langchain/pull/14504](https://togithub.com/langchain-ai/langchain/pull/14504) - [@UtkarshaGupte](https://togithub.com/UtkarshaGupte) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19931](https://togithub.com/langchain-ai/langchain/pull/19931) - [@crispyricepc](https://togithub.com/crispyricepc) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20009](https://togithub.com/langchain-ai/langchain/pull/20009) - [@0ssamaak0](https://togithub.com/0ssamaak0) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20028](https://togithub.com/langchain-ai/langchain/pull/20028) - [@donbr](https://togithub.com/donbr) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19393](https://togithub.com/langchain-ai/langchain/pull/19393) - [@TAAGECH9](https://togithub.com/TAAGECH9) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20008](https://togithub.com/langchain-ai/langchain/pull/20008) - [@rahul-trip](https://togithub.com/rahul-trip) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19855](https://togithub.com/langchain-ai/langchain/pull/19855) - [@david02871](https://togithub.com/david02871) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19850](https://togithub.com/langchain-ai/langchain/pull/19850) - [@harryhaibojiang](https://togithub.com/harryhaibojiang) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19793](https://togithub.com/langchain-ai/langchain/pull/19793) - [@RichmondAlake](https://togithub.com/RichmondAlake) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19998](https://togithub.com/langchain-ai/langchain/pull/19998) - [@Blaizzy](https://togithub.com/Blaizzy) made their first contribution in [https://github.com/langchain-ai/langchain/pull/18152](https://togithub.com/langchain-ai/langchain/pull/18152) - [@Haris-Ali007](https://togithub.com/Haris-Ali007) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20197](https://togithub.com/langchain-ai/langchain/pull/20197) - [@jeffkit](https://togithub.com/jeffkit) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19651](https://togithub.com/langchain-ai/langchain/pull/19651) - [@daviddwlee84](https://togithub.com/daviddwlee84) made their first contribution in [https://github.com/langchain-ai/langchain/pull/19493](https://togithub.com/langchain-ai/langchain/pull/19493) - [@snopoke](https://togithub.com/snopoke) made their first contribution in [https://github.com/langchain-ai/langchain/pull/18013](https://togithub.com/langchain-ai/langchain/pull/18013) - [@charlod](https://togithub.com/charlod) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20007](https://togithub.com/langchain-ai/langchain/pull/20007) - [@casperdcl](https://togithub.com/casperdcl) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20064](https://togithub.com/langchain-ai/langchain/pull/20064) - [@sjnarmstrong](https://togithub.com/sjnarmstrong) made their first contribution in [https://github.com/langchain-ai/langchain/pull/20218](https://togithub.com/langchain-ai/langchain/pull/20218) **Full Changelog**: https://github.com/langchain-ai/langchain/compare/v0.1.14...v0.1.15 ### [`v0.1.14`](https://togithub.com/langchain-ai/langchain/releases/tag/v0.1.14) [Compare Source](https://togithub.com/langchain-ai/langchain/compare/v0.1.13...v0.1.14) #### What's Changed - robocorp\[patch]: release 0.0.4 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19357](https://togithub.com/langchain-ai/langchain/pull/19357) - robocorp\[patch]: run integration tests on release by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19358](https://togithub.com/langchain-ai/langchain/pull/19358) - experimental\[patch]: Release 0.0.55 by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19353](https://togithub.com/langchain-ai/langchain/pull/19353) - openai\[patch]: release 0.1.0, message id and name support by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19363](https://togithub.com/langchain-ai/langchain/pull/19363) - openai\[patch]: fix name param by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19365](https://togithub.com/langchain-ai/langchain/pull/19365) - openai\[patch]: fix core min version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19366](https://togithub.com/langchain-ai/langchain/pull/19366) - feat: update base_url of anthropic by [@enfeng](https://togithub.com/enfeng) in [https://github.com/langchain-ai/langchain/pull/18634](https://togithub.com/langchain-ai/langchain/pull/18634) - community:Replace positional argument with text=text for cohere>=5 compatibility by [@billytrend-cohere](https://togithub.com/billytrend-cohere) in [https://github.com/langchain-ai/langchain/pull/19407](https://togithub.com/langchain-ai/langchain/pull/19407) - core\[patch]: allow "placeholder" type in from_messages tuples by [@hinthornw](https://togithub.com/hinthornw) in [https://github.com/langchain-ai/langchain/pull/19152](https://togithub.com/langchain-ai/langchain/pull/19152) - mistralai\[minor]: 0.1.0rc0, remove mistral sdk by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19420](https://togithub.com/langchain-ai/langchain/pull/19420) - core\[minor]: Add utility code to create tool examples by [@hwchase17](https://togithub.com/hwchase17) in [https://github.com/langchain-ai/langchain/pull/18602](https://togithub.com/langchain-ai/langchain/pull/18602) - \[langchain] fix OpenAIAssistantRunnable.create_assistant by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/19081](https://togithub.com/langchain-ai/langchain/pull/19081) - cookbook\[patch]: add strip of quotes by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19452](https://togithub.com/langchain-ai/langchain/pull/19452) - mistralai: update tool calling by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/19451](https://togithub.com/langchain-ai/langchain/pull/19451) - community\[patch]: invoke callback prior to yielding token (llama.cpp) by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19392](https://togithub.com/langchain-ai/langchain/pull/19392) - mistralai\[patch]: release 0.1.0rc1 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19453](https://togithub.com/langchain-ai/langchain/pull/19453) - mistralai\[patch]: fix core version by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19454](https://togithub.com/langchain-ai/langchain/pull/19454) - docs: delete mistralai embeddings doc from incorrect location by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19432](https://togithub.com/langchain-ai/langchain/pull/19432) - langchain_openai: \[URGENT REGRESSION FIX] Don't fail if tool message already doesn't contain name by [@ldorigo](https://togithub.com/ldorigo) in [https://github.com/langchain-ai/langchain/pull/19435](https://togithub.com/langchain-ai/langchain/pull/19435) - openai\[patch]: release 0.1.1 by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19458](https://togithub.com/langchain-ai/langchain/pull/19458) - openai\[patch]: integration test structured output by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19459](https://togithub.com/langchain-ai/langchain/pull/19459) - openai\[patch]: tool use integration test by [@baskaryan](https://togithub.com/baskaryan) in [https://github.com/langchain-ai/langchain/pull/19460](https://togithub.com/langchain-ai/langchain/pull/19460) - docs: use invoke instead of run by [@raybellwaves](https://togithub.com/raybellwaves) in [https://github.com/langchain-ai/langchain/pull/19457](https://togithub.com/langchain-ai/langchain/pull/19457) - docs: point to titantic dataset on web by [@raybellwaves](https://togithub.com/raybellwaves) in [https://github.com/langchain-ai/langchain/pull/19455](https://togithub.com/langchain-ai/langchain/pull/19455) - community:Modified regular expression by [@igeni](https://togithub.com/igeni) in [https://github.com/langchain-ai/langchain/pull/19449](https://togithub.com/langchain-ai/langchain/pull/19449) - openai\[patch]: add test coverage to output by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19462](https://togithub.com/langchain-ai/langchain/pull/19462) - community: RecursiveUrlLoader: add base_url option by [@germankrause](https://togithub.com/germankrause) in [https://github.com/langchain-ai/langchain/pull/19421](https://togithub.com/langchain-ai/langchain/pull/19421) - docarray requires hnsw installation by [@lucifertrj](https://togithub.com/lucifertrj) in [https://github.com/langchain-ai/langchain/pull/19416](https://togithub.com/langchain-ai/langchain/pull/19416) - langchain: Add async methods to VectorStoreRetrieverMemory by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/19408](https://togithub.com/langchain-ai/langchain/pull/19408) - makefile `api_docs_clean` fix by [@leo-gan](https://togithub.com/leo-gan) in [https://github.com/langchain-ai/langchain/pull/19405](https://togithub.com/langchain-ai/langchain/pull/19405) - docs: moving FireworksEmbeddings documentation to docs folder by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19398](https://togithub.com/langchain-ai/langchain/pull/19398) - community\[patch]: invoke callback prior to yielding token (fireworks) by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19388](https://togithub.com/langchain-ai/langchain/pull/19388) - community\[patch]: invoke callback prior to yielding token (openai) by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19389](https://togithub.com/langchain-ai/langchain/pull/19389) - docs: Add `partition` parameter to DashVector by [@wangcailin](https://togithub.com/wangcailin) in [https://github.com/langchain-ai/langchain/pull/19385](https://togithub.com/langchain-ai/langchain/pull/19385) - community: fix bugs in baiduvectordb as vectorstore by [@fengjial](https://togithub.com/fengjial) in [https://github.com/langchain-ai/langchain/pull/19380](https://togithub.com/langchain-ai/langchain/pull/19380) - docs: update import paths and move to lcel for llama.cpp examples by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19391](https://togithub.com/langchain-ai/langchain/pull/19391) - docs: update module imports for fireworks documentation by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19377](https://togithub.com/langchain-ai/langchain/pull/19377) - docs: fix error bilibili url by [@Undertone0809](https://togithub.com/Undertone0809) in [https://github.com/langchain-ai/langchain/pull/19375](https://togithub.com/langchain-ai/langchain/pull/19375) - docs: adding voyageai to the list of partner packages by [@sepiatone](https://togithub.com/sepiatone) in [https://github.com/langchain-ai/langchain/pull/19376](https://togithub.com/langchain-ai/langchain/pull/19376) - mistralai\[patch]: streaming tool calls by [@efriis](https://togithub.com/efriis) in [https://github.com/langchain-ai/langchain/pull/19469](https://togithub.com/langchain-ai/langchain/pull/19469) - Remove non-rendering images & output spamming from doc ntbks by [@rlancemartin](https://togithub.com/rlancemartin) in [https://github.com/langchain-ai/langchain/pull/19475](https://togithub.com/langchain-ai/langchain/pull/19475) - Use async memory in Chain when needed by [@cbornet](https://togithub.com/cbornet) in [https://github.com/langchain-ai/langchain/pull/19429](https://togithub.com/langchain-ai/langchain/pull/19429) - code\[patch]: Add in code documentation to core Runnable `pipe` and `pick` methods (docs only) by [@liugddx](https://togithub.com/liugddx) in [https://github.com/langchain-ai/langchain/pull/19395](https://togithub.com/langchain-ai/langchain/pull/19395) - community\[minor]: S3FileLoader to use expose mode and post_processors arguments of unstructured loader by [@preak95](https://togithub.com/preak95) in [https://github.com/langchain-ai/langchain/pull/19270](https://togithub.com/langchain-ai/langchain/pull/19270) - Add OpenVINO llms docs by [@OpenVINO-dev-contest](https://togithub.com/OpenVINO-dev-contest) in [https://github.com/langchain-ai/langchain/pull/19489](https://togithub.com/langchain-ai/langchain/pull/19489) - community\[minor]: Add `DuckDB` as a vectorstore by [@Hugoberry](https://togithub.com/Hugoberry) in [https://github.com/langchain-ai/langchain/pull/18916](https://togithub.com/langchain-ai/langchain/pull/18916) - infra: Update package version to apply CVE-related patch by [@JacobLezberg](https://togithub.com/JacobLezberg) in [https://github.com/langchain-ai/langchain/pull/19490](https://togithub.com/langchain-ai/langchain/pull/19490) - langchain-community: Dappier chat model integration by [@IgorMunizS](https://togithub.com/IgorMunizS) in [https://github.com/langchain-ai/langchain/pull/19370](https://togithub.com/langchain-ai/langchain/pull/19370) - Update docs for `HuggingFacePipeline` by [@nikhilkmr300](https://togithub.com/nikhilkmr300) in [https://github.com/langchain-ai/langchain/pull/19306](https://togithub.com/langchain-ai/langchain/pull/19306) - add kwargs by [@ccurme](https://togithub.com/ccurme) in [https://github.com/langchain-ai/langchain/pull/19519](https://togithub.com/langchain-ai/langchain/pull/19519) - langchain: Passthrough batch_size on index()/aindex() calls by [@znwilkins](https://togithub.com/znwilkins) in [https://github.com/langchain-ai/langchain/pull/19443](https://togithub.com/langchain-ai/langchain/pull/19443) - core\[patch]: Use defusedxml in XMLOutputParser by [@eyurtsev](https://togithub.com/eyurtsev) in [https://github.com/langchain-ai/langchain/pull/19526](https://togithub.com/langchain-ai/langchain/pull/19526) - langchain_cohere: add cohere as a partner package by [@billytrend-cohere]( </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://developer.mend.io/github/GoogleCloudPlatform/generative-ai).

Add ignore_comments option (default False): do not extract html comments

ed8ffe1

dosubot bot added the 🤖:improvement Medium size change to existing code to handle new use-cases label Nov 12, 2023

petervandenabeele changed the title ~~Add ignore_comments option (default False): do not extract html comments~~ Add remove_comments option (default True): do not extract html comments Nov 13, 2023

fix: complete the rename from ignore_comments to remove_comments

bc6270d

baskaryan reviewed Nov 13, 2023

View reviewed changes

hwchase17 closed this Jan 30, 2024

baskaryan reopened this Jan 30, 2024

merge

83223ec

dosubot bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Apr 2, 2024

baskaryan added 5 commits April 1, 2024 17:09

fmt

c9685eb

fmt

6dce7b1

fmt

aba75d6

fmt

7cacd8e

fmt

815e710

baskaryan approved these changes Apr 2, 2024

View reviewed changes

dosubot bot added the lgtm PR looks good. Use to confirm that a PR is ready for merging. label Apr 2, 2024

fmt

9c6f508

baskaryan enabled auto-merge (squash) April 2, 2024 00:17

baskaryan merged commit e830a4e into langchain-ai:master Apr 2, 2024
60 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add remove_comments option (default True): do not extract html comments #13259

Add remove_comments option (default True): do not extract html comments #13259

petervandenabeele commented Nov 12, 2023 •

edited

vercel bot commented Nov 12, 2023 •

edited

baskaryan Nov 13, 2023

nfcampos Nov 13, 2023

petervandenabeele Nov 13, 2023

hwchase17 Nov 29, 2023

petervandenabeele commented Jan 30, 2024

baskaryan commented Jan 30, 2024

petervandenabeele commented Apr 2, 2024

Add remove_comments option (default True): do not extract html comments #13259

Add remove_comments option (default True): do not extract html comments #13259

Conversation

petervandenabeele commented Nov 12, 2023 • edited

vercel bot commented Nov 12, 2023 • edited

baskaryan Nov 13, 2023

Choose a reason for hiding this comment

nfcampos Nov 13, 2023

Choose a reason for hiding this comment

petervandenabeele Nov 13, 2023

Choose a reason for hiding this comment

hwchase17 Nov 29, 2023

Choose a reason for hiding this comment

petervandenabeele commented Jan 30, 2024

baskaryan commented Jan 30, 2024

petervandenabeele commented Apr 2, 2024

petervandenabeele commented Nov 12, 2023 •

edited

vercel bot commented Nov 12, 2023 •

edited