Flaky test in langchain-chroma: test_chroma_update_document@257 fails on MacOS (you won't believe what caused it)

[sarahec]

Checked other resources

• I added a very descriptive title to this issue.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.
• I am sure that this is a bug in LangChain rather than my code.
• The bug is not resolved by updating to the latest stable version of LangChain (or the specific integration package).

Example Code

Build error (see description)

Error Message and Stack Trace (if applicable)

No response

Description

On MacOS 10.5 (aarch64-Darwin), After building chromadb 0.5.11 (current), building langchain-chroma 0.1.4 fails in the testing phase. test_chroma_update_document at line 257:

>   assert new_embedding == embedding.embed_documents([updated_content])[0]
E   ValueError: the truth value of an array with more than one element is ambiguous. Use a.any() or a.all()

But after some significant testing, the problem turns out to be that test_chroma_async needed an async annotation. Add that and test_chroma_update_document works again.

This appeared in the context of testing nixpkgs 45372

Build log

System Info

System Information

OS: Darwin
OS Version: Darwin Kernel Version 24.0.0: Mon Aug 12 20:52:41 PDT 2024; root:xnu-11215.1.10~2/RELEASE_ARM64_T6031
Python Version: 3.12.5 (main, Aug 6 2024, 19:08:49) [Clang 16.0.6 ]

Package Information

langchain_core: 0.3.7
langchain: 0.3.1
langchain_community: 0.3.0
langsmith: 0.1.125
langchain_chroma: 0.1.4
langchain_groq: 0.2.0
langchain_text_splitters: 0.3.0
langgraph: 0.2.23

Optional packages not installed

langserve

Other Dependencies

aiohttp: 3.10.5
async-timeout: Installed. No version info available.
chromadb: 0.5.11
dataclasses-json: 0.6.7
fastapi: 0.115.0
groq: 0.11.0
httpx: 0.27.2
jsonpatch: 1.33
langgraph-checkpoint: 1.0.10
numpy: 1.26.4
orjson: 3.10.7
packaging: 24.1
pydantic: 2.9.2
pydantic-settings: 2.5.2
PyYAML: 6.0.2
requests: 2.32.3
SQLAlchemy: 2.0.35
tenacity: 8.5.0
typing-extensions: 4.12.2