fix(vertexai): replace removed bison integration test models#1863
Merged
Mason Daugherty (mdrxy) merged 1 commit intoJun 21, 2026
Google Cloud Build / langchain-google-vertexai-us (llm-integration-tests)
succeeded
Jun 21, 2026 in 22m 27s
Summary
Build Information
| Trigger | langchain-google-vertexai-us |
| Build | 25acec58-069f-47a8-b39e-0843827348f3 |
| Start | 2026-06-20T16:42:29-07:00 |
| Duration | 21m39.471s |
| Status | SUCCESS |
Steps
| Step | Status | Duration |
|---|---|---|
| integration tests | SUCCESS | 21m34.576s |
Details
starting build "25acec58-069f-47a8-b39e-0843827348f3"
FETCHSOURCE
From https://github.com/langchain-ai/langchain-google
* branch b2993aa835ed24cbf14c02b58b4f38940ce85106 -> FETCH_HEAD
HEAD is now at b2993aa fix(vertexai): replace removed bison integration test models
GitCommit:
b2993aa835ed24cbf14c02b58b4f38940ce85106
BUILD
Pulling image: python:3.11
3.11: Pulling from library/python
ef1b08ddd59d: Already exists
8b365b6ff7b7: Already exists
2ca884014342: Already exists
442cca122a8b: Already exists
f6fb30da281d: Pulling fs layer
00fb515ecb79: Pulling fs layer
e5c164e2c953: Pulling fs layer
e5c164e2c953: Verifying Checksum
e5c164e2c953: Download complete
f6fb30da281d: Verifying Checksum
f6fb30da281d: Download complete
00fb515ecb79: Download complete
f6fb30da281d: Pull complete
00fb515ecb79: Pull complete
e5c164e2c953: Pull complete
Digest: sha256:a30c4ff1a6a474019f9b1f0d921e81a254cf420d408c09e8a8b79fd803b62ebf
Status: Downloaded newer image for python:3.11
docker.io/library/python:3.11
Using pip 24.0 from /usr/local/lib/python3.11/site-packages/pip (python 3.11)
Collecting uv==0.8.13
Obtaining dependency information for uv==0.8.13 from https://files.pythonhosted.org/packages/82/6b/81387a715dd045f7edea452fb76a5896dcfc11b8ecf0db5106f4b0f633ec/uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.5/19.5 MB 83.7 MB/s eta 0:00:00
Installing collected packages: uv
Successfully installed uv-0.8.13
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip is available: 24.0 -> 26.1.2
[notice] To update, run: pip install --upgrade pip
Using CPython 3.11.15 interpreter at: /usr/local/bin/python3
Creating virtual environment at: .venv
Resolved 127 packages in 2ms
Building langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading cryptography (4.5MiB)
Downloading tokenizers (3.1MiB)
Downloading pyarrow (45.4MiB)
Downloading pygments (1.2MiB)
Downloading zstandard (5.3MiB)
Downloading google-cloud-aiplatform (7.8MiB)
Downloading pydantic-core (2.0MiB)
Downloading hf-xet (3.2MiB)
Downloading google-api-python-client (14.0MiB)
Downloading grpcio (6.3MiB)
Downloading numpy (16.1MiB)
Downloading pydantic-core
Downloading tokenizers
Downloading hf-xet
Downloading zstandard
Downloading cryptography
Downloading pygments
Downloading grpcio
Built langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading google-api-python-client
Downloading numpy
Downloading pyarrow
Downloading google-cloud-aiplatform
Prepared 115 packages in 2.43s
warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
If the cache and target directories are on different filesystems, hardlinking may not be supported.
If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Installed 115 packages in 445ms
+ annotated-types==0.7.0
+ anthropic==0.75.0
+ anyio==4.12.0
+ bottleneck==1.6.0
+ certifi==2025.11.12
+ cffi==2.0.0
+ charset-normalizer==3.4.4
+ click==8.3.1
+ cryptography==48.0.1
+ distro==1.9.0
+ docstring-parser==0.17.0
+ execnet==2.1.2
+ filelock==3.20.3
+ freezegun==1.5.5
+ fsspec==2025.12.0
+ google-api-core==2.28.1
+ google-api-python-client==2.187.0
+ google-auth==2.48.0
+ google-auth-httplib2==0.2.1
+ google-cloud-aiplatform==1.139.0
+ google-cloud-bigquery==3.38.0
+ google-cloud-core==2.5.0
+ google-cloud-datastore==2.21.0
+ google-cloud-resource-manager==1.15.0
+ google-cloud-storage==3.6.0
+ google-cloud-vectorsearch==0.2.0
+ google-crc32c==1.7.1
+ google-genai==1.65.0
+ google-resumable-media==2.8.0
+ googleapis-common-protos==1.72.0
+ grpc-google-iam-v1==0.14.3
+ grpcio==1.76.0
+ grpcio-status==1.76.0
+ h11==0.16.0
+ hf-xet==1.2.0
+ httpcore==1.0.9
+ httplib2==0.31.0
+ httpx==0.28.1
+ httpx-sse==0.4.3
+ huggingface-hub==1.2.1
+ idna==3.15
+ iniconfig==2.3.0
+ jiter==0.12.0
+ jsonpatch==1.33
+ jsonpointer==3.0.0
+ langchain==1.1.2
+ langchain-core==1.4.7
+ langchain-google-vertexai==3.2.4 (from file:///workspace/libs/vertexai)
+ langchain-mistralai==1.1.0
+ langchain-protocol==0.0.16
+ langchain-tests==1.1.6
+ langgraph==1.0.10rc1
+ langgraph-checkpoint==4.0.0
+ langgraph-prebuilt==1.0.8
+ langgraph-sdk==0.3.9
+ langsmith==0.8.0
+ markdown-it-py==4.0.0
+ mdurl==0.1.2
+ numexpr==2.14.1
+ numpy==2.3.5
+ orjson==3.11.7
+ ormsgpack==1.12.0
+ packaging==25.0
+ pluggy==1.6.0
+ proto-plus==1.26.1
+ protobuf==6.33.5
+ py-cpuinfo==9.0.0
+ pyarrow==23.0.1
+ pyasn1==0.6.3
+ pyasn1-modules==0.4.2
+ pycparser==2.23
+ pydantic==2.12.5
+ pydantic-core==2.41.5
+ pygments==2.20.0
+ pyparsing==3.2.5
+ pytest==9.0.3
+ pytest-asyncio==1.3.0
+ pytest-benchmark==5.2.3
+ pytest-codspeed==4.2.0
+ pytest-mock==3.15.1
+ pytest-order==1.3.0
+ pytest-recording==0.13.4
+ pytest-retry==1.7.0
+ pytest-socket==0.7.0
+ pytest-timeout==2.4.0
+ pytest-watcher==0.4.3
+ pytest-xdist==3.8.0
+ python-dateutil==2.9.0.post0
+ pyyaml==6.0.3
+ requests==2.33.0
+ requests-toolbelt==1.0.0
+ rich==14.2.0
+ rsa==4.9.1
+ shellingham==1.5.4
+ six==1.17.0
+ sniffio==1.3.1
+ syrupy==5.1.0
+ tenacity==9.1.2
+ tokenizers==0.22.1
+ tqdm==4.67.1
+ typer-slim==0.20.0
+ types-protobuf==4.25.0.20240417
+ types-requests==2.32.4.20250913
+ typing-extensions==4.15.0
+ typing-inspection==0.4.2
+ uritemplate==4.2.0
+ urllib3==2.7.0
+ uuid-utils==0.12.0
+ validators==0.35.0
+ vcrpy==8.1.1
+ watchdog==6.0.0
+ websockets==15.0.1
+ wrapt==2.0.1
+ xxhash==3.6.0
+ zstandard==0.25.0
============================= test session starts ==============================
platform linux -- Python 3.11.15, pytest-9.0.3, pluggy-1.6.0
codspeed: 4.2.0 (disabled, mode: walltime, callgraph: not supported, timer_resolution: 1.0ns)
benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /workspace/libs/vertexai
configfile: pyproject.toml
plugins: benchmark-5.2.3, asyncio-1.3.0, codspeed-4.2.0, socket-0.7.0, order-1.3.0, mock-3.15.1, recording-0.13.4, timeout-2.4.0, langsmith-0.8.0, xdist-3.8.0, retry-1.7.0, syrupy-5.1.0, anyio-4.12.0
asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collected 284 items
tests/integration_tests/test_anthropic_cache.py .... [ 1%]
tests/integration_tests/test_anthropic_files.py ... [ 2%]
tests/integration_tests/test_anthropic_long_context.py ss [ 3%]
tests/integration_tests/test_callbacks.py .... [ 4%]
tests/integration_tests/test_chains.py ... [ 5%]
tests/integration_tests/test_chat_models.py ..x..X............x.X....... [ 15%]
.........................Xx....XX.......... [ 30%]
tests/integration_tests/test_compile.py . [ 30%]
tests/integration_tests/test_embeddings.py ......... [ 34%]
tests/integration_tests/test_evaluation.py ...x [ 35%]
tests/integration_tests/test_image_utils.py s [ 35%]
tests/integration_tests/test_llms.py ...X...... [ 39%]
tests/integration_tests/test_llms_safety.py .. [ 40%]
tests/integration_tests/test_maas.py .X.....X.....X.....X..... [ 48%]
tests/integration_tests/test_model_garden.py ................ [ 54%]
tests/integration_tests/test_standard.py sssssssssssssssssssssssssssssss [ 65%]
sssssssssssssssss.......ssss............................sss...s.x [ 88%]
tests/integration_tests/test_vectorstores.py .................ss. [ 95%]
tests/integration_tests/test_vectorstores_v2.py .s....... [ 98%]
starting build "25acec58-069f-47a8-b39e-0843827348f3"
FETCHSOURCE
From https://github.com/langchain-ai/langchain-google
* branch b2993aa835ed24cbf14c02b58b4f38940ce85106 -> FETCH_HEAD
HEAD is now at b2993aa fix(vertexai): replace removed bison integration test models
GitCommit:
b2993aa835ed24cbf14c02b58b4f38940ce85106
BUILD
Pulling image: python:3.11
3.11: Pulling from library/python
ef1b08ddd59d: Already exists
8b365b6ff7b7: Already exists
2ca884014342: Already exists
442cca122a8b: Already exists
f6fb30da281d: Pulling fs layer
00fb515ecb79: Pulling fs layer
e5c164e2c953: Pulling fs layer
e5c164e2c953: Verifying Checksum
e5c164e2c953: Download complete
f6fb30da281d: Verifying Checksum
f6fb30da281d: Download complete
00fb515ecb79: Download complete
f6fb30da281d: Pull complete
00fb515ecb79: Pull complete
e5c164e2c953: Pull complete
Digest: sha256:a30c4ff1a6a474019f9b1f0d921e81a254cf420d408c09e8a8b79fd803b62ebf
Status: Downloaded newer image for python:3.11
docker.io/library/python:3.11
Using pip 24.0 from /usr/local/lib/python3.11/site-packages/pip (python 3.11)
Collecting uv==0.8.13
Obtaining dependency information for uv==0.8.13 from https://files.pythonhosted.org/packages/82/6b/81387a715dd045f7edea452fb76a5896dcfc11b8ecf0db5106f4b0f633ec/uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.5/19.5 MB 83.7 MB/s eta 0:00:00
Installing collected packages: uv
Successfully installed uv-0.8.13
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip is available: 24.0 -> 26.1.2
[notice] To update, run: pip install --upgrade pip
Using CPython 3.11.15 interpreter at: /usr/local/bin/python3
Creating virtual environment at: .venv
Resolved 127 packages in 2ms
Building langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading cryptography (4.5MiB)
Downloading tokenizers (3.1MiB)
Downloading pyarrow (45.4MiB)
Downloading pygments (1.2MiB)
Downloading zstandard (5.3MiB)
Downloading google-cloud-aiplatform (7.8MiB)
Downloading pydantic-core (2.0MiB)
Downloading hf-xet (3.2MiB)
Downloading google-api-python-client (14.0MiB)
Downloading grpcio (6.3MiB)
Downloading numpy (16.1MiB)
Downloading pydantic-core
Downloading tokenizers
Downloading hf-xet
Downloading zstandard
Downloading cryptography
Downloading pygments
Downloading grpcio
Built langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading google-api-python-client
Downloading numpy
Downloading pyarrow
Downloading google-cloud-aiplatform
Prepared 115 packages in 2.43s
warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
If the cache and target directories are on different filesystems, hardlinking may not be supported.
If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Installed 115 packages in 445ms
+ annotated-types==0.7.0
+ anthropic==0.75.0
+ anyio==4.12.0
+ bottleneck==1.6.0
+ certifi==2025.11.12
+ cffi==2.0.0
+ charset-normalizer==3.4.4
+ click==8.3.1
+ cryptography==48.0.1
+ distro==1.9.0
+ docstring-parser==0.17.0
+ execnet==2.1.2
+ filelock==3.20.3
+ freezegun==1.5.5
+ fsspec==2025.12.0
+ google-api-core==2.28.1
+ google-api-python-client==2.187.0
+ google-auth==2.48.0
+ google-auth-httplib2==0.2.1
+ google-cloud-aiplatform==1.139.0
+ google-cloud-bigquery==3.38.0
+ google-cloud-core==2.5.0
+ google-cloud-datastore==2.21.0
+ google-cloud-resource-manager==1.15.0
+ google-cloud-storage==3.6.0
+ google-cloud-vectorsearch==0.2.0
+ google-crc32c==1.7.1
+ google-genai==1.65.0
+ google-resumable-media==2.8.0
+ googleapis-common-protos==1.72.0
+ grpc-google-iam-v1==0.14.3
+ grpcio==1.76.0
+ grpcio-status==1.76.0
+ h11==0.16.0
+ hf-xet==1.2.0
+ httpcore==1.0.9
+ httplib2==0.31.0
+ httpx==0.28.1
+ httpx-sse==0.4.3
+ huggingface-hub==1.2.1
+ idna==3.15
+ iniconfig==2.3.0
+ jiter==0.12.0
+ jsonpatch==1.33
+ jsonpointer==3.0.0
+ langchain==1.1.2
+ langchain-core==1.4.7
+ langchain-google-vertexai==3.2.4 (from file:///workspace/libs/vertexai)
+ langchain-mistralai==1.1.0
+ langchain-protocol==0.0.16
+ langchain-tests==1.1.6
+ langgraph==1.0.10rc1
+ langgraph-checkpoint==4.0.0
+ langgraph-prebuilt==1.0.8
+ langgraph-sdk==0.3.9
+ langsmith==0.8.0
+ markdown-it-py==4.0.0
+ mdurl==0.1.2
+ numexpr==2.14.1
+ numpy==2.3.5
+ orjson==3.11.7
+ ormsgpack==1.12.0
+ packaging==25.0
+ pluggy==1.6.0
+ proto-plus==1.26.1
+ protobuf==6.33.5
+ py-cpuinfo==9.0.0
+ pyarrow==23.0.1
+ pyasn1==0.6.3
+ pyasn1-modules==0.4.2
+ pycparser==2.23
+ pydantic==2.12.5
+ pydantic-core==2.41.5
+ pygments==2.20.0
+ pyparsing==3.2.5
+ pytest==9.0.3
+ pytest-asyncio==1.3.0
+ pytest-benchmark==5.2.3
+ pytest-codspeed==4.2.0
+ pytest-mock==3.15.1
+ pytest-order==1.3.0
+ pytest-recording==0.13.4
+ pytest-retry==1.7.0
+ pytest-socket==0.7.0
+ pytest-timeout==2.4.0
+ pytest-watcher==0.4.3
+ pytest-xdist==3.8.0
+ python-dateutil==2.9.0.post0
+ pyyaml==6.0.3
+ requests==2.33.0
+ requests-toolbelt==1.0.0
+ rich==14.2.0
+ rsa==4.9.1
+ shellingham==1.5.4
+ six==1.17.0
+ sniffio==1.3.1
+ syrupy==5.1.0
+ tenacity==9.1.2
+ tokenizers==0.22.1
+ tqdm==4.67.1
+ typer-slim==0.20.0
+ types-protobuf==4.25.0.20240417
+ types-requests==2.32.4.20250913
+ typing-extensions==4.15.0
+ typing-inspection==0.4.2
+ uritemplate==4.2.0
+ urllib3==2.7.0
+ uuid-utils==0.12.0
+ validators==0.35.0
+ vcrpy==8.1.1
+ watchdog==6.0.0
+ websockets==15.0.1
+ wrapt==2.0.1
+ xxhash==3.6.0
+ zstandard==0.25.0
============================= test session starts ==============================
platform linux -- Python 3.11.15, pytest-9.0.3, pluggy-1.6.0
codspeed: 4.2.0 (disabled, mode: walltime, callgraph: not supported, timer_resolution: 1.0ns)
benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /workspace/libs/vertexai
configfile: pyproject.toml
plugins: benchmark-5.2.3, asyncio-1.3.0, codspeed-4.2.0, socket-0.7.0, order-1.3.0, mock-3.15.1, recording-0.13.4, timeout-2.4.0, langsmith-0.8.0, xdist-3.8.0, retry-1.7.0, syrupy-5.1.0, anyio-4.12.0
asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collected 284 items
tests/integration_tests/test_anthropic_cache.py .... [ 1%]
tests/integration_tests/test_anthropic_files.py ... [ 2%]
tests/integration_tests/test_anthropic_long_context.py ss [ 3%]
tests/integration_tests/test_callbacks.py .... [ 4%]
tests/integration_tests/test_chains.py ... [ 5%]
tests/integration_tests/test_chat_models.py ..x..X............x.X....... [ 15%]
.........................Xx....XX.......... [ 30%]
tests/integration_tests/test_compile.py . [ 30%]
tests/integration_tests/test_embeddings.py ......... [ 34%]
tests/integration_tests/test_evaluation.py ...x [ 35%]
tests/integration_tests/test_image_utils.py s [ 35%]
tests/integration_tests/test_llms.py ...X...... [ 39%]
tests/integration_tests/test_llms_safety.py .. [ 40%]
tests/integration_tests/test_maas.py .X.....X.....X.....X..... [ 48%]
tests/integration_tests/test_model_garden.py ................ [ 54%]
tests/integration_tests/test_standard.py sssssssssssssssssssssssssssssss [ 65%]
sssssssssssssssss.......ssss............................sss...s.x [ 88%]
tests/integration_tests/test_vectorstores.py .................ss. [ 95%]
tests/integration_tests/test_vectorstores_v2.py .s....... [ 98%]
starting build "25acec58-069f-47a8-b39e-0843827348f3"
FETCHSOURCE
From https://github.com/langchain-ai/langchain-google
* branch b2993aa835ed24cbf14c02b58b4f38940ce85106 -> FETCH_HEAD
HEAD is now at b2993aa fix(vertexai): replace removed bison integration test models
GitCommit:
b2993aa835ed24cbf14c02b58b4f38940ce85106
BUILD
Pulling image: python:3.11
3.11: Pulling from library/python
ef1b08ddd59d: Already exists
8b365b6ff7b7: Already exists
2ca884014342: Already exists
442cca122a8b: Already exists
f6fb30da281d: Pulling fs layer
00fb515ecb79: Pulling fs layer
e5c164e2c953: Pulling fs layer
e5c164e2c953: Verifying Checksum
e5c164e2c953: Download complete
f6fb30da281d: Verifying Checksum
f6fb30da281d: Download complete
00fb515ecb79: Download complete
f6fb30da281d: Pull complete
00fb515ecb79: Pull complete
e5c164e2c953: Pull complete
Digest: sha256:a30c4ff1a6a474019f9b1f0d921e81a254cf420d408c09e8a8b79fd803b62ebf
Status: Downloaded newer image for python:3.11
docker.io/library/python:3.11
Using pip 24.0 from /usr/local/lib/python3.11/site-packages/pip (python 3.11)
Collecting uv==0.8.13
Obtaining dependency information for uv==0.8.13 from https://files.pythonhosted.org/packages/82/6b/81387a715dd045f7edea452fb76a5896dcfc11b8ecf0db5106f4b0f633ec/uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.5/19.5 MB 83.7 MB/s eta 0:00:00
Installing collected packages: uv
Successfully installed uv-0.8.13
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip is available: 24.0 -> 26.1.2
[notice] To update, run: pip install --upgrade pip
Using CPython 3.11.15 interpreter at: /usr/local/bin/python3
Creating virtual environment at: .venv
Resolved 127 packages in 2ms
Building langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading cryptography (4.5MiB)
Downloading tokenizers (3.1MiB)
Downloading pyarrow (45.4MiB)
Downloading pygments (1.2MiB)
Downloading zstandard (5.3MiB)
Downloading google-cloud-aiplatform (7.8MiB)
Downloading pydantic-core (2.0MiB)
Downloading hf-xet (3.2MiB)
Downloading google-api-python-client (14.0MiB)
Downloading grpcio (6.3MiB)
Downloading numpy (16.1MiB)
Downloading pydantic-core
Downloading tokenizers
Downloading hf-xet
Downloading zstandard
Downloading cryptography
Downloading pygments
Downloading grpcio
Built langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading google-api-python-client
Downloading numpy
Downloading pyarrow
Downloading google-cloud-aiplatform
Prepared 115 packages in 2.43s
warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
If the cache and target directories are on different filesystems, hardlinking may not be supported.
If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Installed 115 packages in 445ms
+ annotated-types==0.7.0
+ anthropic==0.75.0
+ anyio==4.12.0
+ bottleneck==1.6.0
+ certifi==2025.11.12
+ cffi==2.0.0
+ charset-normalizer==3.4.4
+ click==8.3.1
+ cryptography==48.0.1
+ distro==1.9.0
+ docstring-parser==0.17.0
+ execnet==2.1.2
+ filelock==3.20.3
+ freezegun==1.5.5
+ fsspec==2025.12.0
+ google-api-core==2.28.1
+ google-api-python-client==2.187.0
+ google-auth==2.48.0
+ google-auth-httplib2==0.2.1
+ google-cloud-aiplatform==1.139.0
+ google-cloud-bigquery==3.38.0
+ google-cloud-core==2.5.0
+ google-cloud-datastore==2.21.0
+ google-cloud-resource-manager==1.15.0
+ google-cloud-storage==3.6.0
+ google-cloud-vectorsearch==0.2.0
+ google-crc32c==1.7.1
+ google-genai==1.65.0
+ google-resumable-media==2.8.0
+ googleapis-common-protos==1.72.0
+ grpc-google-iam-v1==0.14.3
+ grpcio==1.76.0
+ grpcio-status==1.76.0
+ h11==0.16.0
+ hf-xet==1.2.0
+ httpcore==1.0.9
+ httplib2==0.31.0
+ httpx==0.28.1
+ httpx-sse==0.4.3
+ huggingface-hub==1.2.1
+ idna==3.15
+ iniconfig==2.3.0
+ jiter==0.12.0
+ jsonpatch==1.33
+ jsonpointer==3.0.0
+ langchain==1.1.2
+ langchain-core==1.4.7
+ langchain-google-vertexai==3.2.4 (from file:///workspace/libs/vertexai)
+ langchain-mistralai==1.1.0
+ langchain-protocol==0.0.16
+ langchain-tests==1.1.6
+ langgraph==1.0.10rc1
+ langgraph-checkpoint==4.0.0
+ langgraph-prebuilt==1.0.8
+ langgraph-sdk==0.3.9
+ langsmith==0.8.0
+ markdown-it-py==4.0.0
+ mdurl==0.1.2
+ numexpr==2.14.1
+ numpy==2.3.5
+ orjson==3.11.7
+ ormsgpack==1.12.0
+ packaging==25.0
+ pluggy==1.6.0
+ proto-plus==1.26.1
+ protobuf==6.33.5
+ py-cpuinfo==9.0.0
+ pyarrow==23.0.1
+ pyasn1==0.6.3
+ pyasn1-modules==0.4.2
+ pycparser==2.23
+ pydantic==2.12.5
+ pydantic-core==2.41.5
+ pygments==2.20.0
+ pyparsing==3.2.5
+ pytest==9.0.3
+ pytest-asyncio==1.3.0
+ pytest-benchmark==5.2.3
+ pytest-codspeed==4.2.0
+ pytest-mock==3.15.1
+ pytest-order==1.3.0
+ pytest-recording==0.13.4
+ pytest-retry==1.7.0
+ pytest-socket==0.7.0
+ pytest-timeout==2.4.0
+ pytest-watcher==0.4.3
+ pytest-xdist==3.8.0
+ python-dateutil==2.9.0.post0
+ pyyaml==6.0.3
+ requests==2.33.0
+ requests-toolbelt==1.0.0
+ rich==14.2.0
+ rsa==4.9.1
+ shellingham==1.5.4
+ six==1.17.0
+ sniffio==1.3.1
+ syrupy==5.1.0
+ tenacity==9.1.2
+ tokenizers==0.22.1
+ tqdm==4.67.1
+ typer-slim==0.20.0
+ types-protobuf==4.25.0.20240417
+ types-requests==2.32.4.20250913
+ typing-extensions==4.15.0
+ typing-inspection==0.4.2
+ uritemplate==4.2.0
+ urllib3==2.7.0
+ uuid-utils==0.12.0
+ validators==0.35.0
+ vcrpy==8.1.1
+ watchdog==6.0.0
+ websockets==15.0.1
+ wrapt==2.0.1
+ xxhash==3.6.0
+ zstandard==0.25.0
============================= test session starts ==============================
platform linux -- Python 3.11.15, pytest-9.0.3, pluggy-1.6.0
codspeed: 4.2.0 (disabled, mode: walltime, callgraph: not supported, timer_resolution: 1.0ns)
benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /workspace/libs/vertexai
configfile: pyproject.toml
plugins: benchmark-5.2.3, asyncio-1.3.0, codspeed-4.2.0, socket-0.7.0, order-1.3.0, mock-3.15.1, recording-0.13.4, timeout-2.4.0, langsmith-0.8.0, xdist-3.8.0, retry-1.7.0, syrupy-5.1.0, anyio-4.12.0
asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collected 284 items
tests/integration_tests/test_anthropic_cache.py .... [ 1%]
tests/integration_tests/test_anthropic_files.py ... [ 2%]
tests/integration_tests/test_anthropic_long_context.py ss [ 3%]
tests/integration_tests/test_callbacks.py .... [ 4%]
tests/integration_tests/test_chains.py ... [ 5%]
tests/integration_tests/test_chat_models.py ..x..X............x.X....... [ 15%]
.........................Xx....XX.......... [ 30%]
tests/integration_tests/test_compile.py . [ 30%]
tests/integration_tests/test_embeddings.py ......... [ 34%]
tests/integration_tests/test_evaluation.py ...x [ 35%]
tests/integration_tests/test_image_utils.py s [ 35%]
tests/integration_tests/test_llms.py ...X...... [ 39%]
tests/integration_tests/test_llms_safety.py .. [ 40%]
tests/integration_tests/test_maas.py .X.....X.....X.....X..... [ 48%]
tests/integration_tests/test_model_garden.py ................ [ 54%]
tests/integration_tests/test_standard.py sssssssssssssssssssssssssssssss [ 65%]
sssssssssssssssss.......ssss............................sss...s.x [ 88%]
tests/integration_tests/test_vectorstores.py .................ss. [ 95%]
tests/integration_tests/test_vectorstores_v2.py .s....... [ 98%]
starting build "25acec58-069f-47a8-b39e-0843827348f3"
FETCHSOURCE
From https://github.com/langchain-ai/langchain-google
* branch b2993aa835ed24cbf14c02b58b4f38940ce85106 -> FETCH_HEAD
HEAD is now at b2993aa fix(vertexai): replace removed bison integration test models
GitCommit:
b2993aa835ed24cbf14c02b58b4f38940ce85106
BUILD
Pulling image: python:3.11
3.11: Pulling from library/python
ef1b08ddd59d: Already exists
8b365b6ff7b7: Already exists
2ca884014342: Already exists
442cca122a8b: Already exists
f6fb30da281d: Pulling fs layer
00fb515ecb79: Pulling fs layer
e5c164e2c953: Pulling fs layer
e5c164e2c953: Verifying Checksum
e5c164e2c953: Download complete
f6fb30da281d: Verifying Checksum
f6fb30da281d: Download complete
00fb515ecb79: Download complete
f6fb30da281d: Pull complete
00fb515ecb79: Pull complete
e5c164e2c953: Pull complete
Digest: sha256:a30c4ff1a6a474019f9b1f0d921e81a254cf420d408c09e8a8b79fd803b62ebf
Status: Downloaded newer image for python:3.11
docker.io/library/python:3.11
Using pip 24.0 from /usr/local/lib/python3.11/site-packages/pip (python 3.11)
Collecting uv==0.8.13
Obtaining dependency information for uv==0.8.13 from https://files.pythonhosted.org/packages/82/6b/81387a715dd045f7edea452fb76a5896dcfc11b8ecf0db5106f4b0f633ec/uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.5/19.5 MB 83.7 MB/s eta 0:00:00
Installing collected packages: uv
Successfully installed uv-0.8.13
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip is available: 24.0 -> 26.1.2
[notice] To update, run: pip install --upgrade pip
Using CPython 3.11.15 interpreter at: /usr/local/bin/python3
Creating virtual environment at: .venv
Resolved 127 packages in 2ms
Building langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading cryptography (4.5MiB)
Downloading tokenizers (3.1MiB)
Downloading pyarrow (45.4MiB)
Downloading pygments (1.2MiB)
Downloading zstandard (5.3MiB)
Downloading google-cloud-aiplatform (7.8MiB)
Downloading pydantic-core (2.0MiB)
Downloading hf-xet (3.2MiB)
Downloading google-api-python-client (14.0MiB)
Downloading grpcio (6.3MiB)
Downloading numpy (16.1MiB)
Downloading pydantic-core
Downloading tokenizers
Downloading hf-xet
Downloading zstandard
Downloading cryptography
Downloading pygments
Downloading grpcio
Built langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading google-api-python-client
Downloading numpy
Downloading pyarrow
Downloading google-cloud-aiplatform
Prepared 115 packages in 2.43s
warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
If the cache and target directories are on different filesystems, hardlinking may not be supported.
If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Installed 115 packages in 445ms
+ annotated-types==0.7.0
+ anthropic==0.75.0
+ anyio==4.12.0
+ bottleneck==1.6.0
+ certifi==2025.11.12
+ cffi==2.0.0
+ charset-normalizer==3.4.4
+ click==8.3.1
+ cryptography==48.0.1
+ distro==1.9.0
+ docstring-parser==0.17.0
+ execnet==2.1.2
+ filelock==3.20.3
+ freezegun==1.5.5
+ fsspec==2025.12.0
+ google-api-core==2.28.1
+ google-api-python-client==2.187.0
+ google-auth==2.48.0
+ google-auth-httplib2==0.2.1
+ google-cloud-aiplatform==1.139.0
+ google-cloud-bigquery==3.38.0
+ google-cloud-core==2.5.0
+ google-cloud-datastore==2.21.0
+ google-cloud-resource-manager==1.15.0
+ google-cloud-storage==3.6.0
+ google-cloud-vectorsearch==0.2.0
+ google-crc32c==1.7.1
+ google-genai==1.65.0
+ google-resumable-media==2.8.0
+ googleapis-common-protos==1.72.0
+ grpc-google-iam-v1==0.14.3
+ grpcio==1.76.0
+ grpcio-status==1.76.0
+ h11==0.16.0
+ hf-xet==1.2.0
+ httpcore==1.0.9
+ httplib2==0.31.0
+ httpx==0.28.1
+ httpx-sse==0.4.3
+ huggingface-hub==1.2.1
+ idna==3.15
+ iniconfig==2.3.0
+ jiter==0.12.0
+ jsonpatch==1.33
+ jsonpointer==3.0.0
+ langchain==1.1.2
+ langchain-core==1.4.7
+ langchain-google-vertexai==3.2.4 (from file:///workspace/libs/vertexai)
+ langchain-mistralai==1.1.0
+ langchain-protocol==0.0.16
+ langchain-tests==1.1.6
+ langgraph==1.0.10rc1
+ langgraph-checkpoint==4.0.0
+ langgraph-prebuilt==1.0.8
+ langgraph-sdk==0.3.9
+ langsmith==0.8.0
+ markdown-it-py==4.0.0
+ mdurl==0.1.2
+ numexpr==2.14.1
+ numpy==2.3.5
+ orjson==3.11.7
+ ormsgpack==1.12.0
+ packaging==25.0
+ pluggy==1.6.0
+ proto-plus==1.26.1
+ protobuf==6.33.5
+ py-cpuinfo==9.0.0
+ pyarrow==23.0.1
+ pyasn1==0.6.3
+ pyasn1-modules==0.4.2
+ pycparser==2.23
+ pydantic==2.12.5
+ pydantic-core==2.41.5
+ pygments==2.20.0
+ pyparsing==3.2.5
+ pytest==9.0.3
+ pytest-asyncio==1.3.0
+ pytest-benchmark==5.2.3
+ pytest-codspeed==4.2.0
+ pytest-mock==3.15.1
+ pytest-order==1.3.0
+ pytest-recording==0.13.4
+ pytest-retry==1.7.0
+ pytest-socket==0.7.0
+ pytest-timeout==2.4.0
+ pytest-watcher==0.4.3
+ pytest-xdist==3.8.0
+ python-dateutil==2.9.0.post0
+ pyyaml==6.0.3
+ requests==2.33.0
+ requests-toolbelt==1.0.0
+ rich==14.2.0
+ rsa==4.9.1
+ shellingham==1.5.4
+ six==1.17.0
+ sniffio==1.3.1
+ syrupy==5.1.0
+ tenacity==9.1.2
+ tokenizers==0.22.1
+ tqdm==4.67.1
+ typer-slim==0.20.0
+ types-protobuf==4.25.0.20240417
+ types-requests==2.32.4.20250913
+ typing-extensions==4.15.0
+ typing-inspection==0.4.2
+ uritemplate==4.2.0
+ urllib3==2.7.0
+ uuid-utils==0.12.0
+ validators==0.35.0
+ vcrpy==8.1.1
+ watchdog==6.0.0
+ websockets==15.0.1
+ wrapt==2.0.1
+ xxhash==3.6.0
+ zstandard==0.25.0
============================= test session starts ==============================
platform linux -- Python 3.11.15, pytest-9.0.3, pluggy-1.6.0
codspeed: 4.2.0 (disabled, mode: walltime, callgraph: not supported, timer_resolution: 1.0ns)
benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /workspace/libs/vertexai
configfile: pyproject.toml
plugins: benchmark-5.2.3, asyncio-1.3.0, codspeed-4.2.0, socket-0.7.0, order-1.3.0, mock-3.15.1, recording-0.13.4, timeout-2.4.0, langsmith-0.8.0, xdist-3.8.0, retry-1.7.0, syrupy-5.1.0, anyio-4.12.0
asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collected 284 items
tests/integration_tests/test_anthropic_cache.py .... [ 1%]
tests/integration_tests/test_anthropic_files.py ... [ 2%]
tests/integration_tests/test_anthropic_long_context.py ss [ 3%]
tests/integration_tests/test_callbacks.py .... [ 4%]
tests/integration_tests/test_chains.py ... [ 5%]
tests/integration_tests/test_chat_models.py ..x..X............x.X....... [ 15%]
.........................Xx....XX.......... [ 30%]
tests/integration_tests/test_compile.py . [ 30%]
tests/integration_tests/test_embeddings.py ......... [ 34%]
tests/integration_tests/test_evaluation.py ...x [ 35%]
tests/integration_tests/test_image_utils.py s [ 35%]
tests/integration_tests/test_llms.py ...X...... [ 39%]
tests/integration_tests/test_llms_safety.py .. [ 40%]
tests/integration_tests/test_maas.py .X.....X.....X.....X..... [ 48%]
tests/integration_tests/test_model_garden.py ................ [ 54%]
tests/integration_tests/test_standard.py sssssssssssssssssssssssssssssss [ 65%]
sssssssssssssssss.......ssss............................sss...s.x [ 88%]
tests/integration_tests/test_vectorstores.py .................ss. [ 95%]
tests/integration_tests/test_vectorstores_v2.py .s....... [ 98%]
tests/integration_tests/test_vision_models.py sssX [100%]
=============================== warnings summary ===============================
.venv/lib/python3.11/site-packages/langgraph/cache/base/__init__.py:8
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/langgraph/cache/base/__init__.py:8: LangChainPendingDeprecationWarning: The default value of `allowed_objects` will change in a future version. Pass an explicit value (e.g., allowed_objects='messages' or allowed_objects='core') to suppress this warning.
from langgraph.checkpoint.serde.jsonplus import JsonPlusSerializer
tests/integration_tests/test_evaluation.py::test_evaluate_pairwise
/workspace/libs/vertexai/langchain_google_vertexai/evaluators/_core.py:62: UserWarning: Ignoring input in VertexPairWiseStringEvaluator, as it is not expected.
warn(self._skip_input_warning)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=================================== XPASSES ====================================
============================= slowest 5 durations ==============================
127.43s call tests/integration_tests/test_anthropic_files.py::test_pdf_gcs_uri
117.06s call tests/integration_tests/test_anthropic_files.py::test_pdf_byts
48.78s call tests/integration_tests/test_model_garden.py::test_model_garden_agenerate[FALCON_ENDPOINT_ID-generated_text]
46.73s call tests/integration_tests/test_chat_models.py::test_context_catching
44.88s call tests/integration_tests/test_chat_models.py::test_context_catching_tools
=========================== short test summary info ============================
SKIPPED [1] tests/integration_tests/test_anthropic_long_context.py:55: too long & expensive
SKIPPED [1] tests/integration_tests/test_anthropic_long_context.py:70: too long & expensive
SKIPPED [1] tests/integration_tests/test_image_utils.py:8: CI testing not set up
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/base.py: need --first option to run
SKIPPED [30] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:800: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:860: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:1552: need --first option to run
SKIPPED [3] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2155: need --first option to run
SKIPPED [3] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2239: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2322: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3242: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3312: need --first option to run
SKIPPED [1] tests/integration_tests/test_standard.py:63: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:939: model_override_value not specified.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:966: model_override_value not specified.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:993: model_override_value not specified.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:1023: model_override_value not specified.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2891: Model does not support image tool message.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2992: Model does not support PDF tool message.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3108: Model does not explicitly support Anthropic inputs.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3341: VCR not set up.
SKIPPED [1] tests/integration_tests/test_vectorstores.py:329: rebuild the index with restricts
SKIPPED [1] tests/integration_tests/test_vectorstores.py:353: need --long option to run
SKIPPED [1] tests/integration_tests/test_vectorstores_v2.py:178: V2 sparse vector support needs sparse vector schema configuration in collection
SKIPPED [1] tests/integration_tests/test_vision_models.py:30: Image captioning is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
SKIPPED [1] tests/integration_tests/test_vision_models.py:69: Image captioning is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
SKIPPED [1] tests/integration_tests/test_vision_models.py:84: Visual question answering is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
XFAIL tests/integration_tests/test_chat_models.py::test_init_from_credentials_obj - can't create service account key on gcp
XFAIL tests/integration_tests/test_chat_models.py::test_audio_timestamp - very unstable
XFAIL tests/integration_tests/test_chat_models.py::test_label_metadata_invoke_method - can't add labels to the gemini content using invoke method
XFAIL tests/integration_tests/test_evaluation.py::test_evaluate_pairwise - TODO: investigate (started failing 2025-03-25).
XFAIL tests/integration_tests/test_standard.py::TestGemini_15_AIStandard::test_audio_inputs - [NOTRUN] Multimodal tests require integration secrets (user agent to fetch external resources)
XPASS tests/integration_tests/test_chat_models.py::test_candidates - vertex api doesn't respect n/candidate_count
XPASS tests/integration_tests/test_chat_models.py::test_multimodal_video_metadata[video] - investigating
XPASS tests/integration_tests/test_chat_models.py::test_label_metadata - can't add labels to the gemini content
XPASS tests/integration_tests/test_chat_models.py::test_logprobs - logprobs are subject to daily quotas
XPASS tests/integration_tests/test_chat_models.py::test_logprobs_with_json_schema - logprobs are subject to daily quotas
XPASS tests/integration_tests/test_llms.py::test_vertex_generate_multiple_candidates - VertexAI doesn't always respect number of candidates
XPASS tests/integration_tests/test_maas.py::test_generate[meta/llama-4-maverick-17b-128e-instruct-maas] - us-east5 quota for llama-4-maverick is consistently exhausted in the integration-test project (429)
XPASS tests/integration_tests/test_maas.py::test_agenerate[meta/llama-4-maverick-17b-128e-instruct-maas] - us-east5 quota for llama-4-maverick is consistently exhausted in the integration-test project (429)
XPASS tests/integration_tests/test_maas.py::test_stream[meta/llama-4-maverick-17b-128e-instruct-maas] - us-east5 quota for llama-4-maverick is consistently exhausted in the integration-test project (429)
XPASS tests/integration_tests/test_maas.py::test_astream[meta/llama-4-maverick-17b-128e-instruct-maas] - us-east5 quota for llama-4-maverick is consistently exhausted in the integration-test project (429)
XPASS tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition - Started raising 500 error on 2026-01-26.
= 203 passed, 65 skipped, 5 xfailed, 11 xpassed, 2 warnings in 1276.41s (0:21:16) =
PUSH
DONE
Loading