Skip to content
Integration Tests (Replay)

Run the integration test suites from tests/integration in replay mode #137

Sign in to view logs

Run the integration test suites from tests/integration in replay mode

Run the integration test suites from tests/integration in replay mode #137

Run time

Learn about OS pricing on GitHub Actions
Job Run time
generate-matrix
6s
Integration Tests (library, gpt, 3.12, client=published, responses)
54s
Integration Tests (library, ollama-vision, 3.12, client=published, vision)
55s
Integration Tests (library, bedrock, 3.12, client=published, bedrock)
56s
Integration Tests (library, vllm, 3.12, client=published, base-vllm-subset)
1m 37s
Integration Tests (library, ollama, 3.12, client=published, base)
3m 26s
Integration Tests (library, ollama-postgres, 3.12, client=published, base)
8s
Integration Tests (library, gpt-reasoning, 3.12, client=published, gpt-reasoning)
50s
Integration Tests (library, azure, 3.12, client=published, responses)
1m 13s
Integration Tests (library, bedrock, 3.12, client=published, bedrock-responses)
52s
Integration Tests (library, vllm, 3.12, client=published, vllm-reasoning)
1m 1s
Integration Tests (library, watsonx, 3.12, client=published, responses)
1m 53s
Integration Tests (library, ollama-vision, 3.13, client=published, vision)
59s
Integration Tests (library, bedrock, 3.12, client=latest, bedrock-responses)
59s
Integration Tests (library, ollama, 3.12, client=latest, base)
3m 18s
Integration Tests (library, ollama, 3.13, client=published, base)
6h 0m 17s
Integration Tests (library, bedrock, 3.13, client=published, bedrock)
1m 4s
Integration Tests (library, ollama-postgres, 3.12, client=latest, base)
9s
Integration Tests (library, ollama-postgres, 3.13, client=published, base)
5s
Integration Tests (library, ollama-reasoning, 3.12, client=published, ollama-reasoning)
53s
Integration Tests (library, azure, 3.12, client=latest, responses)
1m 0s
Integration Tests (library, bedrock, 3.12, client=latest, bedrock)
1m 0s
Integration Tests (library, gpt-reasoning, 3.12, client=latest, gpt-reasoning)
1m 0s
Integration Tests (library, ollama-reasoning, 3.12, client=latest, ollama-reasoning)
1m 5s
Integration Tests (library, ollama-vision, 3.12, client=latest, vision)
1m 3s
Integration Tests (library, vllm, 3.12, client=latest, vllm-reasoning)
58s
Integration Tests (library, azure, 3.13, client=published, responses)
58s
Integration Tests (library, bedrock, 3.13, client=published, bedrock-responses)
55s
Integration Tests (library, watsonx, 3.13, client=published, responses)
1m 49s
Integration Tests (library, ollama-reasoning, 3.13, client=published, ollama-reasoning)
57s
Integration Tests (library, gpt, 3.12, client=latest, responses)
59s
Integration Tests (library, ollama, 3.13, client=latest, base)
6h 0m 18s
Integration Tests (library, vllm, 3.13, client=published, base-vllm-subset)
1m 23s
Integration Tests (library, vllm, 3.12, client=latest, base-vllm-subset)
1m 30s
Integration Tests (library, gpt-reasoning, 3.13, client=latest, gpt-reasoning)
46s
Integration Tests (library, watsonx, 3.12, client=latest, responses)
1m 51s
Integration Tests (library, azure, 3.13, client=latest, responses)
59s
Integration Tests (docker, bedrock, 3.12, client=published, bedrock)
7s
Integration Tests (library, bedrock, 3.13, client=latest, bedrock-responses)
54s
Integration Tests (library, vllm, 3.13, client=published, vllm-reasoning)
57s
Integration Tests (library, gpt-reasoning, 3.13, client=published, gpt-reasoning)
1m 5s
Integration Tests (library, bedrock, 3.13, client=latest, bedrock)
1m 7s
Integration Tests (library, ollama-vision, 3.13, client=latest, vision)
1m 1s
Integration Tests (library, gpt, 3.13, client=published, responses)
59s
Integration Tests (docker, ollama, 3.12, client=published, base)
1m 27s
Integration Tests (docker, gpt, 3.12, client=published, responses)
1m 34s
Integration Tests (library, vllm, 3.13, client=latest, vllm-reasoning)
1m 3s
Integration Tests (library, ollama-postgres, 3.13, client=latest, base)
5s
Integration Tests (docker, ollama-vision, 3.12, client=published, vision)
1m 6s
Integration Tests (library, watsonx, 3.13, client=latest, responses)
1m 58s
Integration Tests (library, gpt, 3.13, client=latest, responses)
1m 3s
Integration Tests (library, ollama-reasoning, 3.13, client=latest, ollama-reasoning)
52s
Integration Tests (library, vllm, 3.13, client=latest, base-vllm-subset)
1m 59s
Integration Tests (docker, ollama-postgres, 3.12, client=latest, base)
11s
Integration Tests (docker, bedrock, 3.12, client=latest, bedrock)
6s
Integration Tests (docker, azure, 3.12, client=published, responses)
1m 12s
Integration Tests (docker, ollama, 3.12, client=latest, base)
1m 14s
Integration Tests (docker, watsonx, 3.12, client=published, responses)
1m 8s
Integration Tests (docker, ollama-reasoning, 3.12, client=published, ollama-reasoning)
1m 14s
Integration Tests (docker, gpt-reasoning, 3.12, client=published, gpt-reasoning)
1m 16s
Integration Tests (docker, ollama-postgres, 3.12, client=published, base)
8s
Integration Tests (docker, vllm, 3.12, client=published, vllm-reasoning)
1m 7s
Integration Tests (docker, ollama-vision, 3.12, client=latest, vision)
1m 7s
Integration Tests (docker, bedrock, 3.12, client=published, bedrock-responses)
1m 19s
Integration Tests (docker, vllm, 3.12, client=published, base-vllm-subset)
1m 8s
Integration Tests (docker, azure, 3.12, client=latest, responses)
1m 45s
Integration Tests (docker, gpt, 3.12, client=latest, responses)
1m 19s
Integration Tests (docker, gpt-reasoning, 3.12, client=latest, gpt-reasoning)
1m 17s
Integration Tests (docker, bedrock, 3.13, client=published, bedrock)
10s
Integration Tests (docker, ollama-reasoning, 3.12, client=latest, ollama-reasoning)
1m 9s
Integration Tests (docker, vllm, 3.12, client=latest, base-vllm-subset)
1m 11s
Integration Tests (docker, vllm, 3.12, client=latest, vllm-reasoning)
1m 20s
Integration Tests (docker, watsonx, 3.13, client=published, responses)
1m 11s
Integration Tests (docker, ollama, 3.13, client=published, base)
1m 7s
Integration Tests (docker, vllm, 3.13, client=published, base-vllm-subset)
1m 16s
Integration Tests (docker, ollama-postgres, 3.13, client=published, base)
8s
Integration Tests (docker, ollama-vision, 3.13, client=published, vision)
1m 29s
Integration Tests (docker, ollama-vision, 3.13, client=latest, vision)
1m 22s
Integration Tests (docker, gpt, 3.13, client=published, responses)
1m 17s
Integration Tests (docker, azure, 3.13, client=published, responses)
1m 16s
Integration Tests (docker, gpt-reasoning, 3.13, client=published, gpt-reasoning)
1m 15s
Integration Tests (docker, bedrock, 3.13, client=latest, bedrock)
7s
Integration Tests (docker, vllm, 3.13, client=published, vllm-reasoning)
1m 8s
Integration Tests (docker, azure, 3.13, client=latest, responses)
1m 12s
Integration Tests (docker, ollama-reasoning, 3.13, client=published, ollama-reasoning)
1m 18s
Integration Tests (docker, bedrock, 3.13, client=published, bedrock-responses)
1m 23s
Integration Tests (docker, watsonx, 3.13, client=latest, responses)
1m 8s
Integration Tests (docker, ollama-postgres, 3.13, client=latest, base)
12s
Integration Tests (docker, bedrock, 3.13, client=latest, bedrock-responses)
1m 11s
Integration Tests (docker, gpt-reasoning, 3.13, client=latest, gpt-reasoning)
1m 11s
Integration Tests (docker, watsonx, 3.12, client=latest, responses)
1m 16s
Integration Tests (server, ollama, 3.12, client=published, base)
5m 57s
Integration Tests (docker, gpt, 3.13, client=latest, responses)
1m 15s
Integration Tests (server, azure, 3.12, client=published, responses)
2m 2s
Integration Tests (server, gpt-reasoning, 3.12, client=published, gpt-reasoning)
59s
Integration Tests (server, ollama-postgres, 3.12, client=published, base)
5m 18s
Integration Tests (docker, bedrock, 3.12, client=latest, bedrock-responses)
1m 20s
Integration Tests (docker, ollama-reasoning, 3.13, client=latest, ollama-reasoning)
1m 14s
Integration Tests (docker, ollama, 3.13, client=latest, base)
1m 15s
Integration Tests (docker, vllm, 3.13, client=latest, base-vllm-subset)
1m 9s
Integration Tests (server, ollama-reasoning, 3.12, client=published, ollama-reasoning)
1m 11s
Integration Tests (server, ollama, 3.12, client=latest, base)
5m 11s
Integration Tests (docker, vllm, 3.13, client=latest, vllm-reasoning)
1m 11s
Integration Tests (server, watsonx, 3.12, client=published, responses)
2m 5s
Integration Tests (server, gpt, 3.12, client=published, responses)
1m 55s
Integration Tests (server, vllm, 3.12, client=published, vllm-reasoning)
1m 6s
Integration Tests (server, ollama-vision, 3.12, client=latest, vision)
2m 20s
Integration Tests (server, azure, 3.12, client=latest, responses)
1m 50s
Integration Tests (server, bedrock, 3.12, client=published, bedrock-responses)
1m 25s
Integration Tests (server, bedrock, 3.12, client=published, bedrock)
13s
Integration Tests (server, ollama-vision, 3.12, client=published, vision)
1m 10s
Integration Tests (server, vllm, 3.12, client=published, base-vllm-subset)
2m 37s
Integration Tests (server, ollama-postgres, 3.12, client=latest, base)
6m 16s
Integration Tests (server, bedrock, 3.12, client=latest, bedrock)
13s
Integration Tests (server, vllm, 3.12, client=latest, vllm-reasoning)
1m 35s
Integration Tests (server, bedrock, 3.12, client=latest, bedrock-responses)
1m 52s
Integration Tests (server, ollama, 3.13, client=published, base)
5m 14s
Integration Tests (server, watsonx, 3.12, client=latest, responses)
3m 13s
Integration Tests (server, ollama-vision, 3.13, client=published, vision)
1m 7s
Integration Tests (server, ollama-reasoning, 3.12, client=latest, ollama-reasoning)
1m 51s
Integration Tests (server, gpt, 3.12, client=latest, responses)
2m 6s
Integration Tests (server, gpt-reasoning, 3.12, client=latest, gpt-reasoning)
1m 36s
Integration Tests (server, vllm, 3.12, client=latest, base-vllm-subset)
3m 20s
Integration Tests (server, bedrock, 3.13, client=published, bedrock)
8s
Integration Tests (server, gpt, 3.13, client=published, responses)
4m 22s
Integration Tests (server, ollama-postgres, 3.13, client=published, base)
5m 30s
Integration Tests (server, azure, 3.13, client=published, responses)
4m 39s
Integration Tests (server, watsonx, 3.13, client=published, responses)
2m 33s
Integration Tests (server, gpt-reasoning, 3.13, client=published, gpt-reasoning)
1m 0s
Integration Tests (server, bedrock, 3.13, client=latest, bedrock)
13s
Integration Tests (server, vllm, 3.13, client=published, base-vllm-subset)
2m 55s
Integration Tests (server, ollama-reasoning, 3.13, client=published, ollama-reasoning)
1m 10s
Integration Tests (server, azure, 3.13, client=latest, responses)
3m 3s
Integration Tests (server, ollama-vision, 3.13, client=latest, vision)
1m 37s
Integration Tests (server, vllm, 3.13, client=published, vllm-reasoning)
1m 8s
Integration Tests (server, ollama-postgres, 3.13, client=latest, base)
5m 48s
Integration Tests (server, gpt, 3.13, client=latest, responses)
4m 34s
Integration Tests (server, watsonx, 3.13, client=latest, responses)
3m 2s
Integration Tests (server, bedrock, 3.13, client=latest, bedrock-responses)
1m 28s
Integration Tests (server, bedrock, 3.13, client=published, bedrock-responses)
1m 26s
Integration Tests (server, gpt-reasoning, 3.13, client=latest, gpt-reasoning)
1m 29s
Integration Tests (server, vllm, 3.13, client=latest, base-vllm-subset)
2m 16s
Integration Tests (server, ollama-reasoning, 3.13, client=latest, ollama-reasoning)
1m 54s
Integration Tests (server, vllm, 3.13, client=latest, vllm-reasoning)
1m 30s
Integration Tests (server, ollama, 3.13, client=latest, base)
5m 21s
15h 45m 23s