Skip to content

Commit 3996d8a

Browse files
committed
chore(docs): Refresh OpenAI conformance coverage baseline after upstream merge.
Signed-off-by: Sébastien Han <seb@redhat.com>
1 parent b5436de commit 3996d8a

2 files changed

Lines changed: 55 additions & 41 deletions

File tree

docs/docs/api-openai/conformance.mdx

Lines changed: 35 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -18,12 +18,12 @@ This documentation is auto-generated from the OpenAI API specification compariso
1818

1919
| Metric | Value |
2020
|--------|-------|
21-
| **Overall Conformance Score** | 92.0% |
21+
| **Overall Conformance Score** | 91.9% |
2222
| **Endpoints Implemented** | 30/146 |
2323
| **Total Properties Checked** | 3487 |
24-
| **Schema/Type Issues** | 180 |
25-
| **Missing Properties** | 98 |
26-
| **Total Issues to Fix** | 278 |
24+
| **Schema/Type Issues** | 179 |
25+
| **Missing Properties** | 104 |
26+
| **Total Issues to Fix** | 283 |
2727

2828
## Integration Test Coverage
2929

@@ -47,11 +47,11 @@ Categories are sorted by conformance score (lowest first, needing most attention
4747
| Moderations | 17.0% | 53 | 5 | 39 |
4848
| Batch | 39.9% | 168 | 60 | 41 |
4949
| Completions | 58.7% | 46 | 17 | 2 |
50+
| Models | 60.0% | 15 | 0 | 6 |
5051
| Files | 76.2% | 42 | 8 | 2 |
5152
| Embeddings | 78.6% | 14 | 3 | 0 |
5253
| Vector stores | 82.9% | 310 | 41 | 12 |
5354
| Responses | 88.9% | 225 | 25 | 0 |
54-
| Models | 93.3% | 15 | 1 | 0 |
5555
| Chat | 98.7% | 449 | 5 | 1 |
5656
| Conversations | 99.3% | 2165 | 15 | 1 |
5757

@@ -500,6 +500,36 @@ Below is a detailed breakdown of conformance issues and missing properties for e
500500

501501
</details>
502502

503+
### Models
504+
505+
**Score:** 60.0% · **Issues:** 0 · **Missing:** 6
506+
507+
#### `/models`
508+
509+
**GET**
510+
511+
<details>
512+
<summary>Missing Properties (2)</summary>
513+
514+
- `responses.200.content.application/json.properties.data`
515+
- `responses.200.content.application/json.properties.object`
516+
517+
</details>
518+
519+
#### `/models/{model}`
520+
521+
**GET**
522+
523+
<details>
524+
<summary>Missing Properties (4)</summary>
525+
526+
- `responses.200.content.application/json.properties.created`
527+
- `responses.200.content.application/json.properties.id`
528+
- `responses.200.content.application/json.properties.object`
529+
- `responses.200.content.application/json.properties.owned_by`
530+
531+
</details>
532+
503533
### Files
504534

505535
**Score:** 76.2% · **Issues:** 8 · **Missing:** 2
@@ -837,23 +867,6 @@ Below is a detailed breakdown of conformance issues and missing properties for e
837867

838868
</details>
839869

840-
### Models
841-
842-
**Score:** 93.3% · **Issues:** 1 · **Missing:** 0
843-
844-
#### `/models/{model}`
845-
846-
**GET**
847-
848-
<details>
849-
<summary>Schema Issues (1)</summary>
850-
851-
| Property | Issues |
852-
|----------|--------|
853-
| `responses.200.content.application/json.properties.owned_by` | Default changed: None -&gt; ogx |
854-
855-
</details>
856-
857870
### Chat
858871

859872
**Score:** 98.7% · **Issues:** 5 · **Missing:** 1

docs/static/openai-coverage.json

Lines changed: 20 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -126,10 +126,10 @@
126126
]
127127
},
128128
"conformance": {
129-
"score": 92.0,
130-
"issues": 180,
131-
"missing_properties": 98,
132-
"total_problems": 278,
129+
"score": 91.9,
130+
"issues": 179,
131+
"missing_properties": 104,
132+
"total_problems": 283,
133133
"total_properties": 3487
134134
}
135135
},
@@ -1312,19 +1312,22 @@
13121312
]
13131313
},
13141314
"Models": {
1315-
"score": 93.3,
1316-
"issues": 1,
1317-
"missing_properties": 0,
1315+
"score": 60.0,
1316+
"issues": 0,
1317+
"missing_properties": 6,
13181318
"total_properties": 15,
13191319
"endpoints": [
13201320
{
13211321
"path": "/models",
13221322
"operations": [
13231323
{
13241324
"method": "GET",
1325-
"missing_properties": [],
1325+
"missing_properties": [
1326+
"GET.responses.200.content.application/json.properties.data",
1327+
"GET.responses.200.content.application/json.properties.object"
1328+
],
13261329
"conformance_issues": [],
1327-
"missing_count": 0,
1330+
"missing_count": 2,
13281331
"issues_count": 0
13291332
}
13301333
]
@@ -1334,17 +1337,15 @@
13341337
"operations": [
13351338
{
13361339
"method": "GET",
1337-
"missing_properties": [],
1338-
"conformance_issues": [
1339-
{
1340-
"property": "GET.responses.200.content.application/json.properties.owned_by",
1341-
"details": [
1342-
"Default changed: None -> ogx"
1343-
]
1344-
}
1340+
"missing_properties": [
1341+
"GET.responses.200.content.application/json.properties.created",
1342+
"GET.responses.200.content.application/json.properties.id",
1343+
"GET.responses.200.content.application/json.properties.object",
1344+
"GET.responses.200.content.application/json.properties.owned_by"
13451345
],
1346-
"missing_count": 0,
1347-
"issues_count": 1
1346+
"conformance_issues": [],
1347+
"missing_count": 4,
1348+
"issues_count": 0
13481349
}
13491350
]
13501351
}

0 commit comments

Comments
 (0)