Skip to content

Commit a14b07d

Browse files
lesebleseb
committed
chore(docs): Refresh OpenAI conformance coverage baseline after upstream merge.
Signed-off-by: Sébastien Han <seb@redhat.com>
1 parent 0874a4d commit a14b07d

2 files changed

Lines changed: 39 additions & 118 deletions

File tree

‎docs/docs/api-openai/conformance.mdx‎

Lines changed: 29 additions & 58 deletions
Original file line numberDiff line numberDiff line change
@@ -18,12 +18,12 @@ This documentation is auto-generated from the OpenAI API specification compariso
1818

1919
| Metric | Value |
2020
|--------|-------|
21-
| **Overall Conformance Score** | 91.9% |
21+
| **Overall Conformance Score** | 92.1% |
2222
| **Endpoints Implemented** | 30/146 |
2323
| **Total Properties Checked** | 3487 |
24-
| **Schema/Type Issues** | 179 |
24+
| **Schema/Type Issues** | 172 |
2525
| **Missing Properties** | 104 |
26-
| **Total Issues to Fix** | 283 |
26+
| **Total Issues to Fix** | 276 |
2727

2828
## Integration Test Coverage
2929

@@ -48,10 +48,10 @@ Categories are sorted by conformance score (lowest first, needing most attention
4848
| Batch | 39.9% | 168 | 60 | 41 |
4949
| Completions | 58.7% | 46 | 17 | 2 |
5050
| Models | 60.0% | 15 | 0 | 6 |
51-
| Files | 76.2% | 42 | 8 | 2 |
5251
| Embeddings | 78.6% | 14 | 3 | 0 |
5352
| Vector stores | 82.9% | 310 | 41 | 12 |
5453
| Responses | 88.9% | 225 | 25 | 0 |
54+
| Files | 92.9% | 42 | 1 | 2 |
5555
| Chat | 98.7% | 449 | 5 | 1 |
5656
| Conversations | 99.3% | 2165 | 15 | 1 |
5757

@@ -530,60 +530,6 @@ Below is a detailed breakdown of conformance issues and missing properties for e
530530

531531
</details>
532532

533-
### Files
534-
535-
**Score:** 76.2% · **Issues:** 8 · **Missing:** 2
536-
537-
#### `/files`
538-
539-
**GET**
540-
541-
<details>
542-
<summary>Schema Issues (2)</summary>
543-
544-
| Property | Issues |
545-
|----------|--------|
546-
| `responses.200.content.application/json.properties.data.items.properties.expires_at` | Type removed: ['integer']; Nullable added (OpenAI non-nullable); Union variants added: 2 |
547-
| `responses.200.content.application/json.properties.data.items.properties.purpose` | Enum values removed: ['assistants_output', 'batch_output', 'fine-tune', 'fine-tune-results', 'vision', 'user_data'] |
548-
549-
</details>
550-
551-
**POST**
552-
553-
<details>
554-
<summary>Missing Properties (2)</summary>
555-
556-
- `requestBody.content.multipart/form-data.properties.expires_after.properties.anchor`
557-
- `requestBody.content.multipart/form-data.properties.expires_after.properties.seconds`
558-
559-
</details>
560-
561-
<details>
562-
<summary>Schema Issues (4)</summary>
563-
564-
| Property | Issues |
565-
|----------|--------|
566-
| `requestBody.content.multipart/form-data.properties.expires_after` | Type removed: ['object']; Union variants added: 2 |
567-
| `requestBody.content.multipart/form-data.properties.purpose` | Enum values removed: ['fine-tune', 'vision', 'user_data', 'evals'] |
568-
| `responses.200.content.application/json.properties.expires_at` | Type removed: ['integer']; Nullable added (OpenAI non-nullable); Union variants added: 2 |
569-
| `responses.200.content.application/json.properties.purpose` | Enum values removed: ['assistants_output', 'batch_output', 'fine-tune', 'fine-tune-results', 'vision', 'user_data'] |
570-
571-
</details>
572-
573-
#### `/files/{file_id}`
574-
575-
**GET**
576-
577-
<details>
578-
<summary>Schema Issues (2)</summary>
579-
580-
| Property | Issues |
581-
|----------|--------|
582-
| `responses.200.content.application/json.properties.expires_at` | Type removed: ['integer']; Nullable added (OpenAI non-nullable); Union variants added: 2 |
583-
| `responses.200.content.application/json.properties.purpose` | Enum values removed: ['assistants_output', 'batch_output', 'fine-tune', 'fine-tune-results', 'vision', 'user_data'] |
584-
585-
</details>
586-
587533
### Embeddings
588534

589535
**Score:** 78.6% · **Issues:** 3 · **Missing:** 0
@@ -867,6 +813,31 @@ Below is a detailed breakdown of conformance issues and missing properties for e
867813

868814
</details>
869815

816+
### Files
817+
818+
**Score:** 92.9% · **Issues:** 1 · **Missing:** 2
819+
820+
#### `/files`
821+
822+
**POST**
823+
824+
<details>
825+
<summary>Missing Properties (2)</summary>
826+
827+
- `requestBody.content.multipart/form-data.properties.expires_after.properties.anchor`
828+
- `requestBody.content.multipart/form-data.properties.expires_after.properties.seconds`
829+
830+
</details>
831+
832+
<details>
833+
<summary>Schema Issues (1)</summary>
834+
835+
| Property | Issues |
836+
|----------|--------|
837+
| `requestBody.content.multipart/form-data.properties.expires_after` | Type removed: ['object']; Union variants added: 2 |
838+
839+
</details>
840+
870841
### Chat
871842

872843
**Score:** 98.7% · **Issues:** 5 · **Missing:** 1

‎docs/static/openai-coverage.json‎

Lines changed: 10 additions & 60 deletions
Original file line numberDiff line numberDiff line change
@@ -126,10 +126,10 @@
126126
]
127127
},
128128
"conformance": {
129-
"score": 91.9,
130-
"issues": 179,
129+
"score": 92.1,
130+
"issues": 172,
131131
"missing_properties": 104,
132-
"total_problems": 283,
132+
"total_problems": 276,
133133
"total_properties": 3487
134134
}
135135
},
@@ -1193,8 +1193,8 @@
11931193
]
11941194
},
11951195
"Files": {
1196-
"score": 76.2,
1197-
"issues": 8,
1196+
"score": 92.9,
1197+
"issues": 1,
11981198
"missing_properties": 2,
11991199
"total_properties": 42,
12001200
"endpoints": [
@@ -1204,24 +1204,9 @@
12041204
{
12051205
"method": "GET",
12061206
"missing_properties": [],
1207-
"conformance_issues": [
1208-
{
1209-
"property": "GET.responses.200.content.application/json.properties.data.items.properties.expires_at",
1210-
"details": [
1211-
"Type removed: ['integer']",
1212-
"Nullable added (OpenAI non-nullable)",
1213-
"Union variants added: 2"
1214-
]
1215-
},
1216-
{
1217-
"property": "GET.responses.200.content.application/json.properties.data.items.properties.purpose",
1218-
"details": [
1219-
"Enum values removed: ['assistants_output', 'batch_output', 'fine-tune', 'fine-tune-results', 'vision', 'user_data']"
1220-
]
1221-
}
1222-
],
1207+
"conformance_issues": [],
12231208
"missing_count": 0,
1224-
"issues_count": 2
1209+
"issues_count": 0
12251210
},
12261211
{
12271212
"method": "POST",
@@ -1236,30 +1221,10 @@
12361221
"Type removed: ['object']",
12371222
"Union variants added: 2"
12381223
]
1239-
},
1240-
{
1241-
"property": "POST.requestBody.content.multipart/form-data.properties.purpose",
1242-
"details": [
1243-
"Enum values removed: ['fine-tune', 'vision', 'user_data', 'evals']"
1244-
]
1245-
},
1246-
{
1247-
"property": "POST.responses.200.content.application/json.properties.expires_at",
1248-
"details": [
1249-
"Type removed: ['integer']",
1250-
"Nullable added (OpenAI non-nullable)",
1251-
"Union variants added: 2"
1252-
]
1253-
},
1254-
{
1255-
"property": "POST.responses.200.content.application/json.properties.purpose",
1256-
"details": [
1257-
"Enum values removed: ['assistants_output', 'batch_output', 'fine-tune', 'fine-tune-results', 'vision', 'user_data']"
1258-
]
12591224
}
12601225
],
12611226
"missing_count": 2,
1262-
"issues_count": 4
1227+
"issues_count": 1
12631228
}
12641229
]
12651230
},
@@ -1276,24 +1241,9 @@
12761241
{
12771242
"method": "GET",
12781243
"missing_properties": [],
1279-
"conformance_issues": [
1280-
{
1281-
"property": "GET.responses.200.content.application/json.properties.expires_at",
1282-
"details": [
1283-
"Type removed: ['integer']",
1284-
"Nullable added (OpenAI non-nullable)",
1285-
"Union variants added: 2"
1286-
]
1287-
},
1288-
{
1289-
"property": "GET.responses.200.content.application/json.properties.purpose",
1290-
"details": [
1291-
"Enum values removed: ['assistants_output', 'batch_output', 'fine-tune', 'fine-tune-results', 'vision', 'user_data']"
1292-
]
1293-
}
1294-
],
1244+
"conformance_issues": [],
12951245
"missing_count": 0,
1296-
"issues_count": 2
1246+
"issues_count": 0
12971247
}
12981248
]
12991249
},

0 commit comments

Comments
 (0)