Commit 2058c4c
authored
Fix flaky MMR diversification YAML tests (elastic#143706)
The default int8_hnsw index type quantizes float32 vectors to
int8, introducing enough scoring error to non-deterministically
reorder documents with close cosine similarities. With only 4
dimensions the quantization is particularly coarse.
Use explicit hnsw index type on test dense_vector mappings to
get exact float scoring and deterministic KNN result ordering.
Update expected results to reflect exact cosine ordering.
Closes elastic#143430
Closes elastic#1436091 parent 2ad21ee commit 2058c4c
File tree
2 files changed
+11
-11
lines changed- rest-api-spec/src/yamlRestTest/resources/rest-api-spec/test/search.retrievers/result-diversification
2 files changed
+11
-11
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
366 | 366 | | |
367 | 367 | | |
368 | 368 | | |
369 | | - | |
370 | | - | |
371 | | - | |
372 | 369 | | |
373 | 370 | | |
374 | 371 | | |
375 | | - | |
376 | | - | |
377 | | - | |
378 | 372 | | |
379 | 373 | | |
380 | 374 | | |
| |||
Lines changed: 11 additions & 5 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
| 26 | + | |
| 27 | + | |
26 | 28 | | |
27 | 29 | | |
28 | 30 | | |
| |||
41 | 43 | | |
42 | 44 | | |
43 | 45 | | |
| 46 | + | |
| 47 | + | |
44 | 48 | | |
45 | 49 | | |
46 | 50 | | |
| |||
76 | 80 | | |
77 | 81 | | |
78 | 82 | | |
| 83 | + | |
| 84 | + | |
79 | 85 | | |
80 | 86 | | |
81 | 87 | | |
| |||
215 | 221 | | |
216 | 222 | | |
217 | 223 | | |
218 | | - | |
| 224 | + | |
219 | 225 | | |
220 | 226 | | |
221 | 227 | | |
| |||
308 | 314 | | |
309 | 315 | | |
310 | 316 | | |
311 | | - | |
| 317 | + | |
312 | 318 | | |
313 | 319 | | |
314 | 320 | | |
| |||
356 | 362 | | |
357 | 363 | | |
358 | 364 | | |
359 | | - | |
| 365 | + | |
360 | 366 | | |
361 | 367 | | |
362 | 368 | | |
| |||
459 | 465 | | |
460 | 466 | | |
461 | 467 | | |
462 | | - | |
| 468 | + | |
463 | 469 | | |
464 | 470 | | |
465 | 471 | | |
| |||
514 | 520 | | |
515 | 521 | | |
516 | 522 | | |
517 | | - | |
| 523 | + | |
518 | 524 | | |
519 | 525 | | |
520 | 526 | | |
| |||
0 commit comments