Skip to content

Update semantic text to default to bfloat16 #144275

@liranabn

Description

@liranabn

We need a way to index to bfloat16 for inference services that use the float element type. The most straightforward way to do this is to default to bfloat16 for all inference services that use the float element type. However, this affects scoring, so we also need a way for the user to specify the element type in case they want to use float for the most accurate possible scoring. The agreed upon solution is to add an element_type param to dense vector index_options for semantic text.

Metadata

Metadata

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions