[Bug]: run stream llm request will report std::runtime_error using ov genai 2026.0.0.0 #20802
Description
Bug Description
Run stream llm request will report std::runtime_error using ov genai 2026.0.0.0
ov genai 2026.0.0.0 removed deprecated APIs like Streamer put method, bool return for callback, ChunkStreamer
ChunkStreamer put function is used in stream llm request
Related commit in ov genai: openvinotoolkit/openvino.genai@9d3d6e3
Version
0.14.13
Steps to Reproduce
root@3957c43f1690:/home/user# python3
Python 3.11.14 (main, Feb 24 2026, 19:44:43) [GCC 14.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from llama_index.llms.openvino_genai import OpenVINOGenAILLM
>>> ov_llm = OpenVINOGenAILLM(model_path="/home/user/models/Qwen3-8B/INT4_compressed_weights",device="CPU",)
>>> ov_llm.config.max_new_tokens = 100
>>> response = ov_llm.stream_complete("What is the meaning of life?")
/home/user/.local/lib/python3.11/site-packages/llama_index/core/schema.py:116: UserWarning: Pydantic serializer warnings:
PydanticSerializationUnexpectedValue(Expected `str` - serialized value may not be as expected [field_name='config', input_value=<openvino_genai.py_openvi...bject at 0x7b78406f0bb0>, input_type=GenerationConfig])
data = handler(self)
>>> terminate called after throwing an instance of 'std::runtime_error'
what(): Tried to call pure virtual function "StreamerBase::write"
Aborted (core dumped)
Relevant Logs/Tracbacks
ENV:
llama-index-embeddings-openvino 0.6.1
llama-index-embeddings-openvino-genai 0.6.1
llama-index-llms-openvino 0.5.1
llama-index-llms-openvino-genai 0.2.1
llama-index-postprocessor-openvino-rerank 0.5.1
openvino 2026.0.0
openvino-genai 2026.0.0.0
openvino-telemetry 2025.2.0
openvino-tokenizers 2026.0.0.0
llama-cloud 0.1.35
llama-cloud-services 0.6.54
llama-index 0.14.13
llama-index-cli 0.5.3
llama-index-core 0.14.15