Update google genai instrumentation to work with latest semantic convention, allow for uploading content. (open-telemetry#3772)

* Update google genai instrumentation to latest semantic convention.

Co-authored-by: Aaron Abbott <[email protected]>

* fix: log roles as str, event attrs as objects.

* fix: proper event name

* refactor: remove unused message models.

* refactor: use OTel imported semconv attributes.

* refactor: Inject upload_hook in Instrumentor.

* refactor: rename upload hook to completion hook.

* test: add tests for non streaming case and tool_call_wrapper.

* test: add tool call instrumentation tests and nonstreaming recording in spans test.

* fix: remove print

* feature: add blobpart and filepart to message handling

* fix: encode bytes as base64 when dumping to json string.

* fix: always call completion hook, independently of recording settings.

* test: update requirements for instrumentation-google-genai oldest env

* test: bump google-genai lib version in -oldest test env.

* test: fix event recording test.

* Update FakeCredentials

* Fix tests

* fix lint issues

* fix: aggregate streaming messages into one event.

* fix: remove gen_ai.system from latest sem_conv

* refactor: import encoder from utils-genai

* build: update deps versions.

* refactor: deduplicate creating attributes, use gen_ai_json_dumps

* refactor: move blobpart and filedatapart to instrumentation-google-genai package.

* test: add comment for headers.

* test: fix span attributes formatting.

* fix: lint

* fix: use LogRecord instead of Event.

* docs: update changelog

* build: update uv.lock

* test: disable lint

* build: unpin opentelemetry-util-genai version

* test: add e2e completion_hook test

---------

Co-authored-by: Aaron Abbott <[email protected]>
Co-authored-by: Dylan Russell <[email protected]>
Co-authored-by: DylanRussell <[email protected]>

Author: 3 people

instrumentation-genai/opentelemetry-instrumentation-google-genai/CHANGELOG.md

@@ -7,6 +7,11 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## Unreleased
 
+- Implement the new semantic convention changes made in https://github.com/open-telemetry/semantic-conventions/pull/2179.
+A single event (`gen_ai.client.inference.operation.details`) is used to capture Chat History. This is opt-in,
+an environment variable OTEL_SEMCONV_STABILITY_OPT_IN needs to be set to `gen_ai_latest_experimental` to see them ([#3386](https://github.com/open-telemetry/opentelemetry-python-contrib/pull/3386))
+- Support CompletionHook for upload to cloud storage. 
+
 ## Version 0.3b0 (2025-07-08)
 
 - Add automatic instrumentation to tool call functions ([#3446](https://github.com/open-telemetry/opentelemetry-python-contrib/pull/3446))

instrumentation-genai/opentelemetry-instrumentation-google-genai/pyproject.toml

@@ -38,13 +38,15 @@ classifiers = [
 ]
 dependencies = [
   "opentelemetry-api ~=1.37",
-  "opentelemetry-instrumentation >=0.52b1, <2",
-  "opentelemetry-semantic-conventions >=0.52b1, <2"
-]
+  "opentelemetry-instrumentation >=0.58b0, <2",
+  "opentelemetry-semantic-conventions >=0.58b0, <2",
+  # TODO https://github.com/open-telemetry/opentelemetry-python-contrib/issues/3786: restrict
+  # version after the first release
+  "opentelemetry-util-genai",]
 
 [project.optional-dependencies]
 instruments = [
-    "google-genai >= 1.0.0"
+    "google-genai >= 1.32.0"
 ]
 
 [project.entry-points.opentelemetry_instrumentor]

instrumentation-genai/opentelemetry-instrumentation-google-genai/src/opentelemetry/instrumentation/google_genai/flags.py

@@ -12,12 +12,25 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 
-import os
+from os import environ
+from typing import Union
 
-_CONTENT_RECORDING_ENV_VAR = (
-    "OTEL_INSTRUMENTATION_GENAI_CAPTURE_MESSAGE_CONTENT"
+from opentelemetry.instrumentation._semconv import _StabilityMode
+from opentelemetry.util.genai.environment_variables import (
+    OTEL_INSTRUMENTATION_GENAI_CAPTURE_MESSAGE_CONTENT,
 )
+from opentelemetry.util.genai.types import ContentCapturingMode
+from opentelemetry.util.genai.utils import get_content_capturing_mode
 
 
-def is_content_recording_enabled():
-    return os.getenv(_CONTENT_RECORDING_ENV_VAR, "false").lower() == "true"
+def is_content_recording_enabled(
+    mode: _StabilityMode,
+) -> Union[bool, ContentCapturingMode]:
+    if mode == _StabilityMode.DEFAULT:
+        capture_content = environ.get(
+            OTEL_INSTRUMENTATION_GENAI_CAPTURE_MESSAGE_CONTENT, "false"
+        )
+        return capture_content.lower() == "true"
+    if mode == _StabilityMode.GEN_AI_LATEST_EXPERIMENTAL:
+        return get_content_capturing_mode()
+    raise RuntimeError(f"{mode} mode not supported")