[RELEASE] `v0.4.0` #820

dot-agi · 2025-03-13T09:40:15Z

🚀 AgentOps v0.4.0

🌟 Overview

We're thrilled to announce the release of AgentOps v0.4.0, featuring a complete redesign built on OpenTelemetry! This major architectural shift enables more robust instrumentation, standardized metrics collection, and enhanced interoperability with the broader observability ecosystem.

🏗️ Key Architectural Changes

📊 OpenTelemetry Core Integration

✅ Replaced proprietary event system with OpenTelemetry's trace, metrics, and logging components
✅ Implemented OTLP exporters for standardized data transmission
✅ Added support for distributed tracing with proper context propagation
✅ Integrated with OpenTelemetry's resource and semantic convention systems

🔌 Instrumentation Framework

✅ Created custom instrumentors for popular AI frameworks:
- OpenAI SDK (v0 and v1 API support)
- Anthropic SDK (including streaming support)
- CrewAI framework
- Agents SDK with comprehensive span capture
✅ Implemented auto-instrumentation capabilities that can be enabled at runtime
✅ Added support for streaming operations with proper span lifecycle management

🧩 Client Architecture

✅ Redesigned client architecture with clear separation of concerns
✅ Implemented proper resource attribution and semantic conventions
✅ Added internal span processors for enhanced data processing

✨ New Features

🌊 Streaming Support

Full instrumentation for streaming LLM responses with accurate token counting and latency measurements

📈 Enhanced Metrics Collection

Token usage histograms
Latency measurements
Request/response counters
Error rate tracking

⚙️ Internal Span Processing

Custom span processors for enriching spans with additional context
Proper handling of span relationships and hierarchies

🛡️ Improved Error Handling

Fail-safe operation modes
Graceful degradation when services are unavailable
Comprehensive error logging

🤝 Framework-Specific Integrations

CrewAI task and agent tracking
OpenAI assistants API support
Anthropic Claude streaming support

🔄 Backward Compatibility

While this is a complete redesign, we've maintained backward compatibility through:

🔙 Legacy module that maps old API calls to new OpenTelemetry-based implementations
🔍 Automatic detection and adaptation to client usage patterns
📝 Maintaining the same public API surface while changing the implementation

📚 Documentation & Examples

Updated examples demonstrating the new OpenTelemetry-based approach
Comprehensive documentation reflecting the architectural changes
Migration guides for users of previous versions

Signed-off-by: Teo <[email protected]>

…nitions (#810) * Add AgentsInstrumentor and update SpanKind definitions * Added support for Agents SDK streaming * Remove monkey patching of shutdown method from AgentsInstrumentor * Remove debug print statement from AgentsInstrumentor and clean up initialization code * Refactor logging in AgentsInstrumentor to use warning level for error messages and remove debug statements. This change enhances log clarity by reducing verbosity and ensuring that important warnings are highlighted.

* Added Examples for OpenAI * Update OpenAI examples to reference 'trace url' instead of 'session url' for tracking runs in AgentOps. --------- Co-authored-by: Pratyush Shukla <[email protected]>

* Added Examples for CrewAI * Update .gitignore to include .db files and remove obsolete SQLite and binary files from examples/crewai_examples/db directory. --------- Co-authored-by: Pratyush Shukla <[email protected]>

* remove haystack support * Delete groq_examples directory * removed ollama support

* commands mod Signed-off-by: Teo <[email protected]> * start_span, end_span commands Signed-off-by: Teo <[email protected]> * Move compat to legacy Signed-off-by: Teo <[email protected]> * legacy: start/end session Signed-off-by: Teo <[email protected]> * commands: move session-related to legacy Signed-off-by: Teo <[email protected]> * Move facade to context Signed-off-by: Teo <[email protected]> * Client: auto_start_session configured with legacy Signed-off-by: Teo <[email protected]> * commands: start_span to implement auto init Signed-off-by: Teo <[email protected]> * core: refactor, remove .start_session() methods, improve exceptions Signed-off-by: Teo <[email protected]> * adapt examples Signed-off-by: Teo <[email protected]> --------- Signed-off-by: Teo <[email protected]>

Signed-off-by: Teo <[email protected]>

* Added Examples for Anthropic * Refactor Anthropic example notebook by removing verbose debug output and updating execution count to null for cleaner presentation. --------- Co-authored-by: Pratyush Shukla <[email protected]>

* remove unnecessary instrumentations * move `test_auth_flow` to `tests/integraiton` * remove cursor rules * remove incomplete instrumentations from the sdk * ignore .cursorrules * remove `autogen` instrumentation * ruff format code * ruff format examples * Added Agents SDK Examples (#819) * Added Agents Example * remove init from agents examples --------- Co-authored-by: Pratyush Shukla <[email protected]> * clean the scripts to fix ruff formatting * ruff format --------- Co-authored-by: Dwij <[email protected]>

teocns added 30 commits February 23, 2025 22:02

agentops.start_session: accept **kwargs

c783b6f

Signed-off-by: Teo <[email protected]>

tests: isolate session fixtures

cbc676c

Signed-off-by: Teo <[email protected]>

tests: session fixture - introduce kwargs marker

c8d89d7

Signed-off-by: Teo <[email protected]>

session: add auto_start property

d2a609b

Signed-off-by: Teo <[email protected]>

move default_config from session->config

3ef3b10

Signed-off-by: Teo <[email protected]>

session/state

41de71e

Signed-off-by: Teo <[email protected]>

session: dict() and json()

29e8bb8

Signed-off-by: Teo <[email protected]>

session: use slots

96b0068

Signed-off-by: Teo <[email protected]>

session: improve fields

9c0ad23

Signed-off-by: Teo <[email protected]>

session: general improvements

6b1f82e

Signed-off-by: Teo <[email protected]>

telemetry/helpers: dict_to_span_attributes

a410e64

Signed-off-by: Teo <[email protected]>

cleanup

38c3ebc

Signed-off-by: Teo <[email protected]>

test: add tests for Session serialization and encoding

a35c30b

session._tracer -> session.telemetry

afec862

Signed-off-by: Teo <[email protected]>

save

455f805

Signed-off-by: Teo <[email protected]>

session: logger improvements, comments

4405576

Signed-off-by: Teo <[email protected]>

Create auto instrumentation features

a9d37b4

Signed-off-by: Teo <[email protected]>

Move session_generator under tests/fixtures/session.py

dd82070

Signed-off-by: Teo <[email protected]>

++context

d89a3c4

Signed-off-by: Teo <[email protected]>

integration tests refactor TOOD move

4f98abd

Signed-off-by: Teo <[email protected]>

telemetry: -context

a3bd7a6

Signed-off-by: Teo <[email protected]>

Move openai instrumentation to third_party/

4238eb2

Signed-off-by: Teo <[email protected]>

cleanup test_session.py

ce9b538

Signed-off-by: Teo <[email protected]>

chore(pyproject): add third_party

a0c4772

Signed-off-by: Teo <[email protected]>

add logging to instrumentation/__init__.py

f7af00e

Signed-off-by: Teo <[email protected]>

cleanup telemetry/mixin

dec4fe1

Signed-off-by: Teo <[email protected]>

test client instrumentation

9ced223

Signed-off-by: Teo <[email protected]>

_singleton.py

d540e93

Signed-off-by: Teo <[email protected]>

+exceptions.py

206dba0

Signed-off-by: Teo <[email protected]>

+fixtures/config.py

9707213

Signed-off-by: Teo <[email protected]>

Dwij1704 and others added 13 commits March 13, 2025 03:53

Added Examples for OpenAI (#811)

6d3f2e1

* Added Examples for OpenAI * Update OpenAI examples to reference 'trace url' instead of 'session url' for tracking runs in AgentOps. --------- Co-authored-by: Pratyush Shukla <[email protected]>

Added Examples for CrewAI (#812)

6531a49

* Added Examples for CrewAI * Update .gitignore to include .db files and remove obsolete SQLite and binary files from examples/crewai_examples/db directory. --------- Co-authored-by: Pratyush Shukla <[email protected]>

Remove instrumentor support for Ollama and Haystack (#814)

b920589

* remove haystack support * Delete groq_examples directory * removed ollama support

refactor: rename uuid_to_hex_int to uuid_to_int16

0f30676

add InternalSpanProcessor

a802e96

Signed-off-by: Teo <[email protected]>

Squash merge dev-internal-processor into dev

ff0141f

Signed-off-by: Teo <[email protected]>

Added Anthropic examples (#817)

9f10111

* Added Examples for Anthropic * Refactor Anthropic example notebook by removing verbose debug output and updating execution count to null for cleaner presentation. --------- Co-authored-by: Pratyush Shukla <[email protected]>

Merge branch 'main' into dev

a986236

add missing anthropic example

510b8c8

remove test file

93f243b

dot-agi requested review from areibman, bboynton97, tcdent and teocns March 13, 2025 09:41

dot-agi self-assigned this Mar 13, 2025

dot-agi added in progress v0.4 labels Mar 13, 2025

dot-agi marked this pull request as ready for review March 13, 2025 09:56

dot-agi added 5 commits March 13, 2025 15:29

update version

50a53a2

update vcrpy dep version

f054284

ruff ignore E731

25d45c9

update uv.lock

902a432

fix video rendering

5e5aa4d

areibman merged commit ef381d2 into main Mar 13, 2025
3 of 9 checks passed

areibman deleted the dev branch March 13, 2025 11:23

dot-agi removed the in progress label Mar 13, 2025

dot-agi restored the dev branch March 13, 2025 11:27

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[RELEASE] `v0.4.0` #820

[RELEASE] `v0.4.0` #820

Uh oh!

dot-agi commented Mar 13, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

[RELEASE] v0.4.0 #820

[RELEASE] v0.4.0 #820

Uh oh!

Conversation

dot-agi commented Mar 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🚀 AgentOps v0.4.0

🌟 Overview

🏗️ Key Architectural Changes

📊 OpenTelemetry Core Integration

🔌 Instrumentation Framework

🧩 Client Architecture

✨ New Features

🌊 Streaming Support

📈 Enhanced Metrics Collection

⚙️ Internal Span Processing

🛡️ Improved Error Handling

🤝 Framework-Specific Integrations

🔄 Backward Compatibility

📚 Documentation & Examples

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

[RELEASE] `v0.4.0` #820

[RELEASE] `v0.4.0` #820

dot-agi commented Mar 13, 2025 •

edited

Loading