Skip to content

refactor(loongsuite-instrumentation-langchain): GenAI Util Migration & ReAct Step Support #139

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Cirilla-zmh merged 14 commits into from
Mar 11, 2026
Merged

refactor(loongsuite-instrumentation-langchain): GenAI Util Migration & ReAct Step Support #139

Show file tree
Hide file tree
Changes from 8 commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
9555d6d
feat(genai-util): add entry span and ReAct span
Cirilla-zmh Mar 10, 2026
8b17bde
refactor(langchain): enhance instrumentation with ExtendedTelemetryHa…
Cirilla-zmh Mar 10, 2026
b517483
Fix logic of token usage extraction
Cirilla-zmh Mar 10, 2026
832219b
feat(langchain): patch langchain.agents.create_agent for ReAct agent …
Cirilla-zmh Mar 10, 2026
62ede15
Add necessary debug logs
Cirilla-zmh Mar 10, 2026
a0943dd
Fix related PR
Cirilla-zmh Mar 10, 2026
257cbc0
Add legacy unit test
Cirilla-zmh Mar 10, 2026
a30ab5b
format
Cirilla-zmh Mar 10, 2026
ede082d
feedback
Cirilla-zmh Mar 10, 2026
e6a1ef3
Fix message part for tool call response
Cirilla-zmh Mar 10, 2026
409f0c8
Capture tool definitions
Cirilla-zmh Mar 11, 2026
4450a45
Fix tool call id
Cirilla-zmh Mar 11, 2026
dbb9eaf
feedback
Cirilla-zmh Mar 11, 2026
67511d3
Add truncated str
Cirilla-zmh Mar 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions .github/workflows/loongsuite_lint_0.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -108,6 +108,25 @@ jobs:
- name: Run tests
run: tox -c tox-loongsuite.ini -e lint-loongsuite-instrumentation-google-adk

lint-loongsuite-instrumentation-langchain:
name: LoongSuite loongsuite-instrumentation-langchain
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.13
uses: actions/setup-python@v5
with:
python-version: "3.13"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e lint-loongsuite-instrumentation-langchain

lint-loongsuite-instrumentation-mem0:
name: LoongSuite loongsuite-instrumentation-mem0
runs-on: ubuntu-latest
Expand Down
190 changes: 190 additions & 0 deletions .github/workflows/loongsuite_test_0.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -716,6 +716,196 @@ jobs:
- name: Run tests
run: tox -c tox-loongsuite.ini -e py313-test-loongsuite-instrumentation-google-adk-latest -- -ra

py39-test-loongsuite-instrumentation-langchain-oldest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-oldest 3.9 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.9
uses: actions/setup-python@v5
with:
python-version: "3.9"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py39-test-loongsuite-instrumentation-langchain-oldest -- -ra

py39-test-loongsuite-instrumentation-langchain-latest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-latest 3.9 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.9
uses: actions/setup-python@v5
with:
python-version: "3.9"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py39-test-loongsuite-instrumentation-langchain-latest -- -ra

py310-test-loongsuite-instrumentation-langchain-oldest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-oldest 3.10 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.10
uses: actions/setup-python@v5
with:
python-version: "3.10"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py310-test-loongsuite-instrumentation-langchain-oldest -- -ra

py310-test-loongsuite-instrumentation-langchain-latest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-latest 3.10 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.10
uses: actions/setup-python@v5
with:
python-version: "3.10"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py310-test-loongsuite-instrumentation-langchain-latest -- -ra

py311-test-loongsuite-instrumentation-langchain-oldest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-oldest 3.11 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.11
uses: actions/setup-python@v5
with:
python-version: "3.11"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py311-test-loongsuite-instrumentation-langchain-oldest -- -ra

py311-test-loongsuite-instrumentation-langchain-latest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-latest 3.11 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.11
uses: actions/setup-python@v5
with:
python-version: "3.11"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py311-test-loongsuite-instrumentation-langchain-latest -- -ra

py312-test-loongsuite-instrumentation-langchain-oldest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-oldest 3.12 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.12
uses: actions/setup-python@v5
with:
python-version: "3.12"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py312-test-loongsuite-instrumentation-langchain-oldest -- -ra

py312-test-loongsuite-instrumentation-langchain-latest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-latest 3.12 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.12
uses: actions/setup-python@v5
with:
python-version: "3.12"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py312-test-loongsuite-instrumentation-langchain-latest -- -ra

py313-test-loongsuite-instrumentation-langchain-oldest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-oldest 3.13 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.13
uses: actions/setup-python@v5
with:
python-version: "3.13"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py313-test-loongsuite-instrumentation-langchain-oldest -- -ra

py313-test-loongsuite-instrumentation-langchain-latest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-langchain-latest 3.13 Ubuntu
runs-on: ubuntu-latest
timeout-minutes: 30
steps:
- name: Checkout repo @ SHA - ${{ github.sha }}
uses: actions/checkout@v4

- name: Set up Python 3.13
uses: actions/setup-python@v5
with:
python-version: "3.13"

- name: Install tox
run: pip install tox-uv

- name: Run tests
run: tox -c tox-loongsuite.ini -e py313-test-loongsuite-instrumentation-langchain-latest -- -ra

py310-test-loongsuite-instrumentation-mem0-oldest_ubuntu-latest:
name: LoongSuite loongsuite-instrumentation-mem0-oldest 3.10 Ubuntu
runs-on: ubuntu-latest
Expand Down
32 changes: 32 additions & 0 deletions instrumentation-loongsuite/loongsuite-instrumentation-langchain/CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,38 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0

## Unreleased

### Added

- ReAct Step instrumentation for AgentExecutor
([#139](https://github.com/alibaba/loongsuite-python-agent/pull/139))
- Monkey-patch `AgentExecutor._iter_next_step` and `_aiter_next_step` to instrument each ReAct iteration
- Dual patch: patch both `langchain.agents` (0.x) and `langchain_classic.agents` (1.x) when available, so either import path works
- Covers invoke, ainvoke, stream, astream, batch, abatch
- ReAct Step spans: `gen_ai.span.kind=STEP`, `gen_ai.operation.name=react`, `gen_ai.react.round`, `gen_ai.react.finish_reason`
- Span hierarchy: Agent > ReAct Step > LLM/Tool

- LangGraph ReAct agent support (requires `loongsuite-instrumentation-langgraph`)
([#139](https://github.com/alibaba/loongsuite-python-agent/pull/139))
- Detect LangGraph agents via `Run.metadata["_loongsuite_react_agent"]`
(metadata injected by the LangGraph instrumentation)
- Disambiguate the top-level graph (Agent span) from child nodes (chain
spans) using `inside_langgraph_react` propagation
- Agent name resolution: when the ReAct agent is invoked inside an outer
graph node, inherit the node's name (e.g. `invoke_agent product_agent`)
instead of the generic default (`invoke_agent LangGraph`)
- Track ReAct step boundaries via callback-based detection of the
`"agent"` node within the graph
- Span hierarchy: Agent > ReAct Step > LLM/Tool (same as AgentExecutor)

### Breaking Changes

- Rewrite the instrumentation for LangChain with `genai-util`
([#139](https://github.com/alibaba/loongsuite-python-agent/pull/139))
- Replaced the legacy `wrapt`-based function wrapping with `BaseTracer` callback mechanism
- Migrated to `ExtendedTelemetryHandler` from `opentelemetry-util-genai` for standardized GenAI semantic conventions
- Added Agent detection by `run.name`, TTFT tracking, content capture gating, and `RLock` thread safety
- Added new test suite (98 tests) with `oldest`/`latest` dependency matrices

## Version 0.1.0 (2026-02-28)

### Added
Expand Down
Loading