Skip to content

PR -> feat: Unified Telemetry Layer for Non-LangGraph Trace Pipelines (M2) Body #64

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
mjehanzaib999 wants to merge 76 commits into
base: experimental
Choose a base branch
from
Draft

PR -> feat: Unified Telemetry Layer for Non-LangGraph Trace Pipelines (M2) Body #64

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
76 commits
Select commit Hold shift + click to select a range
dc7384a
checkpoint of WIP JSON OTEL demo
doxav Oct 3, 2025
cd29a67
working OTEL/LANGGRAPH demo
doxav Oct 5, 2025
028ec8d
converted demo JSON/OpenTelemetry to LangGraph
doxav Oct 5, 2025
3436130
checkpoint
doxav Oct 6, 2025
c4c837b
OTEL/JSON/LANGGRAPH demo: add a mechanism to ensure multiple optimiza…
doxav Oct 6, 2025
ebea1ae
ADDED batchify for handling the multiple feedback in a batch + ADDED …
doxav Nov 6, 2025
8f4e8ad
working code optimization - TODO: clean, simplify the code
doxav Nov 7, 2025
fca35f2
fixed code optimization
doxav Nov 20, 2025
5ae098c
ADD synthtizer prompt in optim score > High score
doxav Nov 20, 2025
e156e76
TEST removing span/OTEL from optimized code
doxav Nov 20, 2025
2cac599
fixed and updated LangGraph/Otel demo README
doxav Nov 21, 2025
319af63
restore
doxav Nov 25, 2025
4a7e301
ADD demo and tests for native LangGraph integration with OTEL tracing
doxav Dec 11, 2025
928a6c5
ADD refactor run_graph_with_otel to support custom evaluation functio…
doxav Dec 12, 2025
ad1c961
ADD implement run_benchmark function to compare different feedback mode
doxav Dec 12, 2025
0613494
ADD M0 technical plan, architecture docs, and prototype API validation
JZOMVI Feb 6, 2026
a605dfb
Fix Colab badge URL: replace placeholders with actual repo/branch path
JZOMVI Feb 6, 2026
7870a9f
ADD Colab Secrets key retrieval and Google Drive auto-save to notebook
JZOMVI Feb 6, 2026
ebcdd4a
Update T1 tech plan: notebooks + acceptance alignment + fixed opto/tr…
doxav Feb 8, 2026
33e5e3b
ADD M1 core: instrument_graph + optimize_graph + E2E pipeline + notebook
JZOMVI Feb 12, 2026
59a49c6
FIX: address all feedback issues (A1-F13)
JZOMVI Feb 12, 2026
5fb13d7
REFACTOR: remove all hardcoded/example-specific defaults from library…
mjehanzaib999 Feb 13, 2026
f80c09c
fix(optimization): correct best_updates tracking to reflect actual be…
mjehanzaib999 Feb 16, 2026
5ccea66
fix(optimization): fall back to graph.output_key in optimize_graph()
mjehanzaib999 Feb 16, 2026
cf5eddc
fix(instrumentation): wire enable_code_optimization to TracingLLM
mjehanzaib999 Feb 16, 2026
1ee1326
fix(otel): prevent dangling TGJ parents and record errors on child spans
mjehanzaib999 Feb 16, 2026
5b96633
fix(notebook): replace brittle name heuristics with attribute-based t…
mjehanzaib999 Feb 17, 2026
5fcd548
Merge branch 'experimental' of https://github.com/AgentOpt/OpenTrace …
mjehanzaib999 Feb 19, 2026
61cf01e
fix: address PR feedback round 2 — multi-node notebook + error.messag…
mjehanzaib999 Feb 19, 2026
d1cb8a4
fix: replace custom OpenRouterLLM with Trace LiteLLM, use real OptoPr…
mjehanzaib999 Feb 20, 2026
2c8e850
fix: update retired OpenRouter model to llama-3.3-70b-instruct:free
mjehanzaib999 Feb 20, 2026
a8a7e92
fix: use OPENAI_BASE_URL env var for OpenRouter routing
mjehanzaib999 Feb 20, 2026
ee12b14
fix: add openai/ prefix for litellm OpenRouter routing
mjehanzaib999 Feb 20, 2026
04478ef
fix: use openai package directly for OpenRouter, add smoke test
mjehanzaib999 Feb 20, 2026
38cc07b
fix: switch to Qwen3 model, use built-in eval_fn for live optimization
mjehanzaib999 Feb 20, 2026
d80d6a9
fix: use paid meta-llama/llama-3.3-70b-instruct to avoid free-tier ra…
mjehanzaib999 Feb 20, 2026
eba582c
fix: resolve ParameterNode-keyed updates in live optimization
mjehanzaib999 Feb 23, 2026
6f4e5f1
fix: per-query optimizer step to avoid feedback aggregation assertion
mjehanzaib999 Feb 23, 2026
ed33d86
fix: use batchify for multi-query backward pass instead of per-query …
mjehanzaib999 Feb 24, 2026
4cfc03c
feat: add unified telemetry layer for non-LangGraph Trace pipelines (M2)
mjehanzaib999 Feb 25, 2026
c380bfd
Add M2 validation notebook with StubLLM and live LLM test sections
mjehanzaib999 Feb 27, 2026
b42980f
git commit -m "Clean up repo root: move M2 notebook to examples/noteb…
mjehanzaib999 Feb 27, 2026
94b9305
fix: correct Colab badge URL to point to fork and M2 branch
mjehanzaib999 Feb 27, 2026
d284f0f
fix: move postprocess_output inside span context so MessageNode bindi…
mjehanzaib999 Mar 2, 2026
88c76ba
fix: ensure Colab install cell fetches latest code on re-run
mjehanzaib999 Mar 2, 2026
a969bd1
fix: add local sys.path for notebook and relax Python version
mjehanzaib999 Mar 2, 2026
059f4de
fix: use string-compatible function in span redaction test cell
mjehanzaib999 Mar 2, 2026
a991974
fix: add missing cell IDs to M2 notebook for GitHub compatibility
mjehanzaib999 Mar 2, 2026
12149bd
fix: revert M2 notebook to nbformat 4.4 for GitHub compatibility
mjehanzaib999 Mar 2, 2026
befefc4
fix: use llama-3.3-70b-instruct model in M2 notebook to match M1
mjehanzaib999 Mar 2, 2026
76c9546
Created using Colab
mjehanzaib999 Mar 2, 2026
86c588b
feat: add MLflow integration tests to M2 notebook
mjehanzaib999 Mar 2, 2026
726c775
fix: expose __name__ and __qualname__ on FunModule for mlflow.trace()…
mjehanzaib999 Mar 2, 2026
43c37fe
feat: add MLflow UI inspection cell and fix FunModule __name__ for ml…
mjehanzaib999 Mar 2, 2026
93b85dd
feat: add MLflow UI inspection cell with clickable proxy link (Sectio…
mjehanzaib999 Mar 2, 2026
51b0ce9
fix: use serve_kernel_port_as_iframe for MLflow UI on Colab
mjehanzaib999 Mar 2, 2026
fc8c6e7
fix: correct record_genai_chat() kwargs in call_llm() OTEL span
mjehanzaib999 Mar 3, 2026
06c8d10
fix: use token stack for TelemetrySession nested activation
mjehanzaib999 Mar 3, 2026
dd28bae
feat: add set_current() / clear_current() imperative activation API
mjehanzaib999 Mar 3, 2026
e058461
feat: add mode="span" and OTLP->TGJ->ingest_tgj round-trip validation…
mjehanzaib999 Mar 3, 2026
e532fee
fix: resolve MLflow "Failed to capture inputs" by setting FunModule._…
mjehanzaib999 Mar 3, 2026
5477493
fix: align gen_ai.operation.name with OTEL semconv default
mjehanzaib999 Mar 4, 2026
7e18299
nit:fixed cursor syntax to nb
mjehanzaib999 Mar 4, 2026
4b5cec9
Colab run m2
mjehanzaib999 Mar 4, 2026
d9db871
fix: remove Jupyter widget outputs that broke GitHub notebook rendering
mjehanzaib999 Mar 4, 2026
729172b
refactor: minimize core lib diffs — restore original comments, docstr…
mjehanzaib999 Mar 4, 2026
0c6f463
fix: repair pre-existing upstream test failures for CI-safe suite
mjehanzaib999 Mar 10, 2026
881c29b
feat(m2): Phase B core library safety enhancements
mjehanzaib999 Mar 10, 2026
8cbf9bb
docs: Phase C — unified telemetry documentation for PR #64
mjehanzaib999 Mar 12, 2026
b14ea96
chore(notebooks): Phase D — rename demos, env-var models, drop outputs
mjehanzaib999 Mar 12, 2026
61dfc1e
ran m2 notebook successfully
mjehanzaib999 Mar 16, 2026
ccf7123
fix: addresses feedback regarding bundle param order, stable TGJ refs…
mjehanzaib999 Mar 18, 2026
1534d16
fix: tgj_ingest stable refs + consolidate docs into 2 files + cleanup
mjehanzaib999 Mar 19, 2026
35ecf4c
Executed end to end demo of the m2 notebook after cleanup and refacto…
mjehanzaib999 Mar 20, 2026
d5a83f0
fix: strip widget metadata from M2 notebook for GitHub rendering
mjehanzaib999 Mar 20, 2026
7d4d4f6
fix: remove all widget metadata from M2 notebook for GitHub rendering
mjehanzaib999 Mar 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions .env.example
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
# OpenRouter Configuration
# Copy this file to .env and fill in your values
# Get your API key from: https://openrouter.ai/keys

OPENROUTER_API_KEY=sk-or-v1-your-key-here
OPENROUTER_MODEL=meta-llama/llama-3.1-8b-instruct:free
OPENROUTER_BASE_URL=https://openrouter.ai/api/v1
USE_STUB_LLM=false
4 changes: 3 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -168,4 +168,6 @@ OAI_CONFIG_LIST
*.gv.pdf

# jupyter book API output
docs/api/*
docs/api/*

uv.lock
57 changes: 0 additions & 57 deletions OVERVIEW.md
View file
Open in desktop

This file was deleted.

Loading