Skip to content

feat(sdk): [Enterprise Integration]: Add provider agnostic traceing#145

Open
namrataghadi-galileo wants to merge 3 commits intomainfrom
feature/59789-add-provider-agnostic-tracing
Open

feat(sdk): [Enterprise Integration]: Add provider agnostic traceing#145
namrataghadi-galileo wants to merge 3 commits intomainfrom
feature/59789-add-provider-agnostic-tracing

Conversation

@namrataghadi-galileo
Copy link
Contributor

Summary
Added a new provider-agnostic telemetry package to the AgentControl Python SDK for external trace context resolution and merged control event emission.
Updated tracing to consult a registered external trace context provider before falling back to OTEL context.
Exported the new telemetry APIs from the top-level agent_control package.
Added focused tests to ensure provider/sink failures do not affect existing behavior.

Scope

  • User-facing/API changes:

    • New SDK APIs:

      1. set_trace_context_provider(...)
      2. get_trace_context_from_provider()
      3. clear_trace_context_provider()
      4. set_control_event_sink(...)
      5. emit_control_events(...)
      6. clear_control_event_sink()
  • Internal changes:

    • Added:

      1. agent_control/telemetry/trace_context.py
      2. agent_control/telemetry/event_sink.py
      3. agent_control/telemetry/init.py
      4. Updated tracing.py to use external provider before OTEL fallback.
      5. Added tests for provider behavior, sink behavior, and tracing precedence.

Risk and Rollout
Risk level: low
Rollback plan:
Revert the new telemetry package and the small tracing/export changes in the SDK.
Since the change is additive and inactive unless a provider or sink is explicitly registered, rollback is straightforward.

Testing

  • Added or updated automated tests
  • Ran make check (or explained why not)
  • Ran targeted SDK tests only; did not run the full project check suite.
  • Manually verified behavior

Checklist

  • Linked issue/spec (if applicable)
  • Updated docs/examples for user-facing changes
  • Included any required follow-up tasks

@namrataghadi-galileo namrataghadi-galileo changed the title feat(sdk): Add provider agnostic traceing feat(sdk): [Enterprise Integration]: Add provider agnostic traceing Mar 23, 2026
@codecov
Copy link

codecov bot commented Mar 23, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@lan17
Copy link
Contributor

lan17 commented Mar 23, 2026

Why not emit these from the server?

@namrataghadi-galileo
Copy link
Contributor Author

@lan17 Keeping emission in the SDK gives us one merged, ordered batch and a single integration model for both logger and non-logger flows

@lan17
Copy link
Contributor

lan17 commented Mar 23, 2026

@lan17 Keeping emission in the SDK gives us one merged, ordered batch and a single integration model for both logger and non-logger flows

What about other language sdks, like typescript, java, etc.?

If we can delegate this to agent control server then it makes sdk easier.

Could we just send additional metadata to agent control server when we send events to integrate with Galileo spans/traces?

@namrataghadi-galileo
Copy link
Contributor Author

Server-side emission is attractive for thinner SDKs, but it defeats the main purpose of the logger-based design: reusing Galileo Logger’s in-process trace buffering and flush. For logger integrations, the SDK must have the merged control events locally before flush. Other languages can still be supported through the thinner OTEL non-logger path until they need full logger integration.

@lan17
Copy link
Contributor

lan17 commented Mar 23, 2026

Server-side emission is attractive for thinner SDKs, but it defeats the main purpose of the logger-based design: reusing Galileo Logger’s in-process trace buffering and flush. For logger integrations, the SDK must have the merged control events locally before flush. Other languages can still be supported through the thinner OTEL non-logger path until they need full logger integration.

Should this be done outside of core OSS sdk, then?

This pattern conflicts with one @abhinav-galileo implemented where we emit events to the server (also via a buffer on SDK), so it maybe confusing to have both systems at same time.

@namrataghadi-galileo
Copy link
Contributor Author

namrataghadi-galileo commented Mar 23, 2026

The current PR only adds provider-agnostic hooks to OSS. It does not move logger context into OSS or change the default buffered event-to-server flow. Logger context, span conversion, trace attachment, and flush integration still belong to the external Galileo integration layer, so OSS is not taking on a second concrete observability system.

Also, it would be confusing if both were active default systems. It is much less confusing if the existing buffered SDK-to-server flow remains the only default OSS behavior and the new sink/provider APIs are treated purely as optional extension points for external integrations.

@namrataghadi-galileo
Copy link
Contributor Author

I’m also waiting to hear back from both Davids on the RFC and get their perspective on the proposed logger-based and non-logger-based approaches. That said, the hook additions themselves are independent of any Galileo-specific observability or tracing design. They are generic enough to support other third-party observability systems as well. For example, if LangSmith is the external observability framework, these hooks could still be used to publish trace_id and span_id

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants