[MLOB-1524] feat(llmobs): introduce LLM Observability SDK #4742
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Introduces an LLM Observability SDK into the tracer, with its own tracing API extending the core tracer, and span tagging and processing functionality to flush LLM Observability spans to LLM Observability.
The following PRs have been merged into the branch for this PR, and have been reviewed and approved:
#4696 APM: @ida613 LLMObs: @Yun-Kim
#4699 APM: @rochdev LLMObs: @Yun-Kim
#4718 APM: @rochdev LLMObs @Yun-Kim
#4738 APM: @rochdev LLMObs: @lievan
[Rest of description WIP, will populate with relevant docs links. This PR will have at least 2 more commits pushed, one with the span processing logic, and one with the core SDK and Typescript definitions]
Submitting OpenAI spans will be a direct follow-up PR.
Motivation
Introduce core LLM Observability SDK logic into the tracer.