Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
User description
Fix any breaking changes if this pull request fails to deploy
Generated description
Below is a concise technical summary of the changes proposed in this PR:
This pull request updates the application's API type definitions, introducing new endpoints for searching and partially querying log streams, experiments, traces, spans, and sessions. It significantly enhances data models with detailed event logging, metric roll-up configurations, and feedback rating information. Additionally, it adds a comprehensive framework for validating custom code scorers and refines various integration and column metadata types, improving data management and extensibility.
AnnotationQueueActionenum,validation_resultfor dataset content,generated_outputfor column mapping,stream_metricsfor job creation,deprecatedflag for scorers,project_idfor subscription config, andsession_external_idfor log ingest requests. These changes improve data consistency, clarity, and support for new features.Modified files (3)
Latest Contributors(0)
logging_method,client_version, andreliablefields toSessionCreateRequestfor more robust session creation. It also modifiesUserCollaboratorCreateto allow user invitation by email, enhancing user management flexibility.Modified files (3)
Latest Contributors(0)
AggregatedTraceView,AggregatedTraceViewNode,ExperimentResponse,LogStreamResponse,Extended*Recordtypes, andPartialExtended*Recordtypes. Key additions includeedge_occurrences_histogramandinsightsfor trace views,feedback_rating_infoandmetric_infofor various records, andnum_spans/num_tracescounts. It also introduces new event types for LLM spans, such asMessageEvent,ReasoningEvent,InternalToolCall,WebSearchCallEvent,ImageGenerationEvent,MCPCallEvent,MCPListToolsEvent, andMCPApprovalRequestEvent, providing richer context for LLM interactions.Modified files (3)
Latest Contributors(0)
BaseMetricRollUpConfigDB,NumericRollUpMethod,CategoricalRollUpMethod,RollUpStrategy,ChainAggregationStrategy) and updatesMetricThresholdwith more detailed settings. This allows for more flexible and powerful aggregation and display of metrics across different levels of the trace/span/session hierarchy. It also adds new scorer types related to SQL metrics and composite user-registered scorers.Modified files (3)
Latest Contributors(0)
AndNode,OrNode,NotNode,FilterLeaf) to be specifically typed forLogRecordsfilters, improving type safety and clarity. It also updatesLogRecordsColumnInfowith additional metadata fields likefilter_type,label_color, andis_optional, and introducesSelectColumnsfor explicit column selection in queries.Modified files (3)
Latest Contributors(0)
Modified files (3)
Latest Contributors(0)
Modified files (3)
Latest Contributors(0)
Modified files (3)
Latest Contributors(0)
inference_profilesto AWS and Azure OpenAI integrations,legacy_mistral_prompt_formatandmax_top_pto Mistral, and a newCustomLLMConfigfor custom LiteLLM handlers. TheCustomIntegrationtoken is now optional, andCustomAuthenticationTypeincludes a 'none' option. These changes provide greater flexibility and control over LLM integration settings.Modified files (3)
Latest Contributors(0)