Index
AgentService(interface)EvaluationService(interface)SessionService(interface)ToolService(interface)WidgetService(interface)Action(message)Action.EntityOperation(message)Action.EntityOperation.OperationType(enum)Agent(message)Agent.AgentToolset(message)Agent.LlmAgent(message)Agent.RemoteDialogflowAgent(message)AgentTool(message)AgentTransfer(message)AggregatedMetrics(message)AggregatedMetrics.HallucinationMetrics(message)AggregatedMetrics.MetricsByAppVersion(message)AggregatedMetrics.MetricsByTurn(message)AggregatedMetrics.SemanticSimilarityMetrics(message)AggregatedMetrics.ToolCallLatencyMetrics(message)AggregatedMetrics.ToolMetrics(message)AggregatedMetrics.TurnLatencyMetrics(message)AmbientSoundConfig(message)AmbientSoundConfig.PrebuiltAmbientNoise(enum)ApiAuthentication(message)ApiKeyConfig(message)ApiKeyConfig.RequestLocation(enum)App(message)App.ToolExecutionMode(enum)App.VariableDeclaration(message)AppSnapshot(message)AppVersion(message)AudioEncoding(enum)AudioProcessingConfig(message)AudioRecordingConfig(message)BargeInConfig(message)BatchDeleteConversationsRequest(message)BatchDeleteConversationsResponse(message)BearerTokenConfig(message)BidiSessionClientMessage(message)BidiSessionServerMessage(message)BigQueryExportSettings(message)Blob(message)Callback(message)Changelog(message)ChannelProfile(message)ChannelProfile.ChannelType(enum)ChannelProfile.PersonaProperty(message)ChannelProfile.PersonaProperty.Persona(enum)ChannelProfile.WebWidgetConfig(message)ChannelProfile.WebWidgetConfig.Modality(enum)ChannelProfile.WebWidgetConfig.SecuritySettings(message)ChannelProfile.WebWidgetConfig.Theme(enum)Chunk(message)Citations(message)Citations.CitedChunk(message)ClientCertificateSettings(message)ClientFunction(message)CloudLoggingSettings(message)CodeBlock(message)ConnectorTool(message)ConnectorToolset(message)Conversation(message)Conversation.ChannelType(enum)Conversation.InputType(enum)Conversation.Source(enum)Conversation.Turn(message)ConversationLoggingSettings(message)CreateAgentRequest(message)CreateAppRequest(message)CreateAppVersionRequest(message)CreateDeploymentRequest(message)CreateEvaluationDatasetRequest(message)CreateEvaluationExpectationRequest(message)CreateEvaluationRequest(message)CreateExampleRequest(message)CreateGuardrailRequest(message)CreateScheduledEvaluationRunRequest(message)CreateToolRequest(message)CreateToolsetRequest(message)DataStore(message)DataStore.ConnectorConfig(message)DataStore.DataStoreType(enum)DataStore.DocumentProcessingMode(enum)DataStoreSettings(message)DataStoreSettings.Engine(message)DataStoreSettings.Engine.Type(enum)DataStoreTool(message)DataStoreTool.BoostSpec(message)DataStoreTool.BoostSpec.ConditionBoostSpec(message)DataStoreTool.BoostSpec.ConditionBoostSpec.BoostControlSpec(message)DataStoreTool.BoostSpec.ConditionBoostSpec.BoostControlSpec.AttributeType(enum)DataStoreTool.BoostSpec.ConditionBoostSpec.BoostControlSpec.ControlPoint(message)DataStoreTool.BoostSpec.ConditionBoostSpec.BoostControlSpec.InterpolationType(enum)DataStoreTool.BoostSpecs(message)DataStoreTool.DataStoreSource(message)DataStoreTool.EngineSource(message)DataStoreTool.FilterParameterBehavior(enum)DataStoreTool.GroundingConfig(message)DataStoreTool.ModalityConfig(message)DataStoreTool.ModalityConfig.ModalityType(enum)DataStoreTool.RewriterConfig(message)DataStoreTool.SummarizationConfig(message)DeleteAgentRequest(message)DeleteAppRequest(message)DeleteAppVersionRequest(message)DeleteConversationRequest(message)DeleteDeploymentRequest(message)DeleteEvaluationDatasetRequest(message)DeleteEvaluationExpectationRequest(message)DeleteEvaluationRequest(message)DeleteEvaluationResultRequest(message)DeleteEvaluationRunOperationMetadata(message)DeleteEvaluationRunRequest(message)DeleteExampleRequest(message)DeleteGuardrailRequest(message)DeleteScheduledEvaluationRunRequest(message)DeleteToolRequest(message)DeleteToolsetRequest(message)Deployment(message)EndSession(message)EndUserAuthConfig(message)EndUserAuthConfig.Oauth2AuthCodeConfig(message)EndUserAuthConfig.Oauth2JwtBearerConfig(message)EndpointControlPolicy(message)EndpointControlPolicy.EnforcementScope(enum)ErrorHandlingSettings(message)ErrorHandlingSettings.EndSessionConfig(message)ErrorHandlingSettings.ErrorHandlingStrategy(enum)ErrorHandlingSettings.FallbackResponseConfig(message)Evaluation(message)Evaluation.Golden(message)Evaluation.GoldenExpectation(message)Evaluation.GoldenTurn(message)Evaluation.Scenario(message)Evaluation.Scenario.TaskCompletionBehavior(enum)Evaluation.Scenario.UserFact(message)Evaluation.Scenario.UserGoalBehavior(enum)Evaluation.ScenarioExpectation(message)Evaluation.ScenarioExpectation.ToolExpectation(message)Evaluation.Step(message)EvaluationConfig(message)EvaluationConfig.EvaluationChannel(enum)EvaluationDataset(message)EvaluationErrorInfo(message)EvaluationErrorInfo.ErrorType(enum)EvaluationExpectation(message)EvaluationExpectation.LlmCriteria(message)EvaluationMetricsThresholds(message)EvaluationMetricsThresholds.GoldenEvaluationMetricsThresholds(message)EvaluationMetricsThresholds.GoldenEvaluationMetricsThresholds.ExpectationLevelMetricsThresholds(message)EvaluationMetricsThresholds.GoldenEvaluationMetricsThresholds.TurnLevelMetricsThresholds(message)EvaluationMetricsThresholds.GoldenEvaluationMetricsThresholds.TurnLevelMetricsThresholds.SemanticSimilarityChannel(enum)EvaluationMetricsThresholds.HallucinationMetricBehavior(enum)EvaluationMetricsThresholds.ToolMatchingSettings(message)EvaluationMetricsThresholds.ToolMatchingSettings.ExtraToolCallBehavior(enum)EvaluationPersona(message)EvaluationPersona.SpeechConfig(message)EvaluationPersona.SpeechConfig.BackgroundEnvironment(enum)EvaluationResult(message)EvaluationResult.EvaluationExpectationResult(message)EvaluationResult.ExecutionState(enum)EvaluationResult.GoldenExpectationOutcome(message)EvaluationResult.GoldenExpectationOutcome.ToolInvocationResult(message)EvaluationResult.GoldenResult(message)EvaluationResult.GoldenResult.TurnReplayResult(message)EvaluationResult.HallucinationResult(message)EvaluationResult.Outcome(enum)EvaluationResult.OverallToolInvocationResult(message)EvaluationResult.ScenarioExpectationOutcome(message)EvaluationResult.ScenarioExpectationOutcome.ObservedToolCall(message)EvaluationResult.ScenarioResult(message)EvaluationResult.ScenarioRubricOutcome(message)EvaluationResult.SemanticSimilarityResult(message)EvaluationResult.SpanLatency(message)EvaluationResult.SpanLatency.Type(enum)EvaluationResult.TaskCompletionResult(message)EvaluationResult.ToolCallLatency(message)EvaluationResult.UserGoalSatisfactionResult(message)EvaluationRun(message)EvaluationRun.EvaluationRunState(enum)EvaluationRun.EvaluationRunSummary(message)EvaluationRun.EvaluationType(enum)EvaluationRun.Progress(message)EvaluationSettings(message)EvaluationSettings.ScenarioConversationInitiator(enum)EvaluationToolCallBehaviour(enum)Event(message)Example(message)ExecuteToolRequest(message)ExecuteToolResponse(message)ExecutionType(enum)ExportAppRequest(message)ExportAppRequest.ExportFormat(enum)ExportAppResponse(message)ExportEvaluationsRequest(message)ExportEvaluationsResponse(message)ExportOptions(message)ExportOptions.ExportFormat(enum)ExpressionCondition(message)FileContext(message)FileContext.FileBytes(message)FileSearchTool(message)FileSearchTool.CorpusType(enum)GenerateAppResourceOperationMetadata(message)GenerateAppResourceOperationMetadata.GenerationType(enum)GenerateAppResourceRequest(message)GenerateAppResourceRequest.AppGenerationConfig(message)GenerateAppResourceRequest.EvaluationGenerationConfig(message)GenerateAppResourceRequest.EvaluationPersonasGenerationConfig(message)GenerateAppResourceRequest.HillClimbingFixConfig(message)GenerateAppResourceRequest.QualityReportGenerationConfig(message)GenerateAppResourceRequest.RefineInstructions(message)GenerateAppResourceRequest.ToolGenerationConfig(message)GenerateAppResourceRequest.ToolGenerationConfig.OpenApiToolsetGenerationConfig(message)GenerateAppResourceRequest.ToolGenerationConfig.OpenApiToolsetGenerationConfig.OperationGenerationConfig(message)GenerateAppResourceResponse(message)GenerateAppResourceResponse.AppResources(message)GenerateAppResourceResponse.Evaluations(message)GenerateAppResourceResponse.GenerateResultInfo(message)GenerateAppResourceResponse.Tools(message)GenerateChatTokenRequest(message)GenerateChatTokenResponse(message)GenerateEvaluationOperationMetadata(message)GenerateEvaluationRequest(message)GetAgentRequest(message)GetAppRequest(message)GetAppVersionRequest(message)GetChangelogRequest(message)GetConversationRequest(message)GetDeploymentRequest(message)GetEvaluationDatasetRequest(message)GetEvaluationExpectationRequest(message)GetEvaluationRequest(message)GetEvaluationResultRequest(message)GetEvaluationRunRequest(message)GetExampleRequest(message)GetGuardrailRequest(message)GetScheduledEvaluationRunRequest(message)GetSecuritySettingsRequest(message)GetToolRequest(message)GetToolsetRequest(message)GoAway(message)GoldenRunMethod(enum)GoogleSearchSuggestions(message)GoogleSearchTool(message)GoogleSearchTool.PromptConfig(message)Guardrail(message)Guardrail.CodeCallback(message)Guardrail.ContentFilter(message)Guardrail.ContentFilter.MatchType(enum)Guardrail.LlmPolicy(message)Guardrail.LlmPolicy.PolicyScope(enum)Guardrail.LlmPromptSecurity(message)Guardrail.LlmPromptSecurity.DefaultSecuritySettings(message)Guardrail.ModelSafety(message)Guardrail.ModelSafety.HarmBlockThreshold(enum)Guardrail.ModelSafety.HarmCategory(enum)Guardrail.ModelSafety.SafetySetting(message)Image(message)ImportAppRequest(message)ImportAppRequest.ImportOptions(message)ImportAppRequest.ImportOptions.ConflictResolutionStrategy(enum)ImportAppResponse(message)ImportEvaluationsOperationMetadata(message)ImportEvaluationsRequest(message)ImportEvaluationsRequest.ConversationList(message)ImportEvaluationsRequest.ImportOptions(message)ImportEvaluationsRequest.ImportOptions.ConflictResolutionStrategy(enum)ImportEvaluationsResponse(message)InputAudioConfig(message)InterruptionSignal(message)LanguageSettings(message)LatencyReport(message)LatencyReport.CallbackLatency(message)LatencyReport.GuardrailLatency(message)LatencyReport.LatencyMetrics(message)LatencyReport.LlmCallLatency(message)LatencyReport.ToolLatency(message)ListAgentsRequest(message)ListAgentsResponse(message)ListAppVersionsRequest(message)ListAppVersionsResponse(message)ListAppsRequest(message)ListAppsResponse(message)ListChangelogsRequest(message)ListChangelogsResponse(message)ListConversationsRequest(message)ListConversationsResponse(message)ListDeploymentsRequest(message)ListDeploymentsResponse(message)ListEvaluationDatasetsRequest(message)ListEvaluationDatasetsResponse(message)ListEvaluationExpectationsRequest(message)ListEvaluationExpectationsResponse(message)ListEvaluationResultsRequest(message)ListEvaluationResultsResponse(message)ListEvaluationRunsRequest(message)ListEvaluationRunsResponse(message)ListEvaluationsRequest(message)ListEvaluationsResponse(message)ListExamplesRequest(message)ListExamplesResponse(message)ListGuardrailsRequest(message)ListGuardrailsResponse(message)ListScheduledEvaluationRunsRequest(message)ListScheduledEvaluationRunsResponse(message)ListToolsRequest(message)ListToolsResponse(message)ListToolsetsRequest(message)ListToolsetsResponse(message)LoggingSettings(message)McpTool(message)McpToolset(message)Message(message)MetricAnalysisSettings(message)MockConfig(message)MockConfig.UnmatchedToolCallBehavior(enum)MockedToolCall(message)ModelSettings(message)OAuthConfig(message)OAuthConfig.OauthGrantType(enum)Omnichannel(message)OmnichannelIntegrationConfig(message)OmnichannelIntegrationConfig.CesAppConfig(message)OmnichannelIntegrationConfig.ChannelConfig(message)OmnichannelIntegrationConfig.RoutingConfig(message)OmnichannelIntegrationConfig.SubscriberConfig(message)OmnichannelIntegrationConfig.WhatsappConfig(message)OmnichannelOperationMetadata(message)OpenApiTool(message)OpenApiToolset(message)OperationMetadata(message)OptimizationConfig(message)OptimizationConfig.OptimizationStatus(enum)OutputAudioConfig(message)PersonaRunConfig(message)PythonCodeCondition(message)PythonFunction(message)QualityReport(message)QualityReport.AgentIssues(message)QualityReport.Issue(message)RecognitionResult(message)RedactionConfig(message)RestoreAppVersionRequest(message)RestoreAppVersionResponse(message)RetrieveToolSchemaRequest(message)RetrieveToolSchemaResponse(message)RetrieveToolsRequest(message)RetrieveToolsResponse(message)RunEvaluationOperationMetadata(message)RunEvaluationRequest(message)RunEvaluationResponse(message)RunSessionRequest(message)RunSessionResponse(message)ScheduledEvaluationRun(message)ScheduledEvaluationRun.SchedulingConfig(message)ScheduledEvaluationRun.SchedulingConfig.Frequency(enum)Schema(message)Schema.Type(enum)SecuritySettings(message)ServiceAccountAuthConfig(message)ServiceAgentIdTokenAuthConfig(message)ServiceDirectoryConfig(message)SessionConfig(message)SessionConfig.RemoteDialogflowQueryParameters(message)SessionInput(message)SessionOutput(message)SessionOutput.DiagnosticInfo(message)Span(message)SynthesizeSpeechConfig(message)SystemTool(message)TestPersonaVoiceRequest(message)TestPersonaVoiceResponse(message)TimeZoneSettings(message)TlsConfig(message)TlsConfig.CaCert(message)Tool(message)ToolCall(message)ToolCalls(message)ToolFakeConfig(message)ToolResponse(message)ToolResponses(message)Toolset(message)ToolsetTool(message)TransferRule(message)TransferRule.DeterministicTransfer(message)TransferRule.Direction(enum)TransferRule.DisablePlannerTransfer(message)TriggerAction(message)TriggerAction.GenerativeAnswer(message)TriggerAction.RespondImmediately(message)TriggerAction.Response(message)TriggerAction.TransferAgent(message)UpdateAgentRequest(message)UpdateAppRequest(message)UpdateDeploymentRequest(message)UpdateEvaluationDatasetRequest(message)UpdateEvaluationExpectationRequest(message)UpdateEvaluationRequest(message)UpdateExampleRequest(message)UpdateGuardrailRequest(message)UpdateScheduledEvaluationRunRequest(message)UpdateSecuritySettingsRequest(message)UpdateToolRequest(message)UpdateToolsetRequest(message)UploadEvaluationAudioRequest(message)UploadEvaluationAudioResponse(message)WebSearchQuery(message)WidgetTool(message)WidgetTool.DataMapping(message)WidgetTool.DataMapping.Mode(enum)WidgetTool.WidgetType(enum)
AgentService
The service that manages agent-related resources in Gemini Enterprise for Customer Engagement (CES).
| BatchDeleteConversations |
|---|
|
Batch deletes the specified conversations.
|
| CreateAgent |
|---|
|
Creates a new agent in the given app.
|
| CreateApp |
|---|
|
Creates a new app in the given project and location.
|
| CreateAppVersion |
|---|
|
Creates a new app version in the given app.
|
| CreateDeployment |
|---|
|
Creates a new deployment in the given app.
|
| CreateExample |
|---|
|
Creates a new example in the given app.
|
| CreateGuardrail |
|---|
|
Creates a new guardrail in the given app.
|
| CreateTool |
|---|
|
Creates a new tool in the given app.
|
| CreateToolset |
|---|
|
Creates a new toolset in the given app.
|
| DeleteAgent |
|---|
|
Deletes the specified agent.
|
| DeleteApp |
|---|
|
Deletes the specified app.
|
| DeleteAppVersion |
|---|
|
Deletes the specified app version.
|
| DeleteConversation |
|---|
|
Deletes the specified conversation.
|
| DeleteDeployment |
|---|
|
Deletes the specified deployment.
|
| DeleteExample |
|---|
|
Deletes the specified example.
|
| DeleteGuardrail |
|---|
|
Deletes the specified guardrail.
|
| DeleteTool |
|---|
|
Deletes the specified tool.
|
| DeleteToolset |
|---|
|
Deletes the specified toolset.
|
| ExportApp |
|---|
|
Exports the specified app.
|
| GenerateAppResource |
|---|
|
Generates specific resources (e.g. agent) in the app using LLM assistant.
|
| GetAgent |
|---|
|
Gets details of the specified agent.
|
| GetApp |
|---|
|
Gets details of the specified app.
|
| GetAppVersion |
|---|
|
Gets details of the specified app version.
|
| GetChangelog |
|---|
|
Gets the specified changelog.
|
| GetConversation |
|---|
|
Gets details of the specified conversation.
|
| GetDeployment |
|---|
|
Gets details of the specified deployment.
|
| GetExample |
|---|
|
Gets details of the specified example.
|
| GetGuardrail |
|---|
|
Gets details of the specified guardrail.
|
| GetSecuritySettings |
|---|
|
Retrieves the security settings for the project and location.
|
| GetTool |
|---|
|
Gets details of the specified tool.
|
| GetToolset |
|---|
|
Gets details of the specified toolset.
|
| ImportApp |
|---|
|
Imports the specified app.
|
| ListAgents |
|---|
|
Lists agents in the given app.
|
| ListAppVersions |
|---|
|
Lists all app versions in the given app.
|
| ListApps |
|---|
|
Lists apps in the given project and location.
|
| ListChangelogs |
|---|
|
Lists the changelogs of the specified app.
|
| ListConversations |
|---|
|
Lists conversations in the given app.
|
| ListDeployments |
|---|
|
Lists deployments in the given app.
|
| ListExamples |
|---|
|
Lists examples in the given app.
|
| ListGuardrails |
|---|
|
Lists guardrails in the given app.
|
| ListTools |
|---|
|
Lists tools in the given app.
|
| ListToolsets |
|---|
|
Lists toolsets in the given app.
|
| RestoreAppVersion |
|---|
|
Restores the specified app version. This will create a new app version from the current draft app and overwrite the current draft with the specified app version.
|
| UpdateAgent |
|---|
|
Updates the specified agent.
|
| UpdateApp |
|---|
|
Updates the specified app.
|
| UpdateDeployment |
|---|
|
Updates the specified deployment.
|
| UpdateExample |
|---|
|
Updates the specified example.
|
| UpdateGuardrail |
|---|
|
Updates the specified guardrail.
|
| UpdateSecuritySettings |
|---|
|
Updates the security settings for the project and location.
|
| UpdateTool |
|---|
|
Updates the specified tool.
|
| UpdateToolset |
|---|
|
Updates the specified toolset.
|
EvaluationService
EvaluationService exposes methods to perform evaluation for the CES app.
| CreateEvaluation |
|---|
|
Creates an evaluation.
|
| CreateEvaluationDataset |
|---|
|
Creates an evaluation dataset.
|
| CreateEvaluationExpectation |
|---|
|
Creates an evaluation expectation.
|
| CreateScheduledEvaluationRun |
|---|
|
Creates a scheduled evaluation run.
|
| DeleteEvaluation |
|---|
|
Deletes an evaluation.
|
| DeleteEvaluationDataset |
|---|
|
Deletes an evaluation dataset.
|
| DeleteEvaluationExpectation |
|---|
|
Deletes an evaluation expectation.
|
| DeleteEvaluationResult |
|---|
|
Deletes an evaluation result.
|
| DeleteEvaluationRun |
|---|
|
Deletes an evaluation run.
|
| DeleteScheduledEvaluationRun |
|---|
|
Deletes a scheduled evaluation run.
|
| ExportEvaluations |
|---|
|
Exports evaluations.
|
| GenerateEvaluation |
|---|
|
Creates a golden evaluation from a conversation.
|
| GetEvaluation |
|---|
|
Gets details of the specified evaluation.
|
| GetEvaluationDataset |
|---|
|
Gets details of the specified evaluation dataset.
|
| GetEvaluationExpectation |
|---|
|
Gets details of the specified evaluation expectation.
|
| GetEvaluationResult |
|---|
|
Gets details of the specified evaluation result.
|
| GetEvaluationRun |
|---|
|
Gets details of the specified evaluation run.
|
| GetScheduledEvaluationRun |
|---|
|
Gets details of the specified scheduled evaluation run.
|
| ImportEvaluations |
|---|
|
Imports evaluations into the app.
|
| ListEvaluationDatasets |
|---|
|
Lists all evaluation datasets in the given app.
|
| ListEvaluationExpectations |
|---|
|
Lists all evaluation expectations in the given app.
|
| ListEvaluationResults |
|---|
|
Lists all evaluation results for a given evaluation.
|
| ListEvaluationRuns |
|---|
|
Lists all evaluation runs in the given app.
|
| ListEvaluations |
|---|
|
Lists all evaluations in the given app.
|
| ListScheduledEvaluationRuns |
|---|
|
Lists all scheduled evaluation runs in the given app.
|
| RunEvaluation |
|---|
|
Runs an evaluation of the app.
|
| TestPersonaVoice |
|---|
|
Tests the voice of a persona. Also accepts a default persona.
|
| UpdateEvaluation |
|---|
|
Updates an evaluation.
|
| UpdateEvaluationDataset |
|---|
|
Updates an evaluation dataset.
|
| UpdateEvaluationExpectation |
|---|
|
Updates an evaluation expectation.
|
| UpdateScheduledEvaluationRun |
|---|
|
Updates a scheduled evaluation run.
|
| UploadEvaluationAudio |
|---|
|
Uploads audio for use in Golden Evaluations. Stores the audio in the Cloud Storage bucket defined in 'App.logging_settings.evaluation_audio_recording_config.gcs_bucket' and returns a transcript.
|
SessionService
Session service provides APIs for interacting with CES agents.
| BidiRunSession |
|---|
|
Establishes a bidirectional streaming connection with the CES agent. The agent processes continuous multimodal inputs (e.g., text, audio) and generates real-time multimodal output streams. --- Client Request Stream --- The client streams requests in the following order:
--- Server Response Stream --- For each interaction turn, the agent streams messages in the following sequence:
--- Audio Best Practices --- 1. Streaming: Stream
|
| RunSession |
|---|
|
Initiates a single-turn interaction with the CES agent within a session.
|
| StreamRunSession |
|---|
|
Initiates a single-turn interaction with the CES agent. Uses server-side streaming to deliver incremental results and partial responses as they are generated. By default, complete responses (e.g., messages from callbacks or full LLM responses) are sent to the client as soon as they are available. To enable streaming individual text chunks directly from the model, set
|
ToolService
Tool service provides APIs for interacting with CES tools.
| ExecuteTool |
|---|
|
Executes the given tool with the given arguments.
|
| RetrieveToolSchema |
|---|
|
Retrieve the schema of the given tool. The schema is computed on the fly for the given instance of the tool.
|
| RetrieveTools |
|---|
|
Retrieve the list of tools included in the specified toolset.
|
WidgetService
Provides APIs for widgets to interact with CES APIs.
| GenerateChatToken |
|---|
|
Generates a session scoped token for chat widget to authenticate with Session APIs.
|
Action
Configuration of an Action for the tool to use. Note: This can be either an Action or an Operation. See https://cloud.google.com/integration-connectors/docs/entities-operation-action for details.
| Fields | |
|---|---|
input_fields[] |
Optional. Entity fields to use as inputs for the operation. If no fields are specified, all fields of the Entity will be used. |
output_fields[] |
Optional. Entity fields to return from the operation. If no fields are specified, all fields of the Entity will be returned. |
Union field action_spec. Specification for an action to configure for the tool to use. action_spec can be only one of the following: |
|
connection_action_id |
ID of a Connection action for the tool to use. |
entity_operation |
Entity operation configuration for the tool to use. |
EntityOperation
Entity CRUD operation specification.
| Fields | |
|---|---|
entity_id |
Required. ID of the entity. |
operation |
Required. Operation to perform on the entity. |
OperationType
The operation to perform on the entity.
| Enums | |
|---|---|
OPERATION_TYPE_UNSPECIFIED |
Operation type unspecified. Invalid, ConnectorTool create/update will fail. |
LIST |
List operation. |
GET |
Get operation. |
CREATE |
Create operation. |
UPDATE |
Update operation. |
DELETE |
Delete operation. |
Agent
An agent acts as the fundamental building block that provides instructions to the Large Language Model (LLM) for executing specific tasks.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the agent. Format: |
display_name |
Required. Display name of the agent. |
description |
Optional. Human-readable description of the agent. |
model_settings |
Optional. Configurations for the LLM model. |
instruction |
Optional. Instructions for the LLM model to guide the agent's behavior. |
tools[] |
Optional. List of available tools for the agent. Format: |
child_agents[] |
Optional. List of child agents in the agent tree. Format: |
before_agent_callbacks[] |
Optional. The callbacks to execute before the agent is called. The provided callbacks are executed sequentially in the exact order they are given in the list. If a callback returns an overridden response, execution stops and any remaining callbacks are skipped. |
after_agent_callbacks[] |
Optional. The callbacks to execute after the agent is called. The provided callbacks are executed sequentially in the exact order they are given in the list. If a callback returns an overridden response, execution stops and any remaining callbacks are skipped. |
before_model_callbacks[] |
Optional. The callbacks to execute before the model is called. If there are multiple calls to the model, the callback will be executed multiple times. The provided callbacks are executed sequentially in the exact order they are given in the list. If a callback returns an overridden response, execution stops and any remaining callbacks are skipped. |
after_model_callbacks[] |
Optional. The callbacks to execute after the model is called. If there are multiple calls to the model, the callback will be executed multiple times. The provided callbacks are executed sequentially in the exact order they are given in the list. If a callback returns an overridden response, execution stops and any remaining callbacks are skipped. |
before_tool_callbacks[] |
Optional. The callbacks to execute before the tool is invoked. If there are multiple tool invocations, the callback will be executed multiple times. The provided callbacks are executed sequentially in the exact order they are given in the list. If a callback returns an overridden response, execution stops and any remaining callbacks are skipped. |
after_tool_callbacks[] |
Optional. The callbacks to execute after the tool is invoked. If there are multiple tool invocations, the callback will be executed multiple times. The provided callbacks are executed sequentially in the exact order they are given in the list. If a callback returns an overridden response, execution stops and any remaining callbacks are skipped. |
create_time |
Output only. Timestamp when the agent was created. |
update_time |
Output only. Timestamp when the agent was last updated. |
guardrails[] |
Optional. List of guardrails for the agent. Format: |
etag |
Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
toolsets[] |
Optional. List of toolsets for the agent. |
generated_summary |
Output only. If the agent is generated by the LLM assistant, this field contains a descriptive summary of the generation. |
transfer_rules[] |
Optional. Agent transfer rules. If multiple rules match, the first one in the list will be used. |
Union field agent_type. The type of agent. agent_type can be only one of the following: |
|
llm_agent |
Optional. The default agent type. |
remote_dialogflow_agent |
Optional. The remote Dialogflow agent to be used for the agent execution. If this field is set, all other agent level properties will be ignored. Note: If the Dialogflow agent is in a different project from the app, you should grant |
AgentToolset
A toolset with a selection of its tools.
| Fields | |
|---|---|
toolset |
Required. The resource name of the toolset. Format: |
tool_ids[] |
Optional. The tools IDs to filter the toolset. |
LlmAgent
This type has no fields.
Default agent type. The agent uses instructions and callbacks specified in the agent to perform the task using a large language model.
RemoteDialogflowAgent
The agent which will transfer execution to a remote Dialogflow CX agent. The Dialogflow agent will process subsequent user queries until the session ends or flow ends, and the control is transferred back to the parent CES agent.
| Fields | |
|---|---|
agent |
Required. The Dialogflow agent resource name. Format: |
flow_id |
Optional. The flow ID of the flow in the Dialogflow agent. |
environment_id |
Optional. The environment ID of the Dialogflow agent to be used for the agent execution. If not specified, the draft environment will be used. |
input_variable_mapping |
Optional. The mapping of the app variables names to the Dialogflow session parameters names to be sent to the Dialogflow agent as input. |
output_variable_mapping |
Optional. The mapping of the Dialogflow session parameters names to the app variables names to be sent back to the CES agent after the Dialogflow agent execution ends. |
respect_response_interruption_settings |
Optional. Indicates whether to respect the message-level interruption settings configured in the Dialogflow agent.
|
AgentTool
Represents a tool that allows the agent to call another agent.
| Fields | |
|---|---|
name |
Required. The name of the agent tool. |
description |
Optional. Description of the tool's purpose. |
root_agent |
Optional. Deprecated: Use |
agent |
Optional. The resource name of the agent that is the entry point of the tool. Format: |
AgentTransfer
Represents an event indicating the transfer of a conversation to a different agent.
| Fields | |
|---|---|
target_agent |
Required. The agent to which the conversation is being transferred. The agent will handle the conversation from this point forward. Format: |
display_name |
Output only. Display name of the agent. |
AggregatedMetrics
Aggregated metrics for an evaluation or evaluation dataset.
| Fields | |
|---|---|
metrics_by_app_version[] |
Output only. Aggregated metrics, grouped by app version ID. |
HallucinationMetrics
Metrics for hallucination results.
| Fields | |
|---|---|
score |
Output only. The average hallucination score (0 to 1). |
MetricsByAppVersion
Metrics aggregated per app version.
| Fields | |
|---|---|
app_version_id |
Output only. The app version ID. |
tool_metrics[] |
Output only. Metrics for each tool within this app version. |
semantic_similarity_metrics[] |
Output only. Metrics for semantic similarity within this app version. |
hallucination_metrics[] |
Output only. Metrics for hallucination within this app version. |
tool_call_latency_metrics[] |
Output only. Metrics for tool call latency within this app version. |
turn_latency_metrics[] |
Output only. Metrics for turn latency within this app version. |
pass_count |
Output only. The number of times the evaluation passed. |
fail_count |
Output only. The number of times the evaluation failed. |
metrics_by_turn[] |
Output only. Metrics aggregated per turn within this app version. |
MetricsByTurn
Metrics aggregated per turn.
| Fields | |
|---|---|
turn_index |
Output only. The turn index (0-based). |
tool_metrics[] |
Output only. Metrics for each tool within this turn. |
semantic_similarity_metrics[] |
Output only. Metrics for semantic similarity within this turn. |
hallucination_metrics[] |
Output only. Metrics for hallucination within this turn. |
tool_call_latency_metrics[] |
Output only. Metrics for tool call latency within this turn. |
turn_latency_metrics[] |
Output only. Metrics for turn latency within this turn. |
SemanticSimilarityMetrics
Metrics for semantic similarity results.
| Fields | |
|---|---|
score |
Output only. The average semantic similarity score (0-4). |
ToolCallLatencyMetrics
Metrics for tool call latency.
| Fields | |
|---|---|
tool |
Output only. The name of the tool. |
average_latency |
Output only. The average latency of the tool calls. |
ToolMetrics
Metrics for a single tool.
| Fields | |
|---|---|
tool |
Output only. The name of the tool. |
pass_count |
Output only. The number of times the tool passed. |
fail_count |
Output only. The number of times the tool failed. |
TurnLatencyMetrics
Metrics for turn latency.
| Fields | |
|---|---|
average_latency |
Output only. The average latency of the turns. |
AmbientSoundConfig
Configuration for the ambient sound to be played with the synthesized agent response, to enhance the naturalness of the conversation.
| Fields | |
|---|---|
volume_gain_db |
Optional. Volume gain (in dB) of the normal native volume supported by ambient noise, in the range [-96.0, 16.0]. If unset, or set to a value of 0.0 (dB), will play at normal native signal amplitude. A value of -6.0 (dB) will play at approximately half the amplitude of the normal native signal amplitude. A value of +6.0 (dB) will play at approximately twice the amplitude of the normal native signal amplitude. We strongly recommend not to exceed +10 (dB) as there's usually no effective increase in loudness for any value greater than that. |
Union field source. Ambient noise to be played with the synthesized agent response, to enhance the naturalness of the conversation. source can be only one of the following: |
|
prebuilt_ambient_noise |
Optional. Deprecated: |
gcs_uri |
Optional. Ambient noise as a mono-channel, 16kHz WAV file stored in Cloud Storage. Note: Please make sure the CES service agent |
prebuilt_ambient_sound |
Optional. Name of the prebuilt ambient sound. Valid values are: - "coffee_shop" - "keyboard" - "keypad" - "hum" - "office_1" - "office_2" - "office_3" - "room_1" - "room_2" - "room_3" - "room_4" - "room_5" - "air_conditioner" |
PrebuiltAmbientNoise
Prebuilt ambient noise.
| Enums | |
|---|---|
PREBUILT_AMBIENT_NOISE_UNSPECIFIED |
Not specified. |
RETAIL_STORE |
Ambient noise of a retail store. |
CONVENTION_HALL |
Ambient noise of a convention hall. |
OUTDOOR |
Ambient noise of a street. |
ApiAuthentication
Authentication information required for API calls.
| Fields | |
|---|---|
Union field auth_config. The auth configuration. auth_config can be only one of the following: |
|
api_key_config |
Optional. Config for API key auth. |
oauth_config |
Optional. Config for OAuth. |
service_agent_id_token_auth_config |
Optional. Config for ID token auth generated from CES service agent. |
service_account_auth_config |
Optional. Config for service account authentication. |
bearer_token_config |
Optional. Config for bearer token auth. |
ApiKeyConfig
Configurations for authentication with API key.
| Fields | |
|---|---|
key_name |
Required. The parameter name or the header name of the API key. E.g., If the API request is "https://example.com/act?X-Api-Key= |
api_key_secret_version |
Required. The name of the SecretManager secret version resource storing the API key. Format: Note: You should grant |
request_location |
Required. Key location in the request. |
RequestLocation
The location of the API key in the request.
| Enums | |
|---|---|
REQUEST_LOCATION_UNSPECIFIED |
Unspecified. This value should not be used. |
HEADER |
Represents the key in http header. |
QUERY_STRING |
Represents the key in query string. |
App
An app serves as a top-level container for a group of agents, including the root agent and its sub-agents, along with their associated configurations. These agents work together to achieve specific goals within the app's context.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the app. Format: |
display_name |
Required. Display name of the app. |
description |
Optional. Human-readable description of the app. |
pinned |
Optional. Whether the app is pinned in the app list. |
root_agent |
Optional. The root agent is the entry point of the app. Format: |
language_settings |
Optional. Language settings of the app. |
time_zone_settings |
Optional. TimeZone settings of the app. |
audio_processing_config |
Optional. Audio processing configuration of the app. |
logging_settings |
Optional. Logging settings of the app. |
error_handling_settings |
Optional. Error handling settings of the app. |
model_settings |
Optional. The default LLM model settings for the app. Individual resources (e.g. agents, guardrails) can override these configurations as needed. |
tool_execution_mode |
Optional. The tool execution mode for the app. If not provided, will default to PARALLEL. |
evaluation_metrics_thresholds |
Optional. The evaluation thresholds for the app. |
variable_declarations[] |
Optional. The declarations of the variables. |
predefined_variable_declarations[] |
Output only. The declarations of predefined variables for the app. |
global_instruction |
Optional. Instructions for all the agents in the app. You can use this instruction to set up a stable identity or personality across all the agents. |
guardrails[] |
Optional. List of guardrails for the app. Format: |
data_store_settings |
Optional. The data store settings for the app. |
default_channel_profile |
Optional. The default channel profile used by the app. |
metadata |
Optional. Metadata about the app. This field can be used to store additional information relevant to the app's details or intended usages. |
create_time |
Output only. Timestamp when the app was created. |
update_time |
Output only. Timestamp when the app was last updated. |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
deployment_count |
Output only. Number of deployments in the app. |
client_certificate_settings |
Optional. The default client certificate settings for the app. |
locked |
Optional. Indicates whether the app is locked for changes. If the app is locked, modifications to the app resources will be rejected. |
evaluation_personas[] |
Optional. The evaluation personas for the app. This field is used to define the personas that can be used for evaluation. Maximum of 30 personas can be defined. |
evaluation_settings |
Optional. The evaluation settings for the app. |
ToolExecutionMode
Defines the tool execution behavior if there are multiple tools being selected by the agent at the same time.
| Enums | |
|---|---|
TOOL_EXECUTION_MODE_UNSPECIFIED |
Unspecified tool execution mode. Default to PARALLEL. |
PARALLEL |
If there are multiple tools being selected, they will be executed in parallel, with the same ToolContext. |
SEQUENTIAL |
If there are multiple tools being selected, they will be executed sequentially. The next tool will only be executed after the previous tool completes and it can see updated ToolContext from the previous tool. |
VariableDeclaration
Defines the structure and metadata for a variable.
| Fields | |
|---|---|
name |
Required. The name of the variable. The name must start with a letter or underscore and contain only letters, numbers, or underscores. |
description |
Required. The description of the variable. |
schema |
Required. The schema of the variable. |
AppSnapshot
A snapshot of the app.
| Fields | |
|---|---|
app |
Optional. The basic settings for the app. |
agents[] |
Optional. List of agents in the app. |
tools[] |
Optional. List of tools in the app. |
examples[] |
Optional. List of examples in the app. |
guardrails[] |
Optional. List of guardrails in the app. |
toolsets[] |
Optional. List of toolsets in the app. |
AppVersion
In Customer Engagement Suite (CES), an app version is a snapshot of the app at a specific point in time. It is immutable and cannot be modified once created.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the app version. Format: |
display_name |
Optional. The display name of the app version. |
description |
Optional. The description of the app version. |
creator |
Output only. Email of the user who created the app version. |
create_time |
Output only. Timestamp when the app version was created. |
snapshot |
Output only. The snapshot of the app when the version is created. |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
AudioEncoding
AudioEncoding specifies the encoding format for audio data.
| Enums | |
|---|---|
AUDIO_ENCODING_UNSPECIFIED |
Unspecified audio encoding. |
LINEAR16 |
16-bit linear PCM audio encoding. |
MULAW |
8-bit samples that compand 14-bit audio samples using G.711 PCMU/mu-law. |
ALAW |
8-bit samples that compand 14-bit audio samples using G.711 PCMU/A-law. |
AudioProcessingConfig
Configuration for how the input and output audio should be processed and delivered.
| Fields | |
|---|---|
synthesize_speech_configs |
Optional. Configuration of how the agent response should be synthesized, mapping from the language code to If the configuration for the specified language code is not found, the configuration for the root language code will be used. For example, if the map contains "en-us" and "en", and the specified language code is "en-gb", then "en" configuration will be used. Note: Language code is case-insensitive. |
barge_in_config |
Optional. Configures the agent behavior for the user barge-in activities. |
inactivity_timeout |
Optional. The duration of user inactivity (no speech or interaction) before the agent prompts the user for reengagement. If not set, the agent will not prompt the user for reengagement. |
ambient_sound_config |
Optional. Configuration for the ambient sound to be played with the synthesized agent response, to enhance the naturalness of the conversation. |
AudioRecordingConfig
Configuration for how the audio interactions should be recorded.
| Fields | |
|---|---|
gcs_bucket |
Optional. The Cloud Storage bucket to store the session audio recordings. The URI must start with "gs://". Please choose a bucket location that meets your data residency requirements. Note: If the Cloud Storage bucket is in a different project from the app, you should grant |
gcs_path_prefix |
Optional. The Cloud Storage path prefix for audio recordings. This prefix can include the following placeholders, which will be dynamically substituted at serving time: - $project: project ID - $location: app location - $app: app ID - $date: session date in YYYY-MM-DD format - $session: session ID If the path prefix is not specified, the default prefix |
BargeInConfig
Configuration for how the user barge-in activities should be handled.
| Fields | |
|---|---|
disable_barge_in |
Optional. Disables user barge-in while the agent is speaking. If true, user input during agent response playback will be ignored. Deprecated: |
barge_in_awareness |
Optional. If enabled, the agent will adapt its next response based on the assumption that the user hasn't heard the full preceding agent message. This should not be used in scenarios where agent responses are displayed visually. |
BatchDeleteConversationsRequest
Request message for AgentService.BatchDeleteConversations.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to delete conversations from. Format: |
conversations[] |
Required. The resource names of the conversations to delete. |
BatchDeleteConversationsResponse
Response message for AgentService.BatchDeleteConversations.
| Fields | |
|---|---|
deleted_conversations[] |
The list of conversations that were successfully deleted. |
failed_conversations[] |
The list of conversations that failed to be deleted. |
error_messages[] |
Optional. A list of error messages associated with conversations that failed to be deleted. |
BearerTokenConfig
Configurations for authentication with a bearer token.
| Fields | |
|---|---|
token |
Required. The bearer token. Must be in the format |
BidiSessionClientMessage
The top-level message sent by the client for the SessionService.BidiRunSession method.
| Fields | |
|---|---|
Union field message_type. The type of the message. message_type can be only one of the following: |
|
config |
Optional. The initial config message for the session. |
realtime_input |
Optional. Realtime input for the session. |
BidiSessionServerMessage
The top-level message returned from SessionService.BidiRunSession method.
| Fields | |
|---|---|
Union field message_type. The type of the message. message_type can be only one of the following: |
|
session_output |
Optional. Processing result from the CES agent. |
recognition_result |
Optional. Realtime speech recognition result for the audio input. |
interruption_signal |
Optional. Indicates the agent's audio response has been interrupted. |
end_session |
Optional. Indicates that the session has ended. |
go_away |
Optional. Indicates that the server will disconnect soon and the client should half-close and restart the connection. |
BigQueryExportSettings
Settings to describe the BigQuery export behaviors for the app.
| Fields | |
|---|---|
enabled |
Optional. Indicates whether the BigQuery export is enabled. |
project |
Optional. The project ID of the BigQuery dataset to export the data to. Note: If the BigQuery dataset is in a different project from the app, you should grant |
dataset |
Optional. The BigQuery dataset ID to export the data to. |
Blob
Represents a blob input or output in the conversation.
| Fields | |
|---|---|
mime_type |
Required. The IANA standard MIME type of the source data. |
data |
Required. Raw bytes of the blob. |
Callback
A callback defines the custom logic to be executed at various stages of agent interaction.
| Fields | |
|---|---|
description |
Optional. Human-readable description of the callback. |
disabled |
Optional. Whether the callback is disabled. Disabled callbacks are ignored by the agent. |
proactive_execution_enabled |
Optional. If enabled, the callback will also be executed on intermediate model outputs. This setting only affects after model callback. ENABLE WITH CAUTION. Typically after model callback only needs to be executed after receiving all model responses. Enabling proactive execution may have negative implication on the execution cost and latency, and should only be enabled in rare situations. |
Union field callback. The callback to execute. callback can be only one of the following: |
|
python_code |
Required. The python code to execute for the callback. |
Changelog
Changelogs represent a change made to the app or to an resource within the app.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the changelog. Format: |
author |
Output only. Email address of the change author. |
display_name |
Output only. Display name of the change. It typically should be the display name of the resource that was changed. |
description |
Output only. Description of the change. which typically captures the changed fields in the resource. |
resource |
Output only. The resource that was changed. |
resource_type |
Output only. The type of the resource that was changed. |
action |
Output only. The action that was performed on the resource. |
original_resource |
Output only. The original resource before the change. |
new_resource |
Output only. The new resource after the change. |
dependent_resources[] |
Output only. The dependent resources that were changed. |
create_time |
Output only. The time when the change was made. |
sequence_number |
Output only. The monotonically increasing sequence number of the changelog. |
ChannelProfile
A ChannelProfile configures the agent's behavior for a specific communication channel, such as web UI or telephony.
| Fields | |
|---|---|
profile_id |
Optional. The unique identifier of the channel profile. |
channel_type |
Optional. The type of the channel profile. |
persona_property |
Optional. The persona property of the channel profile. |
disable_dtmf |
Optional. Whether to disable DTMF (dual-tone multi-frequency). |
disable_barge_in_control |
Optional. Whether to disable user barge-in control in the conversation. - true: User interruptions are disabled while the agent is speaking. - false: The agent retains automatic control over when the user can interrupt. |
web_widget_config |
Optional. The configuration for the web widget. |
noise_suppression_level |
Optional. The noise suppression level of the channel profile. Available values are "low", "moderate", "high", "very_high". |
ChannelType
The type of the channel profile.
| Enums | |
|---|---|
UNKNOWN |
Unknown channel type. |
WEB_UI |
Web UI channel. |
API |
API channel. |
TWILIO |
Twilio channel. |
GOOGLE_TELEPHONY_PLATFORM |
Google Telephony Platform channel. |
CONTACT_CENTER_AS_A_SERVICE |
Contact Center as a Service (CCaaS) channel. |
FIVE9 |
Five9 channel. |
CONTACT_CENTER_INTEGRATION |
Third party contact center integration channel. |
PersonaProperty
Represents the persona property of a channel.
| Fields | |
|---|---|
persona |
Optional. The persona of the channel. |
Persona
The persona of the channel.
| Enums | |
|---|---|
UNKNOWN |
UNKNOWN persona. |
CONCISE |
The agent keeps the responses concise and to the point |
CHATTY |
The agent provides additional context, explanations, and details |
WebWidgetConfig
Message for configuration for the web widget.
| Fields | |
|---|---|
modality |
Optional. The modality of the web widget. |
theme |
Optional. The theme of the web widget. |
web_widget_title |
Optional. The title of the web widget. |
security_settings |
Optional. The security settings of the web widget. |
Modality
Modality of the web widget.
| Enums | |
|---|---|
MODALITY_UNSPECIFIED |
Unknown modality. |
CHAT_AND_VOICE |
Widget supports both chat and voice input. |
VOICE_ONLY |
Widget supports only voice input. |
CHAT_ONLY |
Widget supports only chat input. |
CHAT_VOICE_AND_VIDEO |
Widget supports chat, voice, and video input. |
SecuritySettings
Security settings for the web widget.
| Fields | |
|---|---|
enable_public_access |
Optional. Indicates whether public access to the web widget is enabled. If |
enable_origin_check |
Optional. Indicates whether origin check for the web widget is enabled. If |
allowed_origins[] |
Optional. The origins that are allowed to host the web widget. An origin is defined by RFC 6454. If empty, all origins are allowed. A maximum of 100 origins is allowed. Example: "https://example.com" |
enable_recaptcha |
Optional. Indicates whether reCAPTCHA verification for the web widget is enabled. |
Theme
Theme of the web widget.
| Enums | |
|---|---|
THEME_UNSPECIFIED |
Unknown theme. |
LIGHT |
Light theme. |
DARK |
Dark theme. |
Chunk
A chunk of content within a message.
| Fields | |
|---|---|
Union field data. Chunk data. data can be only one of the following: |
|
text |
Optional. Text data. |
transcript |
Optional. Transcript associated with the audio. |
blob |
Optional. Blob data. |
payload |
Optional. Custom payload data. |
image |
Optional. Image data. |
tool_call |
Optional. Tool execution request. |
tool_response |
Optional. Tool execution response. |
agent_transfer |
Optional. Agent transfer event. |
updated_variables |
A struct represents variables that were updated in the conversation, keyed by variable names. |
default_variables |
A struct represents default variables at the start of the conversation, keyed by variable names. |
Citations
Citations associated with the agent response.
| Fields | |
|---|---|
cited_chunks[] |
List of cited pieces of information. |
CitedChunk
Piece of cited information.
| Fields | |
|---|---|
uri |
URI used for citation. |
title |
Title of the cited document. |
text |
Text used for citation. |
ClientCertificateSettings
Settings for custom client certificates.
| Fields | |
|---|---|
tls_certificate |
Required. The TLS certificate encoded in PEM format. This string must include the begin header and end footer lines. |
private_key |
Required. The name of the SecretManager secret version resource storing the private key encoded in PEM format. Format: |
passphrase |
Optional. The name of the SecretManager secret version resource storing the passphrase to decrypt the private key. Should be left unset if the private key is not encrypted. Format: |
ClientFunction
Represents a client-side function that the agent can invoke. When the tool is chosen by the agent, control is handed off to the client. The client is responsible for executing the function and returning the result as a ToolResponse to continue the interaction with the agent.
| Fields | |
|---|---|
name |
Required. The function name. |
description |
Optional. The function description. |
parameters |
Optional. The schema of the function parameters. |
response |
Optional. The schema of the function response. |
CloudLoggingSettings
Settings to describe the Cloud Logging behaviors for the app.
| Fields | |
|---|---|
enable_cloud_logging |
Optional. Whether to enable Cloud Logging for the sessions. |
CodeBlock
A code block to be executed instead of a real tool call.
| Fields | |
|---|---|
python_code |
Required. Python code which will be invoked in tool fake mode. Expected Python function signature - To catch all tool calls: def fake_tool_call(tool: Tool, input: dict[str, Any], callback_context: CallbackContext) -> Optional[dict[str, Any]]: To catch a specific tool call: def fake_{tool_id}(tool: Tool, input: dict[str, Any], callback_context: CallbackContext) -> Optional[dict[str, Any]]: If the function returns None, the real tool will be invoked instead. |
ConnectorTool
A ConnectorTool allows connections to different integrations. See: https://cloud.google.com/integration-connectors/docs/overview.
| Fields | |
|---|---|
connection |
Required. The full resource name of the referenced Integration Connectors Connection. Format: |
action |
Required. Action for the tool to use. |
auth_config |
Optional. Configures how authentication is handled in Integration Connectors. By default, an admin authentication is passed in the Integration Connectors API requests. You can override it with a different end-user authentication config. Note: The Connection must have authentication override enabled in order to specify an EUC configuration here - otherwise, the ConnectorTool creation will fail. See https://cloud.google.com/application-integration/docs/configure-connectors-task#configure-authentication-override for details. |
name |
Optional. The name of the tool that can be used by the Agent to decide whether to call this ConnectorTool. |
description |
Optional. The description of the tool that can be used by the Agent to decide whether to call this ConnectorTool. |
ConnectorToolset
A toolset that generates tools from an Integration Connectors Connection.
| Fields | |
|---|---|
connection |
Required. The full resource name of the referenced Integration Connectors Connection. Format: |
auth_config |
Optional. Configures how authentication is handled in Integration Connectors. By default, an admin authentication is passed in the Integration Connectors API requests. You can override it with a different end-user authentication config. Note: The Connection must have authentication override enabled in order to specify an EUC configuration here - otherwise, the Toolset creation will fail. See: https://cloud.google.com/application-integration/docs/configure-connectors-task#configure-authentication-override |
connector_actions[] |
Required. The list of connector actions/entity operations to generate tools for. |
Conversation
A conversation represents an interaction between an end user and the CES app.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the conversation. Format: |
start_time |
Output only. Timestamp when the conversation was created. |
end_time |
Output only. Timestamp when the conversation was completed. |
turns[] |
Required. The turns in the conversation. |
turn_count |
Output only. The number of turns in the conversation. |
channel_type |
DEPRECATED. Please use |
source |
Output only. Indicate the source of the conversation. |
input_types[] |
Output only. The input types of the conversation. |
entry_agent |
Output only. The agent that initially handles the conversation. If not specified, the conversation is handled by the root agent. Format: |
deployment |
Output only. The deployment of the app used for processing the conversation. Format: |
app_version |
Output only. The version of the app used for processing the conversation. Format: |
language_code |
Output only. The language code of the conversation. |
messages[] |
Deprecated. Use turns instead. |
ChannelType
The channel type of the conversation.
| Enums | |
|---|---|
CHANNEL_TYPE_UNSPECIFIED |
Unspecified channel type. |
TEXT |
The conversation only contains text messages between the end user and the agent. |
AUDIO |
The conversation contains audio messages between the end user and the agent. |
MULTIMODAL |
The conversation multi-modal messages (e.g. image) between the end user and the agent. |
InputType
Type of the input message.
| Enums | |
|---|---|
INPUT_TYPE_UNSPECIFIED |
Unspecified input type. |
INPUT_TYPE_TEXT |
The input message is text. |
INPUT_TYPE_AUDIO |
The input message is audio. |
INPUT_TYPE_IMAGE |
The input message is image. |
INPUT_TYPE_BLOB |
The input message is blob file. |
INPUT_TYPE_TOOL_RESPONSE |
The input message is client function tool response. |
INPUT_TYPE_VARIABLES |
The input message are variables. |
Source
The source of the conversation.
| Enums | |
|---|---|
SOURCE_UNSPECIFIED |
Unspecified source. |
LIVE |
The conversation is from the live end user. |
SIMULATOR |
The conversation is from the simulator. |
EVAL |
The conversation is from the evaluation. |
AGENT_TOOL |
The conversation is from an agent tool. Agent tool runs the agent in a separate session, which is persisted for testing and debugging purposes. |
Turn
All information about a single turn in the conversation.
| Fields | |
|---|---|
messages[] |
Optional. List of messages in the conversation turn, including user input, agent responses and intermediate events during the processing. |
root_span |
Optional. The root span of the action processing. |
ConversationLoggingSettings
Settings to describe the conversation logging behaviors for the app.
| Fields | |
|---|---|
disable_conversation_logging |
Optional. Whether to disable conversation logging for the sessions. |
retention_window |
Optional. Controls the retention window for the conversation. If not set, the conversation will be retained for 365 days. |
CreateAgentRequest
Request message for AgentService.CreateAgent.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to create an agent in. |
agent_id |
Optional. The ID to use for the agent, which will become the final component of the agent's resource name. If not provided, a unique ID will be automatically assigned for the agent. |
agent |
Required. The agent to create. |
CreateAppRequest
Request message for AgentService.CreateApp.
| Fields | |
|---|---|
parent |
Required. The resource name of the location to create an app in. |
app_id |
Optional. The ID to use for the app, which will become the final component of the app's resource name. If not provided, a unique ID will be automatically assigned for the app. |
app |
Required. The app to create. |
CreateAppVersionRequest
Request message for AgentService.CreateAppVersion
| Fields | |
|---|---|
parent |
Required. The resource name of the app to create an app version in. |
app_version_id |
Optional. The ID to use for the app version, which will become the final component of the app version's resource name. If not provided, a unique ID will be automatically assigned for the app version. |
app_version |
Required. The app version to create. |
CreateDeploymentRequest
Request message for AgentService.CreateDeployment.
| Fields | |
|---|---|
parent |
Required. The parent app. Format: |
deployment_id |
Optional. The ID to use for the deployment, which will become the final component of the deployment's resource name. If not provided, a unique ID will be automatically assigned for the deployment. |
deployment |
Required. The deployment to create. |
CreateEvaluationDatasetRequest
Request message for EvaluationService.CreateEvaluationDataset.
| Fields | |
|---|---|
parent |
Required. The app to create the evaluation for. Format: |
evaluation_dataset_id |
Optional. The ID to use for the evaluation dataset, which will become the final component of the evaluation dataset's resource name. If not provided, a unique ID will be automatically assigned for the evaluation. |
evaluation_dataset |
Required. The evaluation dataset to create. |
CreateEvaluationExpectationRequest
Request message for EvaluationService.CreateEvaluationExpectation.
| Fields | |
|---|---|
parent |
Required. The app to create the evaluation expectation for. Format: |
evaluation_expectation_id |
Optional. The ID to use for the evaluation expectation, which will become the final component of the evaluation expectation's resource name. If not provided, a unique ID will be automatically assigned for the evaluation expectation. |
evaluation_expectation |
Required. The evaluation expectation to create. |
CreateEvaluationRequest
Request message for EvaluationService.CreateEvaluation.
| Fields | |
|---|---|
parent |
Required. The app to create the evaluation for. Format: |
evaluation_id |
Optional. The ID to use for the evaluation, which will become the final component of the evaluation's resource name. If not provided, a unique ID will be automatically assigned for the evaluation. |
evaluation |
Required. The evaluation to create. |
CreateExampleRequest
Request message for AgentService.CreateExample.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to create an example in. |
example_id |
Optional. The ID to use for the example, which will become the final component of the example's resource name. If not provided, a unique ID will be automatically assigned for the example. |
example |
Required. The example to create. |
CreateGuardrailRequest
Request message for AgentService.CreateGuardrail.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to create a guardrail in. |
guardrail_id |
Optional. The ID to use for the guardrail, which will become the final component of the guardrail's resource name. If not provided, a unique ID will be automatically assigned for the guardrail. |
guardrail |
Required. The guardrail to create. |
CreateScheduledEvaluationRunRequest
Request message for EvaluationService.CreateScheduledEvaluationRun.
| Fields | |
|---|---|
parent |
Required. The app to create the scheduled evaluation run for. Format: |
scheduled_evaluation_run_id |
Optional. The ID to use for the scheduled evaluation run, which will become the final component of the scheduled evaluation run's resource name. If not provided, a unique ID will be automatically assigned. |
scheduled_evaluation_run |
Required. The scheduled evaluation run to create. |
CreateToolRequest
Request message for AgentService.CreateTool.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to create a tool in. |
tool_id |
Optional. The ID to use for the tool, which will become the final component of the tool's resource name. If not provided, a unique ID will be automatically assigned for the tool. |
tool |
Required. The tool to create. |
CreateToolsetRequest
Request message for AgentService.CreateToolset.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to create a toolset in. |
toolset_id |
Optional. The ID to use for the toolset, which will become the final component of the toolset's resource name. If not provided, a unique ID will be automatically assigned for the toolset. |
toolset |
Required. The toolset to create. |
DataStore
A DataStore resource in Vertex AI Search.
| Fields | |
|---|---|
name |
Required. Full resource name of the DataStore. Format: |
type |
Output only. The type of the data store. This field is readonly and populated by the server. |
document_processing_mode |
Output only. The document processing mode for the data store connection. Only set for PUBLIC_WEB and UNSTRUCTURED data stores. |
display_name |
Output only. The display name of the data store. |
create_time |
Output only. Timestamp when the data store was created. |
connector_config |
Output only. The connector config for the data store connection. |
ConnectorConfig
The connector config for the data store connection.
| Fields | |
|---|---|
collection |
Resource name of the collection the data store belongs to. |
collection_display_name |
Display name of the collection the data store belongs to. |
data_source |
The name of the data source. Example: |
DataStoreType
The type of the data store.
| Enums | |
|---|---|
DATA_STORE_TYPE_UNSPECIFIED |
Not specified. This value indicates that the data store type is not specified, so it will not be used during search. |
PUBLIC_WEB |
A data store that contains public web content. |
UNSTRUCTURED |
A data store that contains unstructured private data. |
FAQ |
A data store that contains structured data used as FAQ. |
CONNECTOR |
A data store that is a connector to a first-party or a third-party service. |
DocumentProcessingMode
The document processing mode of the data store.
| Enums | |
|---|---|
DOCUMENT_PROCESSING_MODE_UNSPECIFIED |
Not specified. |
DOCUMENTS |
Documents are processed as documents. |
CHUNKS |
Documents are converted to chunks. |
DataStoreSettings
Data store related settings for the app.
| Fields | |
|---|---|
engines[] |
Output only. The engines for the app. |
Engine
An engine to which the data stores are connected. See Vertex AI Search: https://cloud.google.com/generative-ai-app-builder/docs/enterprise-search-introduction.
| Fields | |
|---|---|
name |
Output only. The resource name of the engine. Format: |
type |
Output only. The type of the engine. |
Type
The type of the engine. See the documentation available at https://cloud.google.com/generative-ai-app-builder/docs/reference/rest/v1/SolutionType and https://cloud.google.com/generative-ai-app-builder/docs/create-datastore-ingest.
| Enums | |
|---|---|
TYPE_UNSPECIFIED |
Unspecified engine type. |
ENGINE_TYPE_SEARCH |
The SOLUTION_TYPE_SEARCH engine for the app. All connector data stores added to the app will be added to this engine. |
ENGINE_TYPE_CHAT |
Chat engine type. The SOLUTION_TYPE_CHAT engine for the app. All connector data stores added to the app will be added to this engine. |
DataStoreTool
Tool to retrieve from Vertex AI Search datastore or engine for grounding. Accepts either a datastore or an engine, but not both. See Vertex AI Search: https://cloud.google.com/generative-ai-app-builder/docs/enterprise-search-introduction.
| Fields | |
|---|---|
name |
Required. The data store tool name. |
description |
Optional. The tool description. |
boost_specs[] |
Optional. Boost specification to boost certain documents. |
modality_configs[] |
Optional. The modality configs for the data store. |
filter_parameter_behavior |
Optional. The filter parameter behavior. |
Union field search_source. Defines the search source, either a single DataStore or an Engine. search_source can be only one of the following: |
|
data_store_source |
Optional. Search within a single specific DataStore. |
engine_source |
Optional. Search within an Engine (potentially across multiple DataStores). |
BoostSpec
Boost specification to boost certain documents.
| Fields | |
|---|---|
condition_boost_specs[] |
Required. A list of boosting specifications. |
ConditionBoostSpec
Boost specification for a condition.
| Fields | |
|---|---|
condition |
Required. An expression which specifies a boost condition. The syntax is the same as filter expression syntax. Currently, the only supported condition is a list of BCP-47 lang codes. Example: To boost suggestions in languages en or fr: (lang_code: ANY("en", "fr")) |
boost |
Optional. Strength of the boost, which should be in [-1, 1]. Negative boost means demotion. Default is 0.0. Setting to 1.0 gives the suggestions a big promotion. However, it does not necessarily mean that the top result will be a boosted suggestion. Setting to -1.0 gives the suggestions a big demotion. However, other suggestions that are relevant might still be shown. Setting to 0.0 means no boost applied. The boosting condition is ignored. |
boost_control_spec |
Optional. Complex specification for custom ranking based on customer defined attribute value. |
BoostControlSpec
Specification for custom ranking based on customer specified attribute value. It provides more controls for customized ranking than the simple (condition, boost) combination above.
| Fields | |
|---|---|
field_name |
Optional. The name of the field whose value will be used to determine the boost amount. |
attribute_type |
Optional. The attribute type to be used to determine the boost amount. The attribute value can be derived from the field value of the specified field_name. In the case of numerical it is straightforward i.e. attribute_value = numerical_field_value. In the case of freshness however, attribute_value = (time.now() - datetime_field_value). |
interpolation_type |
Optional. The interpolation type to be applied to connect the control points listed below. |
control_points[] |
Optional. The control points used to define the curve. The monotonic function (defined through the interpolation_type above) passes through the control points listed here. |
AttributeType
The attribute(or function) for which the custom ranking is to be applied.
| Enums | |
|---|---|
ATTRIBUTE_TYPE_UNSPECIFIED |
Unspecified AttributeType. |
NUMERICAL |
The value of the numerical field will be used to dynamically update the boost amount. In this case, the attribute_value (the x value) of the control point will be the actual value of the numerical field for which the boost_amount is specified. |
FRESHNESS |
For the freshness use case the attribute value will be the duration between the current time and the date in the datetime field specified. The value must be formatted as an XSD dayTimeDuration value (a restricted subset of an ISO 8601 duration value). The pattern for this is: [nD][T[nH][nM][nS]]. E.g. 5D, 3DT12H30M, T24H. |
ControlPoint
The control points used to define the curve. The curve defined through these control points can only be monotonically increasing or decreasing(constant values are acceptable).
| Fields | |
|---|---|
attribute_value |
Optional. Can be one of: 1. The numerical field value. 2. The duration spec for freshness: The value must be formatted as an XSD |
boost_amount |
Optional. The value between -1 to 1 by which to boost the score if the attribute_value evaluates to the value specified above. |
InterpolationType
The interpolation type to be applied. Default will be linear (Piecewise Linear).
| Enums | |
|---|---|
INTERPOLATION_TYPE_UNSPECIFIED |
Interpolation type is unspecified. In this case, it defaults to Linear. |
LINEAR |
Piecewise linear interpolation will be applied. |
BoostSpecs
Boost specifications to boost certain documents. For more information, please refer to https://cloud.google.com/generative-ai-app-builder/docs/boosting.
| Fields | |
|---|---|
data_stores[] |
Required. The Data Store where the boosting configuration is applied. Full resource name of DataStore, such as projects/{project}/locations/{location}/collections/{collection}/dataStores/{dataStore}. |
spec[] |
Required. A list of boosting specifications. |
DataStoreSource
Configuration for searching within a specific DataStore.
| Fields | |
|---|---|
filter |
Optional. Filter specification for the DataStore. See: https://cloud.google.com/generative-ai-app-builder/docs/filter-search-metadata |
data_store |
Optional. The data store. |
EngineSource
Configuration for searching within an Engine, potentially targeting specific DataStores.
| Fields | |
|---|---|
engine |
Required. Full resource name of the Engine. Format: |
data_store_sources[] |
Optional. Use to target specific DataStores within the Engine. If empty, the search applies to all DataStores associated with the Engine. |
filter |
Optional. A filter applied to the search across the Engine. Not relevant and not used if 'data_store_sources' is provided. See: https://cloud.google.com/generative-ai-app-builder/docs/filter-search-metadata |
FilterParameterBehavior
Filter parameter behavior.
| Enums | |
|---|---|
FILTER_PARAMETER_BEHAVIOR_UNSPECIFIED |
Default filter behavior. Include filter parameter for connector datastores. For the rest of the datastore types, the filter input parameter is omitted. |
ALWAYS_INCLUDE |
Always include filter parameter for all datastore types. |
NEVER_INCLUDE |
The filter parameter is never included in the list of tool parameters, regardless of the datastore type. |
GroundingConfig
Grounding configuration.
| Fields | |
|---|---|
grounding_level |
Optional. The groundedness threshold of the answer based on the retrieved sources. The value has a configurable range of [1, 5]. The level is used to threshold the groundedness of the answer, meaning that all responses with a groundedness score below the threshold will fall back to returning relevant snippets only. For example, a level of 3 means that the groundedness score must be 3 or higher for the response to be returned. |
disabled |
Optional. Whether grounding is disabled. |
ModalityConfig
If specified, will apply the given configuration for the specified modality.
| Fields | |
|---|---|
modality_type |
Required. The modality type. |
rewriter_config |
Optional. The rewriter config. |
summarization_config |
Optional. The summarization config. |
grounding_config |
Optional. The grounding configuration. |
ModalityType
The modality type.
| Enums | |
|---|---|
MODALITY_TYPE_UNSPECIFIED |
Unspecified modality type. |
TEXT |
Text modality. |
AUDIO |
Audio modality. |
RewriterConfig
Rewriter configuration.
| Fields | |
|---|---|
model_settings |
Required. Configurations for the LLM model. |
prompt |
Optional. The prompt definition. If not set, default prompt will be used. |
disabled |
Optional. Whether the rewriter is disabled. |
SummarizationConfig
Summarization configuration.
| Fields | |
|---|---|
model_settings |
Optional. Configurations for the LLM model. |
prompt |
Optional. The prompt definition. If not set, default prompt will be used. |
disabled |
Optional. Whether summarization is disabled. |
DeleteAgentRequest
Request message for AgentService.DeleteAgent.
| Fields | |
|---|---|
name |
Required. The resource name of the agent to delete. |
force |
Optional. Indicates whether to forcefully delete the agent, even if it is still referenced by other app/agents/examples.
|
etag |
Optional. The current etag of the agent. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the agent, deletion will be blocked and an ABORTED error will be returned. |
DeleteAppRequest
Request message for AgentService.DeleteApp.
| Fields | |
|---|---|
name |
Required. The resource name of the app to delete. |
etag |
Optional. The current etag of the app. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the app, deletion will be blocked and an ABORTED error will be returned. |
DeleteAppVersionRequest
Request message for AgentService.DeleteAppVersion.
| Fields | |
|---|---|
name |
Required. The resource name of the app version to delete. |
etag |
Optional. The current etag of the app version. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the app version, deletion will be blocked and an ABORTED error will be returned. |
DeleteConversationRequest
Request message for AgentService.DeleteConversation.
| Fields | |
|---|---|
name |
Required. The resource name of the conversation to delete. |
source |
Optional. Indicate the source of the conversation. If not set, Source.Live will be applied by default. |
DeleteDeploymentRequest
Request message for AgentService.DeleteDeployment.
| Fields | |
|---|---|
name |
Required. The name of the deployment to delete. Format: |
etag |
Optional. The etag of the deployment. If an etag is provided and does not match the current etag of the deployment, deletion will be blocked and an ABORTED error will be returned. |
DeleteEvaluationDatasetRequest
Request message for EvaluationService.DeleteEvaluationDataset.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation dataset to delete. |
etag |
Optional. The current etag of the evaluation dataset. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the evaluation dataset, deletion will be blocked and an ABORTED error will be returned. |
DeleteEvaluationExpectationRequest
Request message for EvaluationService.DeleteEvaluationExpectation.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation expectation to delete. |
etag |
Optional. The current etag of the evaluation expectation. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the evaluation expectation, deletion will be blocked and an ABORTED error will be returned. |
DeleteEvaluationRequest
Request message for EvaluationService.DeleteEvaluation.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation to delete. |
force |
Optional. Indicates whether to forcefully delete the evaluation, even if it is still referenced by evaluation datasets.
|
etag |
Optional. The current etag of the evaluation. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the evaluation, deletion will be blocked and an ABORTED error will be returned. |
DeleteEvaluationResultRequest
Request message for EvaluationService.DeleteEvaluationResult.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation result to delete. |
DeleteEvaluationRunOperationMetadata
This type has no fields.
Operation metadata for EvaluationService.DeleteEvaluationRun.
DeleteEvaluationRunRequest
Request message for EvaluationService.DeleteEvaluationRun.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation run to delete. |
DeleteExampleRequest
Request message for AgentService.DeleteExample.
| Fields | |
|---|---|
name |
Required. The resource name of the example to delete. |
etag |
Optional. The current etag of the example. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the example, deletion will be blocked and an ABORTED error will be returned. |
DeleteGuardrailRequest
Request message for AgentService.DeleteGuardrail.
| Fields | |
|---|---|
name |
Required. The resource name of the guardrail to delete. |
force |
Optional. Indicates whether to forcefully delete the guardrail, even if it is still referenced by app/agents.
|
etag |
Optional. The current etag of the guardrail. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the guardrail, deletion will be blocked and an ABORTED error will be returned. |
DeleteScheduledEvaluationRunRequest
Request message for EvaluationService.DeleteScheduledEvaluationRun.
| Fields | |
|---|---|
name |
Required. The resource name of the scheduled evaluation run to delete. |
etag |
Optional. The etag of the ScheduledEvaluationRun. If provided, it must match the server's etag. |
DeleteToolRequest
Request message for AgentService.DeleteTool.
| Fields | |
|---|---|
name |
Required. The resource name of the tool to delete. |
force |
Optional. Indicates whether to forcefully delete the tool, even if it is still referenced by agents/examples.
|
etag |
Optional. The current etag of the tool. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the tool, deletion will be blocked and an ABORTED error will be returned. |
DeleteToolsetRequest
Request message for AgentService.DeleteToolset.
| Fields | |
|---|---|
name |
Required. The resource name of the toolset to delete. |
force |
Optional. Indicates whether to forcefully delete the toolset, even if it is still referenced by app/agents.
|
etag |
Optional. The current etag of the toolset. If an etag is not provided, the deletion will overwrite any concurrent changes. If an etag is provided and does not match the current etag of the toolset, deletion will be blocked and an ABORTED error will be returned. |
Deployment
A deployment represents an immutable, queryable version of the app. It is used to deploy an app version with a specific channel profile.
| Fields | |
|---|---|
name |
Identifier. The resource name of the deployment. Format: |
display_name |
Required. Display name of the deployment. |
app_version |
Optional. The resource name of the app version to deploy. Format: |
channel_profile |
Required. The channel profile used in the deployment. |
create_time |
Output only. Timestamp when this deployment was created. |
update_time |
Output only. Timestamp when this deployment was last updated. |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
EndSession
Indicates the session has terminated, due to either successful completion (e.g. user says "Good bye!" ) or an agent escalation.
The agent will not process any further inputs after session is terminated and the client should half-close and disconnect after receiving all remaining responses from the agent.
| Fields | |
|---|---|
metadata |
Optional. Provides additional information about the end session signal, such as the reason for ending the session. |
EndUserAuthConfig
End-user authentication configuration used for Connection calls. The field values must be the names of context variables in the format $context.variables.<name_of_variable>.
| Fields | |
|---|---|
Union field auth_config. The auth configuration. auth_config can be only one of the following: |
|
oauth2_auth_code_config |
Oauth 2.0 Authorization Code authentication. |
oauth2_jwt_bearer_config |
JWT Profile Oauth 2.0 Authorization Grant authentication. |
Oauth2AuthCodeConfig
Oauth 2.0 Authorization Code authentication configuration.
| Fields | |
|---|---|
oauth_token |
Required. Oauth token parameter name to pass through. Must be in the format |
Oauth2JwtBearerConfig
JWT Profile Oauth 2.0 Authorization Grant authentication configuration.
| Fields | |
|---|---|
issuer |
Required. Issuer parameter name to pass through. Must be in the format |
subject |
Required. Subject parameter name to pass through. Must be in the format |
client_key |
Required. Client parameter name to pass through. Must be in the format |
EndpointControlPolicy
Defines project/location level endpoint control policy.
| Fields | |
|---|---|
enforcement_scope |
Optional. The scope in which this policy's allowed_origins list is enforced. |
allowed_origins[] |
Optional. The allowed HTTP(s) origins that tools in the App are able to directly call. The enforcement depends on the value of enforcement_scope and the VPC-SC status of the project. If a port number is not provided, all ports will be allowed. Otherwise, the port number must match exactly. For example, "https://example.com" will match "https://example.com:443" and any other port. "https://example.com:443" will only match "https://example.com:443". |
EnforcementScope
Defines the scope in which this policy's allowed_origins list is enforced.
| Enums | |
|---|---|
ENFORCEMENT_SCOPE_UNSPECIFIED |
Unspecified. This policy will be treated as VPCSC_ONLY. |
VPCSC_ONLY |
This policy applies only when VPC-SC is active. |
ALWAYS |
This policy ALWAYS applies, regardless of VPC-SC status. |
ErrorHandlingSettings
Settings to describe how errors should be handled in the app.
| Fields | |
|---|---|
error_handling_strategy |
Optional. The strategy to use for error handling. |
fallback_response_config |
Optional. Configuration for handling fallback responses. |
end_session_config |
Optional. Configuration for ending the session in case of system errors (e.g. LLM errors). |
EndSessionConfig
Configuration for ending the session in case of system errors (e.g. LLM errors).
| Fields | |
|---|---|
escalate_session |
Optional. Whether to escalate the session in |
ErrorHandlingStrategy
Defines the strategy for handling errors.
| Enums | |
|---|---|
ERROR_HANDLING_STRATEGY_UNSPECIFIED |
Unspecified error handling strategy. |
NONE |
No specific handling is enabled. |
FALLBACK_RESPONSE |
A fallback message will be returned to the user in case of system errors (e.g. LLM errors). |
END_SESSION |
An EndSession signal will be emitted in case of system errors (e.g. LLM errors). |
FallbackResponseConfig
Configuration for handling fallback responses.
| Fields | |
|---|---|
custom_fallback_messages |
Optional. The fallback messages in case of system errors (e.g. LLM errors), mapped by supported language code. |
max_fallback_attempts |
Optional. The maximum number of fallback attempts to make before the agent emitting |
Evaluation
An evaluation represents all of the information needed to simulate and evaluate an agent.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of this evaluation. Format: |
display_name |
Required. User-defined display name of the evaluation. Unique within an App. |
description |
Optional. User-defined description of the evaluation. |
tags[] |
Optional. User defined tags to categorize the evaluation. |
evaluation_datasets[] |
Output only. List of evaluation datasets the evaluation belongs to. Format: |
create_time |
Output only. Timestamp when the evaluation was created. |
created_by |
Output only. The user who created the evaluation. |
update_time |
Output only. Timestamp when the evaluation was last updated. |
last_updated_by |
Output only. The user who last updated the evaluation. |
evaluation_runs[] |
Output only. The EvaluationRuns that this Evaluation is associated with. |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
aggregated_metrics |
Output only. The aggregated metrics for this evaluation across all runs. |
last_completed_result |
Output only. The latest evaluation result for this evaluation. |
invalid |
Output only. Whether the evaluation is invalid. This can happen if an evaluation is referencing a tool, toolset, or agent that has since been deleted. |
last_ten_results[] |
Output only. The last 10 evaluation results for this evaluation. This is only populated if include_last_ten_results is set to true in the ListEvaluationsRequest or GetEvaluationRequest. |
Union field inputs. The inputs for the evaluation inputs can be only one of the following: |
|
golden |
Optional. The golden steps to be evaluated. |
scenario |
Optional. The config for a scenario. |
Golden
The steps required to replay a golden conversation.
| Fields | |
|---|---|
turns[] |
Required. The golden turns required to replay a golden conversation. |
evaluation_expectations[] |
Optional. The evaluation expectations to evaluate the replayed conversation against. Format: |
GoldenExpectation
Represents a single, checkable requirement.
| Fields | |
|---|---|
note |
Optional. A note for this requirement, useful in reporting when specific checks fail. E.g., "Check_Payment_Tool_Called". |
Union field condition. The actual check to perform. condition can be only one of the following: |
|
tool_call |
Optional. Check that a specific tool was called with the parameters. |
tool_response |
Optional. Check that a specific tool had the expected response. |
agent_response |
Optional. Check that the agent responded with the correct response. The role "agent" is implied. |
agent_transfer |
Optional. Check that the agent transferred the conversation to a different agent. |
updated_variables |
Optional. Check that the agent updated the session variables to the expected values. Used to also capture agent variable updates for golden evals. |
mock_tool_response |
Optional. The tool response to mock, with the parameters of interest specified. Any parameters not specified will be hallucinated by the LLM. |
GoldenTurn
A golden turn defines a single turn in a golden conversation.
| Fields | |
|---|---|
steps[] |
Required. The steps required to replay a golden conversation. |
root_span |
Optional. The root span of the golden turn for processing and maintaining audio information. |
Scenario
The config for a scenario
| Fields | |
|---|---|
task |
Required. The task to be targeted by the scenario. |
user_facts[] |
Optional. The user facts to be used by the scenario. |
max_turns |
Optional. The maximum number of turns to simulate. If not specified, the simulation will continue until the task is complete. |
rubrics[] |
Required. The rubrics to score the scenario against. |
scenario_expectations[] |
Required. The ScenarioExpectations to evaluate the conversation produced by the user simulation. |
variable_overrides |
Optional. Variables / Session Parameters as context for the session, keyed by variable names. Members of this struct will override any default values set by the system. Note, these are different from user facts, which are facts known to the user. Variables are parameters known to the agent: i.e. MDN (phone number) passed by the telephony system. |
task_completion_behavior |
Optional. Deprecated. Use user_goal_behavior instead. |
user_goal_behavior |
Optional. The expected behavior of the user goal. |
evaluation_expectations[] |
Optional. The evaluation expectations to evaluate the conversation produced by the simulation against. Format: |
TaskCompletionBehavior
The expected behavior of the user task. This is used to determine whether the scenario is successful.
| Enums | |
|---|---|
TASK_COMPLETION_BEHAVIOR_UNSPECIFIED |
Behavior unspecified. Will default to TASK_SATISFIED. |
TASK_SATISFIED |
The user task should be completed successfully. |
TASK_REJECTED |
The user task should be rejected. |
UserFact
Facts about the user as a key value pair.
| Fields | |
|---|---|
name |
Required. The name of the user fact. |
value |
Required. The value of the user fact. |
UserGoalBehavior
The expected behavior of the user goal. This is used to determine whether the scenario is successful.
| Enums | |
|---|---|
USER_GOAL_BEHAVIOR_UNSPECIFIED |
Behavior unspecified. Will default to USER_GOAL_SATISFIED. |
USER_GOAL_SATISFIED |
The user goal should be completed successfully. |
USER_GOAL_REJECTED |
The user goal should be rejected. |
USER_GOAL_IGNORED |
Ignore the user goal status. |
ScenarioExpectation
The expectation to evaluate the conversation produced by the simulation.
| Fields | |
|---|---|
Union field expectation. The expectation to evaluate the conversation produced by the simulation. expectation can be only one of the following: |
|
tool_expectation |
Optional. The tool call and response pair to be evaluated. |
agent_response |
Optional. The agent response to be evaluated. |
ToolExpectation
The tool call and response pair to be evaluated.
| Fields | |
|---|---|
expected_tool_call |
Required. The expected tool call, with the parameters of interest specified. Any parameters not specified will be hallucinated by the LLM. |
mock_tool_response |
Required. The tool response to mock, with the parameters of interest specified. Any parameters not specified will be hallucinated by the LLM. |
Step
A step defines a singular action to happen during the evaluation.
| Fields | |
|---|---|
Union field step. The step to perform. step can be only one of the following: |
|
user_input |
Optional. User input for the conversation. |
agent_transfer |
Optional. Transfer the conversation to a different agent. |
expectation |
Optional. Executes an expectation on the current turn. |
EvaluationConfig
EvaluationConfig configures settings for running the evaluation.
| Fields | |
|---|---|
input_audio_config |
Optional. Configuration for processing the input audio. |
output_audio_config |
Optional. Configuration for generating the output audio. |
evaluation_channel |
Optional. The channel to evaluate. |
tool_call_behaviour |
Optional. Specifies whether the evaluation should use real tool calls or fake tools. |
EvaluationChannel
The channel to evaluate.
| Enums | |
|---|---|
EVALUATION_CHANNEL_UNSPECIFIED |
Unspecified evaluation channel. |
TEXT |
Text-only evaluation channel. |
AUDIO |
Audio evaluation channel. |
EvaluationDataset
An evaluation dataset represents a set of evaluations that are grouped together basaed on shared tags.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of this evaluation dataset. Format: |
display_name |
Required. User-defined display name of the evaluation dataset. Unique within an App. |
evaluations[] |
Optional. Evaluations that are included in this dataset. |
create_time |
Output only. Timestamp when the evaluation dataset was created. |
update_time |
Output only. Timestamp when the evaluation dataset was last updated. |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
created_by |
Output only. The user who created the evaluation dataset. |
last_updated_by |
Output only. The user who last updated the evaluation dataset. |
aggregated_metrics |
Output only. The aggregated metrics for this evaluation dataset across all runs. |
EvaluationErrorInfo
Information about an error encountered during an evaluation execution.
| Fields | |
|---|---|
error_type |
Output only. The type of error. |
error_message |
Output only. The error message. |
session_id |
Output only. The session ID for the conversation that caused the error. |
ErrorType
The type of error
| Enums | |
|---|---|
ERROR_TYPE_UNSPECIFIED |
Unspecified error type. |
RUNTIME_FAILURE |
Failure during runtime execution. |
CONVERSATION_RETRIEVAL_FAILURE |
Failure to retrieve conversation from CES Runtime. |
METRIC_CALCULATION_FAILURE |
Failure to calculate a metric / outcome. |
EVALUATION_UPDATE_FAILURE |
Failure to update the evaluation. |
QUOTA_EXHAUSTED |
Ran out of quota. |
USER_SIMULATION_FAILURE |
Failure during user simulation. |
EvaluationExpectation
An evaluation expectation represents a specific criteria to evaluate against.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of this evaluation expectation. Format: |
display_name |
Required. User-defined display name. Must be unique within the app. |
tags[] |
Optional. User-defined tags for expectations. Can be used to filter expectations. |
create_time |
Output only. Timestamp when the evaluation expectation was created. |
update_time |
Output only. Timestamp when the evaluation expectation was last updated. |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
Union field criteria. The definition of the criteria used for evaluation. criteria can be only one of the following: |
|
llm_criteria |
Optional. Evaluation criteria based on an LLM prompt. |
LlmCriteria
Configuration for LLM-based evaluation criteria.
| Fields | |
|---|---|
prompt |
Required. The prompt/instructions provided to the LLM judge. |
EvaluationMetricsThresholds
Threshold settings for metrics in an Evaluation.
| Fields | |
|---|---|
golden_evaluation_metrics_thresholds |
Optional. The golden evaluation metrics thresholds. |
hallucination_metric_behavior |
Optional. Deprecated: Use |
golden_hallucination_metric_behavior |
Optional. The hallucination metric behavior for golden evaluations. |
scenario_hallucination_metric_behavior |
Optional. The hallucination metric behavior for scenario evaluations. |
GoldenEvaluationMetricsThresholds
Settings for golden evaluations.
| Fields | |
|---|---|
turn_level_metrics_thresholds |
Optional. The turn level metrics thresholds. |
expectation_level_metrics_thresholds |
Optional. The expectation level metrics thresholds. |
tool_matching_settings |
Optional. The tool matching settings. An extra tool call is a tool call that is present in the execution but does not match any tool call in the golden expectation. |
ExpectationLevelMetricsThresholds
Expectation level metrics thresholds.
| Fields | |
|---|---|
tool_invocation_parameter_correctness_threshold |
Optional. The success threshold for individual tool invocation parameter correctness. Must be a float between 0 and 1. Default is 1.0. |
TurnLevelMetricsThresholds
Turn level metrics thresholds.
| Fields | |
|---|---|
semantic_similarity_channel |
Optional. The semantic similarity channel to use for evaluation. |
semantic_similarity_success_threshold |
Optional. The success threshold for semantic similarity. Must be an integer between 0 and 4. Default is >= 3. |
overall_tool_invocation_correctness_threshold |
Optional. The success threshold for overall tool invocation correctness. Must be a float between 0 and 1. Default is 1.0. |
SemanticSimilarityChannel
Semantic similarity channel to use.
| Enums | |
|---|---|
SEMANTIC_SIMILARITY_CHANNEL_UNSPECIFIED |
Metric unspecified. Defaults to TEXT. |
TEXT |
Use text semantic similarity. |
AUDIO |
Use audio semantic similarity. |
HallucinationMetricBehavior
The hallucination metric behavior. Regardless of the behavior, the metric will always be calculated. The difference is that when disabled, the metric is not used to calculate the overall evaluation score.
| Enums | |
|---|---|
HALLUCINATION_METRIC_BEHAVIOR_UNSPECIFIED |
Unspecified hallucination metric behavior. |
DISABLED |
Disable hallucination metric. |
ENABLED |
Enable hallucination metric. |
ToolMatchingSettings
Settings for matching tool calls.
| Fields | |
|---|---|
extra_tool_call_behavior |
Optional. Behavior for extra tool calls. Defaults to FAIL. |
ExtraToolCallBehavior
Defines the behavior when an extra tool call is encountered. An extra tool call is a tool call that is present in the execution but does not match any tool call in the golden expectation.
| Enums | |
|---|---|
EXTRA_TOOL_CALL_BEHAVIOR_UNSPECIFIED |
Unspecified behavior. Defaults to FAIL. |
FAIL |
Fail the evaluation if an extra tool call is encountered. |
ALLOW |
Allow the extra tool call. |
EvaluationPersona
A persona represents an end user in an evaluation.
| Fields | |
|---|---|
name |
Required. The unique identifier of the persona. Format: |
description |
Optional. The description of the persona. |
display_name |
Required. The display name of the persona. Unique within an app. |
personality |
Required. An instruction for the agent on how to behave in the evaluation. |
speech_config |
Optional. Configuration for how the persona sounds (TTS settings). |
SpeechConfig
Configuration for Text-to-Speech generation.
| Fields | |
|---|---|
speaking_rate |
Optional. The speaking rate. 1.0 is normal. Lower is slower (e.g., 0.8), higher is faster (e.g., 1.5). Useful for testing how the agent handles fast talkers. |
environment |
Optional. The simulated audio environment. |
voice_id |
Optional. The specific voice identifier/accent to use. Example: "en-US-Wavenet-D" or "en-GB-Standard-A" |
BackgroundEnvironment
Simulated audio environment.
| Enums | |
|---|---|
BACKGROUND_ENVIRONMENT_UNSPECIFIED |
Background environment unspecified. |
CALL_CENTER |
Call center environment. |
TRAFFIC |
Traffic noise environment. |
KIDS_NOISE |
Kids noise environment. |
CAFE |
Cafe environment. |
EvaluationResult
An evaluation result represents the output of running an Evaluation.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the evaluation result. Format: |
display_name |
Required. Display name of the Evaluation Result. Unique within an Evaluation. By default, it has the following format: " |
create_time |
Output only. Timestamp when the evaluation result was created. |
evaluation_status |
Output only. The outcome of the evaluation. Only populated if execution_state is COMPLETE. |
evaluation_run |
Output only. The evaluation run that produced this result. Format: |
persona |
Output only. The persona used to generate the conversation for the evaluation result. |
error_info |
Output only. Error information for the evaluation result. |
error |
Output only. Deprecated: Use |
initiated_by |
Output only. The user who initiated the evaluation run that resulted in this result. |
app_version |
Output only. The app version used to generate the conversation that resulted in this result. Format: |
app_version_display_name |
Output only. The display name of the |
changelog |
Output only. The changelog of the app version that the evaluation ran against. This is populated if user runs evaluation on latest/draft. |
changelog_create_time |
Output only. The create time of the changelog of the app version that the evaluation ran against. This is populated if user runs evaluation on latest/draft. |
execution_state |
Output only. The state of the evaluation result execution. |
evaluation_metrics_thresholds |
Output only. The evaluation thresholds for the result. |
config |
Output only. The configuration used in the evaluation run that resulted in this result. |
golden_run_method |
Output only. The method used to run the golden evaluation. |
Union field result. The result of the evaluation. Only populated when the execution_state is COMPLETED. result can be only one of the following: |
|
golden_result |
Output only. The outcome of a golden evaluation. |
scenario_result |
Output only. The outcome of a scenario evaluation. |
EvaluationExpectationResult
The result of a single evaluation expectation.
| Fields | |
|---|---|
evaluation_expectation |
Output only. The evaluation expectation. Format: |
prompt |
Output only. The prompt that was used for the evaluation. |
outcome |
Output only. The outcome of the evaluation expectation. |
explanation |
Output only. The explanation for the result. |
ExecutionState
The state of the evaluation result execution.
| Enums | |
|---|---|
EXECUTION_STATE_UNSPECIFIED |
Evaluation result execution state is not specified. |
RUNNING |
Evaluation result execution is running. |
COMPLETED |
Evaluation result execution has completed. |
ERROR |
Evaluation result execution failed due to an internal error. |
GoldenExpectationOutcome
Specifies the expectation and the result of that expectation.
| Fields | |
|---|---|
expectation |
Output only. The expectation that was evaluated. |
outcome |
Output only. The outcome of the expectation. |
semantic_similarity_result |
Output only. The result of the semantic similarity check. |
tool_invocation_result |
Output only. The result of the tool invocation check. |
Union field result. The result of the expectation. result can be only one of the following: |
|
observed_tool_call |
Output only. The result of the tool call expectation. |
observed_tool_response |
Output only. The result of the tool response expectation. |
observed_agent_response |
Output only. The result of the agent response expectation. |
observed_agent_transfer |
Output only. The result of the agent transfer expectation. |
ToolInvocationResult
The result of the tool invocation check.
| Fields | |
|---|---|
outcome |
Output only. The outcome of the tool invocation check. This is determined by comparing the parameter_correctness_score to the threshold. If the score is equal to or above the threshold, the outcome will be PASS. Otherwise, the outcome will be FAIL. |
explanation |
Output only. A free text explanation for the tool invocation result. |
parameter_correctness_score |
Output only. The tool invocation parameter correctness score. This indicates the percent of parameters from the expected tool call that were also present in the actual tool call. |
GoldenResult
The result of a golden evaluation.
| Fields | |
|---|---|
turn_replay_results[] |
Output only. The result of running each turn of the golden conversation. |
evaluation_expectation_results[] |
Output only. The results of the evaluation expectations. |
TurnReplayResult
The result of running a single turn of the golden conversation.
| Fields | |
|---|---|
conversation |
Output only. The conversation that was generated for this turn. |
expectation_outcome[] |
Output only. The outcome of each expectation. |
hallucination_result |
Output only. The result of the hallucination check. |
tool_invocation_score |
Output only. Deprecated. Use OverallToolInvocationResult instead. |
turn_latency |
Output only. Duration of the turn. |
tool_call_latencies[] |
Output only. The latency of each tool call in the turn. |
semantic_similarity_result |
Output only. The result of the semantic similarity check. |
overall_tool_invocation_result |
Output only. The result of the overall tool invocation check. |
error_info |
Output only. Information about the error that occurred during this turn. |
span_latencies[] |
Output only. The latency of spans in the turn. |
tool_ordered_invocation_score |
Output only. The overall tool ordered invocation score for this turn. This indicates the overall percent of tools from the expected turn that were actually invoked in the expected order. |
HallucinationResult
The result of the hallucination check for a single turn.
| Fields | |
|---|---|
label |
Output only. The label associated with each score. Score 1: Justified Score 0: Not Justified Score -1: No Claim To Assess |
explanation |
Output only. The explanation for the hallucination score. |
score |
Output only. The hallucination score. Can be -1, 0, 1. |
Outcome
The outcome of the evaluation or expectation.
| Enums | |
|---|---|
OUTCOME_UNSPECIFIED |
Evaluation outcome is not specified. |
PASS |
Evaluation/Expectation passed. In the case of an evaluation, this means that all expectations were met. |
FAIL |
Evaluation/Expectation failed. In the case of an evaluation, this means that at least one expectation was not met. |
SKIPPED |
Evaluation/Expectation was skipped. |
OverallToolInvocationResult
The result of the overall tool invocation check.
| Fields | |
|---|---|
outcome |
Output only. The outcome of the tool invocation check. This is determined by comparing the tool_invocation_score to the overall_tool_invocation_correctness_threshold. If the score is equal to or above the threshold, the outcome will be PASS. Otherwise, the outcome will be FAIL. |
tool_invocation_score |
The overall tool invocation score for this turn. This indicates the overall percent of tools from the expected turn that were actually invoked. |
ScenarioExpectationOutcome
The outcome of a scenario expectation.
| Fields | |
|---|---|
expectation |
Output only. The expectation that was evaluated. |
outcome |
Output only. The outcome of the ScenarioExpectation. |
Union field result. The result of the expectation. result can be only one of the following: |
|
observed_tool_call |
Output only. The observed tool call. |
observed_agent_response |
Output only. The observed agent response. |
ObservedToolCall
The observed tool call and response.
| Fields | |
|---|---|
tool_call |
Output only. The observed tool call. |
tool_response |
Output only. The observed tool response. |
ScenarioResult
The outcome of a scenario evaluation.
| Fields | |
|---|---|
conversation |
Output only. The conversation that was generated in the scenario. |
task |
Output only. The task that was used when running the scenario for this result. |
user_facts[] |
Output only. The user facts that were used by the scenario for this result. |
expectation_outcomes[] |
Output only. The outcome of each expectation. |
rubric_outcomes[] |
Output only. The outcome of the rubric. |
hallucination_result[] |
Output only. The result of the hallucination check. There will be one hallucination result for each turn in the conversation. |
task_completion_result |
Output only. The result of the task completion check. |
tool_call_latencies[] |
Output only. The latency of each tool call execution in the conversation. |
user_goal_satisfaction_result |
Output only. The result of the user goal satisfaction check. |
span_latencies[] |
Output only. The latency of spans in the conversation. |
evaluation_expectation_results[] |
Output only. The results of the evaluation expectations. |
all_expectations_satisfied |
Output only. Whether all expectations were satisfied for this turn. |
task_completed |
Output only. Whether the task was completed for this turn. This is a composite of all expectations satisfied, no hallucinations, and user goal satisfaction. |
ScenarioRubricOutcome
The outcome of the evaluation against the rubric.
| Fields | |
|---|---|
rubric |
Output only. The rubric that was used to evaluate the conversation. |
score_explanation |
Output only. The rater's response to the rubric. |
score |
Output only. The score of the conversation against the rubric. |
SemanticSimilarityResult
The result of the semantic similarity check.
| Fields | |
|---|---|
label |
Output only. The label associated with each score. Score 4: Fully Consistent Score 3: Mostly Consistent Score 2: Partially Consistent (Minor Omissions) Score 1: Largely Inconsistent (Major Omissions) Score 0: Completely Inconsistent / Contradictory |
explanation |
Output only. The explanation for the semantic similarity score. |
outcome |
Output only. The outcome of the semantic similarity check. This is determined by comparing the score to the semantic_similarity_success_threshold. If the score is equal to or above the threshold, the outcome will be PASS. Otherwise, the outcome will be FAIL. |
score |
Output only. The semantic similarity score. Can be 0, 1, 2, 3, or 4. |
SpanLatency
The latency of a span execution.
| Fields | |
|---|---|
type |
Output only. The type of span. |
display_name |
Output only. The display name of the span. Applicable to tool and guardrail spans. |
start_time |
Output only. The start time of span. |
end_time |
Output only. The end time of span. |
execution_latency |
Output only. The latency of span. |
Union field identifier. The identifier of the specific item based on its type. identifier can be only one of the following: |
|
resource |
Output only. The resource name of the guardrail or tool spans. |
toolset |
Output only. The toolset tool identifier. |
model |
Output only. The name of the LLM span. |
callback |
Output only. The name of the user callback span. |
Type
The type of span. Additional values may be added in the future.
| Enums | |
|---|---|
TYPE_UNSPECIFIED |
Default value. This value is unused. |
TOOL |
Tool call span. |
USER_CALLBACK |
User callback span. |
GUARDRAIL |
Guardrail span. |
LLM |
LLM span. |
TaskCompletionResult
The result of the task completion check for the conversation.
| Fields | |
|---|---|
label |
Output only. The label associated with each score. Score 1: Task Completed Score 0: Task Not Completed Score -1: User Goal Undefined |
explanation |
Output only. The explanation for the task completion score. |
score |
Output only. The task completion score. Can be -1, 0, 1 |
ToolCallLatency
The latency of a tool call execution.
| Fields | |
|---|---|
tool |
Output only. The name of the tool that got executed. Format: |
display_name |
Output only. The display name of the tool. |
start_time |
Output only. The start time of the tool call execution. |
end_time |
Output only. The end time of the tool call execution. |
execution_latency |
Output only. The latency of the tool call execution. |
UserGoalSatisfactionResult
The result of a user goal satisfaction check for a conversation.
| Fields | |
|---|---|
label |
Output only. The label associated with each score. Score 1: User Task Satisfied Score 0: User Task Not Satisfied Score -1: User Task Unspecified |
explanation |
Output only. The explanation for the user task satisfaction score. |
score |
Output only. The user task satisfaction score. Can be -1, 0, 1. |
EvaluationRun
An evaluation run represents an all the evaluation results from an evaluation execution.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the evaluation run. Format: |
display_name |
Optional. User-defined display name of the evaluation run. default: " |
evaluation_results[] |
Output only. The evaluation results that are part of this run. Format: |
create_time |
Output only. Timestamp when the evaluation run was created. |
initiated_by |
Output only. The user who initiated the evaluation run. |
app_version |
Output only. The app version to evaluate. Format: |
app_version_display_name |
Output only. The display name of the |
changelog |
Output only. The changelog of the app version that the evaluation ran against. This is populated if user runs evaluation on latest/draft. |
changelog_create_time |
Output only. The create time of the changelog of the app version that the evaluation ran against. This is populated if user runs evaluation on latest/draft. |
evaluations[] |
Output only. The evaluations that are part of this run. The list may contain evaluations of either type. This field is mutually exclusive with |
evaluation_dataset |
Output only. The evaluation dataset that this run is associated with. This field is mutually exclusive with |
evaluation_type |
Output only. The type of the evaluations in this run. |
state |
Output only. The state of the evaluation run. |
progress |
Output only. The progress of the evaluation run. |
config |
Output only. The configuration used in the run. |
error |
Output only. Deprecated: Use error_info instead. Errors encountered during execution. |
error_info |
Output only. Error information for the evaluation run. |
evaluation_run_summaries |
Output only. Map of evaluation name to EvaluationRunSummary. |
latency_report |
Output only. Latency report for the evaluation run. |
run_count |
Output only. The number of times the evaluations inside the run were run. |
persona_run_configs[] |
Output only. The configuration to use for the run per persona. |
optimization_config |
Optional. Configuration for running the optimization step after the evaluation run. If not set, the optimization step will not be run. |
scheduled_evaluation_run |
Output only. The scheduled evaluation run resource name that created this evaluation run. This field is only set if the evaluation run was created by a scheduled evaluation run. Format: |
golden_run_method |
Output only. The method used to run the evaluation. |
EvaluationRunState
The state of the evaluation run.
| Enums | |
|---|---|
EVALUATION_RUN_STATE_UNSPECIFIED |
Evaluation run state is not specified. |
RUNNING |
Evaluation run is running. |
COMPLETED |
Evaluation run has completed. |
ERROR |
The evaluation run has an error. |
EvaluationRunSummary
Contains the summary of passed and failed result counts for a specific evaluation in an evaluation run.
| Fields | |
|---|---|
passed_count |
Output only. Number of passed results for the associated Evaluation in this run. |
failed_count |
Output only. Number of failed results for the associated Evaluation in this run. |
error_count |
Output only. Number of error results for the associated Evaluation in this run. |
EvaluationType
The type of the evaluations in this run. Additional values may be added in the future.
| Enums | |
|---|---|
EVALUATION_TYPE_UNSPECIFIED |
Evaluation type is not specified. |
GOLDEN |
Golden evaluation. |
SCENARIO |
Scenario evaluation. |
MIXED |
Indicates the run includes a mix of golden and scenario evaluations. |
Progress
The progress of the evaluation run.
| Fields | |
|---|---|
total_count |
Output only. Total number of evaluation results in this run. |
failed_count |
Output only. Number of completed evaluation results with an outcome of FAIL. (EvaluationResult.execution_state is COMPLETED and EvaluationResult.evaluation_status is FAIL). |
error_count |
Output only. Number of evaluation results that failed to execute. (EvaluationResult.execution_state is ERROR). |
completed_count |
Output only. Number of evaluation results that finished successfully. (EvaluationResult.execution_state is COMPLETED). |
passed_count |
Output only. Number of completed evaluation results with an outcome of PASS. (EvaluationResult.execution_state is COMPLETED and EvaluationResult.evaluation_status is PASS). |
EvaluationSettings
Settings for evaluation.
| Fields | |
|---|---|
scenario_conversation_initiator |
Optional. Who starts the conversation in a scenario evaluation. |
golden_run_method |
Optional. The default method used to run golden evaluations. This will be used if no golden_run_method is specified in the RunEvaluationRequest. |
golden_evaluation_tool_call_behaviour |
Optional. Configures the default tool call behaviour for golden evaluations. |
scenario_evaluation_tool_call_behaviour |
Optional. Configures the default tool call behaviour for scenario evaluations. |
ScenarioConversationInitiator
Determines who starts the conversation in a scenario evaluation session.
| Enums | |
|---|---|
SCENARIO_CONVERSATION_INITIATOR_UNSPECIFIED |
Unspecified. Defaults to USER. |
USER |
The user starts the conversation. |
AGENT |
The agent starts the conversation. |
EvaluationToolCallBehaviour
Configures the tool call behaviour for evaluation runs.
| Enums | |
|---|---|
EVALUATION_TOOL_CALL_BEHAVIOUR_UNSPECIFIED |
Unspecified tool call behavior. Will default to real tool calls. |
REAL |
Use real tool calls. |
FAKE |
Use fake tool calls. |
Event
Event input.
| Fields | |
|---|---|
event |
Required. The name of the event. |
Example
An example represents a sample conversation between the user and the agent(s).
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the example. Format: |
display_name |
Required. Display name of the example. |
description |
Optional. Human-readable description of the example. |
entry_agent |
Optional. The agent that initially handles the conversation. If not specified, the example represents a conversation that is handled by the root agent. Format: |
messages[] |
Optional. The collection of messages that make up the conversation. |
create_time |
Output only. Timestamp when the example was created. |
update_time |
Output only. Timestamp when the example was last updated. |
invalid |
Output only. The example may become invalid if referencing resources are deleted. Invalid examples will not be used as few-shot examples. |
etag |
Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
ExecuteToolRequest
Request message for ToolService.ExecuteTool.
| Fields | |
|---|---|
parent |
Required. The resource name of the app which the tool/toolset belongs to. Format: |
args |
Optional. The input parameters and values for the tool in JSON object format. |
mock_config |
Optional. Mock configuration for the tool execution. If this field is set, tools that call other tools will be mocked based on the provided patterns and responses. |
Union field tool_identifier. The identifier of the tool to execute. It could be either a persisted tool or a tool from a toolset. tool_identifier can be only one of the following: |
|
tool |
Optional. The name of the tool to execute. Format: projects/{project}/locations/{location}/apps/{app}/tools/{tool} |
toolset_tool |
Optional. The toolset tool to execute. Only one tool should match the predicate from the toolset. Otherwise, an error will be returned. |
Union field tool_execution_context. Additional context to be provided for the tool execution tool_execution_context can be only one of the following: |
|
variables |
Optional. The variables that are available for the tool execution. |
context |
Optional. The [ToolCallContext](https://docs.cloud.google.com/customer-engagement-ai/conversational-agents/ps/tool/python#environment for details) to be passed to the Python tool. |
ExecuteToolResponse
Response message for ToolService.ExecuteTool.
| Fields | |
|---|---|
response |
The tool execution result in JSON object format. Use "output" key to specify tool response and "error" key to specify error details (if any). If "output" and "error" keys are not specified, then whole "response" is treated as tool execution result. |
variables |
The variable values at the end of the tool execution. |
Union field tool_identifier. The identifier of the tool that got executed. tool_identifier can be only one of the following: |
|
tool |
The name of the tool that got executed. Format: |
toolset_tool |
The toolset tool that got executed. |
ExecutionType
The execution type of the tool or toolset.
| Enums | |
|---|---|
EXECUTION_TYPE_UNSPECIFIED |
The execution type is unspecified. Defaults to SYNCHRONOUS if unspecified. |
SYNCHRONOUS |
The tool is executed synchronously. The session is blocked until the tool returns. |
ASYNCHRONOUS |
The tool is executed asynchronously. The session will continue while the tool is executing. |
ExportAppRequest
Request message for AgentService.ExportApp.
| Fields | |
|---|---|
name |
Required. The resource name of the app to export. |
export_format |
Required. The format to export the app in. |
gcs_uri |
Optional. The Google Cloud Storage URI to which to export the app. The format of this URI must be |
app_version |
Optional. The resource name of the app version to export. Format: |
ExportFormat
Export format for the app.
| Enums | |
|---|---|
EXPORT_FORMAT_UNSPECIFIED |
The export format is unspecified. |
JSON |
The export format is JSON. |
YAML |
The export format is YAML. |
ExportAppResponse
Response message for AgentService.ExportApp.
| Fields | |
|---|---|
Union field app. The exported app. app can be only one of the following: |
|
app_content |
App folder compressed as a zip file. |
app_uri |
The Google Cloud Storage URI to which the app was exported. |
ExportEvaluationsRequest
Request message for EvaluationService.ExportEvaluations.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to export evaluations from. Format: |
names[] |
Required. The resource names of the evaluations to export. |
export_options |
Optional. The export options for the evaluations. |
include_evaluation_results |
Optional. Includes evaluation results in the export. At least one of include_evaluation_results or include_evaluations must be set. |
include_evaluations |
Optional. Includes evaluations in the export. At least one of include_evaluation_results or include_evaluations must be set. |
ExportEvaluationsResponse
Response message for EvaluationService.ExportEvaluations.
| Fields | |
|---|---|
failed_evaluations |
Output only. A map of evaluation resource names that could not be exported, to the reason why they failed. |
Union field evaluations. The exported evaluations. evaluations can be only one of the following: |
|
evaluations_content |
The content of the exported Evaluations. This will be populated if gcs_uri was not specified in the request. |
evaluations_uri |
The Google Cloud Storage URI folder where the exported evaluations were written. This will be populated if gcs_uri was specified in the request. |
ExportOptions
Options for exporting CES evaluation resources.
| Fields | |
|---|---|
export_format |
Optional. The format to export the evaluation results in. Defaults to JSON if not specified. |
gcs_uri |
Optional. The Google Cloud Storage URI to write the exported Evaluation Results to. |
ExportFormat
The format to export the items in. Defaults to JSON if not specified.
| Enums | |
|---|---|
EXPORT_FORMAT_UNSPECIFIED |
Unspecified format. |
JSON |
JSON format. |
YAML |
YAML format. |
ExpressionCondition
Expression condition based on session state.
| Fields | |
|---|---|
expression |
Required. The string representation of cloud.api.Expression condition. |
FileContext
Files to be used as context. Files can be provided as raw bytes.
| Fields | |
|---|---|
Union field file. File provided as context. file can be only one of the following: |
|
file_bytes |
Optional. File provided as raw bytes. |
FileBytes
File provided as raw bytes.
| Fields | |
|---|---|
file_name |
Required. The name of the file provided as raw bytes. |
mime_type |
Required. The IANA standard MIME type of the source data. |
data |
Required. Raw bytes of the file. |
FileSearchTool
The file search tool allows the agent to search across the files uploaded by the app/agent developer. It has presets to give relatively good quality search over the uploaded files and summarization of the retrieved results.
| Fields | |
|---|---|
corpus_type |
Optional. The type of the corpus. Default is FULLY_MANAGED. |
name |
Required. The tool name. |
description |
Optional. The tool description. |
file_corpus |
Optional. The corpus where files are stored. Format: projects/{project}/locations/{location}/ragCorpora/{rag_corpus} |
CorpusType
The type of the Vertex RAG corpus.
| Enums | |
|---|---|
CORPUS_TYPE_UNSPECIFIED |
Unspecified corpus type. |
USER_OWNED |
The corpus is created and owned by the user. |
FULLY_MANAGED |
The corpus is created by the agent. |
GenerateAppResourceOperationMetadata
Operation metadata for AgentService.GenerateAppResource.
| Fields | |
|---|---|
generation_type |
Output only. The type of the operation. |
message |
Output only. Human-readable status of the operation, if any. |
create_time |
Output only. The time the operation was created. |
end_time |
Output only. The time the operation finished running. |
target |
Output only. The resource name of the app that the operation is associated with. Format: |
partial_errors[] |
Output only. Error messages from the resource generation process. |
GenerationType
The type of the generation operation.
| Enums | |
|---|---|
GENERATION_TYPE_UNSPECIFIED |
Unspecified operation type. |
AGENT_RESTRUCTURE |
Agent instruction restructure type. |
AGENT_REFINE |
Agent instruction refinement type. |
AGENT_CREATE |
Agent creation from type. |
TOOL_CREATE |
Tool creation type. |
SCENARIO_CREATE |
Scenario creation type. |
SCENARIO_CREATE_FROM_TRANSCRIPTS |
Scenario creation from transcripts type. |
EVALUATION_PERSONA_CREATE |
Evaluation persona generation type. |
QUALITY_REPORT_CREATE |
Quality report generation type. |
INSTRUCTION_FOLLOWING_FIX |
Instruction following fix type (used for hill climbing fixes). |
GenerateAppResourceRequest
Request message for AgentService.GenerateAppResource.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to generate the resource for. |
refine_instructions[] |
Optional. List of refine instructions to be used to refine the resource. |
tool_generation_config |
Optional. The configuration to be used to generate the tool. |
app_generation_config |
Optional. The configuration to be used to generate the agents and tools. |
evaluation_generation_config |
Optional. The configuration to be used to generate the evaluations. |
evaluation_personas_generation_config |
Optional. The configuration to be used to generate the evaluation personas. |
quality_report_generation_config |
Optional. The configuration to be used for quality report generation. |
hill_climbing_fix_config |
Optional. The configuration to be used for hill climbing fixes. |
Union field resource. The resource to generate. resource can be only one of the following: |
|
agent |
The agent resource to be used by the LLM assistant, can be empty for generating a new agent. |
tool |
The tool resource to be used by the LLM assistant, can be empty for generating a new tool. |
toolset |
The toolset resource to be used by the LLM assistant, can be empty for generating a new toolset. |
AppGenerationConfig
The configuration to be used to generate the app.
| Fields | |
|---|---|
context |
Optional. The context which describes the requirements of the agents & tools to be generated. |
file_contexts[] |
Optional. The files to be used as context. |
dataset_id |
Optional. The insights dataset to be used to fetch conversation data for generating the agents & tools. Format: |
generate_evaluations |
Optional. Whether to generate the evaluations for the app. If true, the provided context will be used to generate the evaluations data. |
gcs_location |
Optional. The Cloud Storage location to store the generated question answer data to be used by the Datastore tool. This data is generated only when using conversation data as an input source. The location must be in the same project as the app. Format: |
EvaluationGenerationConfig
The configuration to be used to generate the evaluations.
| Fields | |
|---|---|
dataset_id |
Optional. The insights dataset to be used to fetch conversation data for generating the evaluations. Format: |
EvaluationPersonasGenerationConfig
This type has no fields.
The configuration to be used to generate the evaluation personas.
HillClimbingFixConfig
The configuration to be used for hill climbing fixes.
| Fields | |
|---|---|
quality_report |
Required. The quality report used to inform the instruction following fix. |
QualityReportGenerationConfig
The configuration to be used for quality report generation.
| Fields | |
|---|---|
evaluation_run |
Required. The evaluation run used to inform quality report analysis. |
RefineInstructions
The instructions to be used to refine a part of the resource. The part of the resource can be specified with a start index, end index and a field mask. For example, if you want to refine a part of the agent instructions you can specify the index of the first character of the instructions, the index of the last character of the instructions and the field mask as "instructions".
| Fields | |
|---|---|
start_index |
Required. The first character (inclusive) of the text to refine. |
end_index |
Required. The last character (inclusive) of the text to refine. |
field_mask |
Required. The field of the resource being refined. Only one field is allowed per RefineInstructions. If refining agent instructions, the field mask should be "instructions". |
instructions |
Required. The instructions to refine the resource. |
ToolGenerationConfig
The configuration to be used to generate a tool.
| Fields | |
|---|---|
context |
Optional. The context which describes the tool to be generated. This can be empty if the tool request & response are provided. |
file_contexts[] |
Optional. The files to be used as context. |
open_api_toolset_generation_config |
Optional. The configuration to be used to generate an Open API schema. |
OpenApiToolsetGenerationConfig
The configuration to be used to generate an Open API schema.
| Fields | |
|---|---|
uri |
Required. The base uri of the tool. |
operation_generation_configs[] |
Required. The list of operations to be added to the Open API schema. |
OperationGenerationConfig
The configuration to be used to generate an operation in the Open API schema.
| Fields | |
|---|---|
method |
Required. The uri of the tool. This should include query and path parameters if any. |
path |
Required. The path of the tool to be appended to the base uri. This should include query and path parameters if any. |
request_json |
Required. A sample request to the tool in JSON format. Skip if the tool does not support request body. |
response_json |
Required. A sample response from the tool in JSON format. |
GenerateAppResourceResponse
Response message for AgentService.GenerateAppResource.
| Fields | |
|---|---|
generate_result_info |
Additional information about the generated result. |
Union field generated_resource. The generated resource. generated_resource can be only one of the following: |
|
agent |
Agent generated by the LLM assistant. |
toolset |
Toolset generated by the LLM assistant. Supports Open API toolset schema generation. |
app_snapshot |
App snapshot generated by the LLM assistant. This snapshot contains the app, agents & tools generated by the LLM assistant. |
tools |
The list of tools generated by the LLM assistant. |
evaluations |
Evaluations generated by the LLM assistant. |
app_resources |
The app resources generated by the LLM assistant. |
quality_report |
The quality report generated by the LLM assistant. |
AppResources
The list of app resources generated by the LLM assistant.
| Fields | |
|---|---|
app_snapshot |
The app snapshot generated by the LLM assistant. This snapshot contains the app, agents & tools generated by the LLM assistant. |
evaluations[] |
The list of evaluations generated by the LLM assistant. |
Evaluations
The list of evaluations generated by the LLM assistant.
| Fields | |
|---|---|
evaluations[] |
The list of generated evaluations. |
GenerateResultInfo
This provides additional information about the generated result.
| Fields | |
|---|---|
explanation |
An explanation of the changes in the generated resource. |
Tools
The list of tools generated by the LLM assistant.
| Fields | |
|---|---|
tools[] |
The list of tools generated by the LLM assistant. |
GenerateChatTokenRequest
Request message for WidgetService.GenerateChatToken.
| Fields | |
|---|---|
name |
Required. The session name to generate the chat token for. Format: projects/{project}/locations/{location}/apps/{app}/sessions/{session} |
deployment |
Required. The deployment of the app to use for the session. Format: projects/{project}/locations/{location}/apps/{app}/deployments/{deployment} |
recaptcha_token |
Optional. The reCAPTCHA token generated by the client-side chat widget. |
live_handoff_enabled |
Optional. Indicates if live handoff is enabled for the session. |
GenerateChatTokenResponse
Response message for WidgetService.GenerateChatToken.
| Fields | |
|---|---|
chat_token |
The session scoped token for chat widget to authenticate with Session APIs. |
expire_time |
The time at which the chat token expires. |
GenerateEvaluationOperationMetadata
This type has no fields.
Operation metadata for EvaluationService.GenerateEvaluation.
GenerateEvaluationRequest
Request message for EvaluationService.GenerateEvaluation.
| Fields | |
|---|---|
conversation |
Required. The conversation to create the golden evaluation for. Format: |
source |
Optional. Indicate the source of the conversation. If not set, all sources will be searched. |
GetAgentRequest
Request message for AgentService.GetAgent.
| Fields | |
|---|---|
name |
Required. The resource name of the agent to retrieve. |
GetAppRequest
Request message for AgentService.GetApp.
| Fields | |
|---|---|
name |
Required. The resource name of the app to retrieve. |
GetAppVersionRequest
Request message for AgentService.GetAppVersion.
| Fields | |
|---|---|
name |
Required. The resource name of the app version to retrieve. |
GetChangelogRequest
Request message for AgentService.GetChangelog.
| Fields | |
|---|---|
name |
Required. The resource name of the changelog to retrieve. |
GetConversationRequest
Request message for AgentService.GetConversation.
| Fields | |
|---|---|
name |
Required. The resource name of the conversation to retrieve. |
source |
Optional. Indicate the source of the conversation. If not set, all source will be searched. |
GetDeploymentRequest
Request message for AgentService.GetDeployment.
| Fields | |
|---|---|
name |
Required. The name of the deployment. Format: |
GetEvaluationDatasetRequest
Request message for EvaluationService.GetEvaluationDataset.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation dataset to retrieve. |
GetEvaluationExpectationRequest
Request message for EvaluationService.GetEvaluationExpectation.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation expectation to retrieve. |
GetEvaluationRequest
Request message for EvaluationService.GetEvaluation.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation to retrieve. |
GetEvaluationResultRequest
Request message for EvaluationService.GetEvaluationResult.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation result to retrieve. |
GetEvaluationRunRequest
Request message for EvaluationService.GetEvaluationRun.
| Fields | |
|---|---|
name |
Required. The resource name of the evaluation run to retrieve. |
GetExampleRequest
Request message for AgentService.GetExample.
| Fields | |
|---|---|
name |
Required. The resource name of the example to retrieve. |
GetGuardrailRequest
Request message for AgentService.GetGuardrail.
| Fields | |
|---|---|
name |
Required. The resource name of the guardrail to retrieve. |
GetScheduledEvaluationRunRequest
Request message for EvaluationService.GetScheduledEvaluationRun.
| Fields | |
|---|---|
name |
Required. The resource name of the scheduled evaluation run to retrieve. |
GetSecuritySettingsRequest
Request message for AgentService.GetSecuritySettings.
| Fields | |
|---|---|
name |
Required. The resource name of the security settings to retrieve. Format: |
GetToolRequest
Request message for AgentService.GetTool.
| Fields | |
|---|---|
name |
Required. The resource name of the tool to retrieve. |
GetToolsetRequest
Request message for AgentService.GetToolset.
| Fields | |
|---|---|
name |
Required. The resource name of the toolset to retrieve. |
GoAway
This type has no fields.
Indicates that the server will disconnect soon and the client should half-close and restart the connection.
GoldenRunMethod
The method used to run the evaluation.
| Enums | |
|---|---|
GOLDEN_RUN_METHOD_UNSPECIFIED |
Run method is not specified. |
STABLE |
Run the evaluation as stable replay, where each turn is a unique session with the previous expected turns injected as context. |
NAIVE |
Run the evaluation as naive replay, where the run is a single session with no context injected. |
GoogleSearchSuggestions
Search suggestions from Google Search Tool.
| Fields | |
|---|---|
htmls[] |
Compliant HTML and CSS styling for search suggestions. The provided HTML and CSS automatically adapts to your device settings, displaying in either light or dark mode indicated by |
web_search_queries[] |
List of queries used to perform the google search along with the search result URIs forming the search suggestions. |
GoogleSearchTool
Represents a tool to perform Google web searches for grounding. See https://cloud.google.com/customer-engagement-ai/conversational-agents/ps/tool#google-search.
| Fields | |
|---|---|
name |
Required. The name of the tool. |
description |
Optional. Description of the tool's purpose. |
context_urls[] |
Optional. Content will be fetched directly from these URLs for context and grounding. Example: "https://example.com/path.html". A maximum of 20 URLs are allowed. |
preferred_domains[] |
Optional. Specifies domains to restrict search results to. Example: "example.com", "another.site". A maximum of 20 domains can be specified. |
exclude_domains[] |
Optional. List of domains to be excluded from the search results. Example: "example.com". A maximum of 2000 domains can be excluded. |
prompt_config |
Optional. Prompt instructions passed to planner on how the search results should be processed for text and voice. |
PromptConfig
Prompt settings used by the model when processing or summarizing the google search results.
| Fields | |
|---|---|
text_prompt |
Optional. Defines the prompt used for the system instructions when interacting with the agent in chat conversations. If not set, default prompt will be used. |
voice_prompt |
Optional. Defines the prompt used for the system instructions when interacting with the agent in voice conversations. If not set, default prompt will be used. |
Guardrail
Guardrail contains a list of checks and balances to keep the agents safe and secure.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the guardrail. Format: |
display_name |
Required. Display name of the guardrail. |
description |
Optional. Description of the guardrail. |
enabled |
Optional. Whether the guardrail is enabled. |
action |
Optional. Action to take when the guardrail is triggered. |
create_time |
Output only. Timestamp when the guardrail was created. |
update_time |
Output only. Timestamp when the guardrail was last updated. |
etag |
Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
Union field guardrail_type. Guardrail type. guardrail_type can be only one of the following: |
|
content_filter |
Optional. Guardrail that bans certain content from being used in the conversation. |
llm_prompt_security |
Optional. Guardrail that blocks the conversation if the prompt is considered unsafe based on the LLM classification. |
llm_policy |
Optional. Guardrail that blocks the conversation if the LLM response is considered violating the policy based on the LLM classification. |
model_safety |
Optional. Guardrail that blocks the conversation if the LLM response is considered unsafe based on the model safety settings. |
code_callback |
Optional. Guardrail that potentially blocks the conversation based on the result of the callback execution. |
CodeCallback
Guardrail that blocks the conversation based on the code callbacks provided.
| Fields | |
|---|---|
before_agent_callback |
Optional. The callback to execute before the agent is called. Each callback function is expected to return a structure (e.g., a dict or object) containing at least: - 'decision': Either 'OK' or 'TRIGGER'. - 'reason': A string explaining the decision. A 'TRIGGER' decision may halt further processing. |
after_agent_callback |
Optional. The callback to execute after the agent is called. Each callback function is expected to return a structure (e.g., a dict or object) containing at least: - 'decision': Either 'OK' or 'TRIGGER'. - 'reason': A string explaining the decision. A 'TRIGGER' decision may halt further processing. |
before_model_callback |
Optional. The callback to execute before the model is called. If there are multiple calls to the model, the callback will be executed multiple times. Each callback function is expected to return a structure (e.g., a dict or object) containing at least: - 'decision': Either 'OK' or 'TRIGGER'. - 'reason': A string explaining the decision. A 'TRIGGER' decision may halt further processing. |
after_model_callback |
Optional. The callback to execute after the model is called. If there are multiple calls to the model, the callback will be executed multiple times. Each callback function is expected to return a structure (e.g., a dict or object) containing at least: - 'decision': Either 'OK' or 'TRIGGER'. - 'reason': A string explaining the decision. A 'TRIGGER' decision may halt further processing. |
ContentFilter
Guardrail that bans certain content from being used in the conversation.
| Fields | |
|---|---|
banned_contents[] |
Optional. List of banned phrases. Applies to both user inputs and agent responses. |
banned_contents_in_user_input[] |
Optional. List of banned phrases. Applies only to user inputs. |
banned_contents_in_agent_response[] |
Optional. List of banned phrases. Applies only to agent responses. |
match_type |
Required. Match type for the content filter. |
disregard_diacritics |
Optional. If true, diacritics are ignored during matching. |
MatchType
Match type for the content filter.
| Enums | |
|---|---|
MATCH_TYPE_UNSPECIFIED |
Match type is not specified. |
SIMPLE_STRING_MATCH |
Content is matched for substrings character by character. |
WORD_BOUNDARY_STRING_MATCH |
Content only matches if the pattern found in the text is surrounded by word delimiters. Banned phrases can also contain word delimiters. |
REGEXP_MATCH |
Content is matched using regular expression syntax. |
LlmPolicy
Guardrail that blocks the conversation if the LLM response is considered violating the policy based on the LLM classification.
| Fields | |
|---|---|
max_conversation_messages |
Optional. When checking this policy, consider the last 'n' messages in the conversation. When not set a default value of 10 will be used. |
model_settings |
Optional. Model settings. |
prompt |
Required. Policy prompt. |
policy_scope |
Required. Defines when to apply the policy check during the conversation. If set to |
fail_open |
Optional. If an error occurs during the policy check, fail open and do not trigger the guardrail. |
allow_short_utterance |
Optional. By default, the LLM policy check is bypassed for short utterances. Enabling this setting applies the policy check to all utterances, including those that would normally be skipped. |
PolicyScope
Defines when to apply the policy check during the conversation.
| Enums | |
|---|---|
POLICY_SCOPE_UNSPECIFIED |
Policy scope is not specified. |
USER_QUERY |
Policy check is triggered on user input. |
AGENT_RESPONSE |
Policy check is triggered on agent response. Applying this policy scope will introduce additional latency before the agent can respond. |
USER_QUERY_AND_AGENT_RESPONSE |
Policy check is triggered on both user input and agent response. Applying this policy scope will introduce additional latency before the agent can respond. |
LlmPromptSecurity
Guardrail that blocks the conversation if the input is considered unsafe based on the LLM classification.
| Fields | |
|---|---|
fail_open |
Optional. Determines the behavior when the guardrail encounters an LLM error. - If true: the guardrail is bypassed. - If false (default): the guardrail triggers/blocks. Note: If a custom policy is provided, this field is ignored in favor of the policy's 'fail_open' configuration. |
Union field security_config. Defines the security configuration mode. The user must choose one of the following configurations. security_config can be only one of the following: |
|
default_settings |
Optional. Use the system's predefined default security settings. To select this mode, include an empty 'default_settings' message in the request. The 'default_prompt_template' field within will be populated by the server in the response. |
custom_policy |
Optional. Use a user-defined LlmPolicy to configure the security guardrail. |
DefaultSecuritySettings
Configuration for default system security settings.
| Fields | |
|---|---|
default_prompt_template |
Output only. The default prompt template used by the system. This field is for display purposes to show the user what prompt the system uses by default. It is OUTPUT_ONLY. |
ModelSafety
Model safety settings overrides. When this is set, it will override the default settings and trigger the guardrail if the response is considered unsafe.
| Fields | |
|---|---|
safety_settings[] |
Required. List of safety settings. |
HarmBlockThreshold
Probability based thresholds levels for blocking.
| Enums | |
|---|---|
HARM_BLOCK_THRESHOLD_UNSPECIFIED |
Unspecified harm block threshold. |
BLOCK_LOW_AND_ABOVE |
Block low threshold and above (i.e. block more). |
BLOCK_MEDIUM_AND_ABOVE |
Block medium threshold and above. |
BLOCK_ONLY_HIGH |
Block only high threshold (i.e. block less). |
BLOCK_NONE |
Block none. |
OFF |
Turn off the safety filter. |
HarmCategory
Harm category.
| Enums | |
|---|---|
HARM_CATEGORY_UNSPECIFIED |
The harm category is unspecified. |
HARM_CATEGORY_HATE_SPEECH |
The harm category is hate speech. |
HARM_CATEGORY_DANGEROUS_CONTENT |
The harm category is dangerous content. |
HARM_CATEGORY_HARASSMENT |
The harm category is harassment. |
HARM_CATEGORY_SEXUALLY_EXPLICIT |
The harm category is sexually explicit content. |
SafetySetting
Safety setting.
| Fields | |
|---|---|
category |
Required. The harm category. |
threshold |
Required. The harm block threshold. |
Image
Represents an image input or output in the conversation.
| Fields | |
|---|---|
mime_type |
Required. The IANA standard MIME type of the source data. Supported image types includes: * image/png * image/jpeg * image/webp |
data |
Required. Raw bytes of the image. |
ImportAppRequest
Request message for AgentService.ImportApp.
| Fields | |
|---|---|
parent |
Required. The parent resource name with the location of the app to import. |
display_name |
Optional. The display name of the app to import. * If the app is created on import, and the display name is specified, the imported app will use this display name. If a conflict is detected with an existing app, a timestamp will be appended to the display name to make it unique. * If the app is a reimport, this field should not be set. Providing a display name during reimport will result in an INVALID_ARGUMENT error. |
app_id |
Optional. The ID to use for the imported app. * If not specified, a unique ID will be automatically assigned for the app. * Otherwise, the imported app will use this ID as the final component of its resource name. If an app with the same ID already exists at the specified location in the project, the content of the existing app will be replaced. |
import_options |
Optional. Options governing the import process for the app. |
ignore_app_lock |
Optional. Flag for overriding the app lock during import. If set to true, the import process will ignore the app lock. |
Union field app. The app to import. app can be only one of the following: |
|
gcs_uri |
The Google Cloud Storage URI from which to import app. The format of this URI must be |
app_content |
Raw bytes representing the compressed zip file with the app folder structure. |
ImportOptions
Configuration options for the app import process. These options control how the import behaves, particularly when conflicts arise with existing app data.
| Fields | |
|---|---|
conflict_resolution_strategy |
Optional. The strategy to use when resolving conflicts during import. |
ConflictResolutionStrategy
Defines the strategy for handling conflicts when an app with the same ID already exists, or when imported resources (like Agents, Tools, etc.) have the same display names as existing resources within that app.
| Enums | |
|---|---|
CONFLICT_RESOLUTION_STRATEGY_UNSPECIFIED |
The conflict resolution strategy is unspecified. |
REPLACE |
Replace existing data with imported data. If an app with the same app_id already exists, its content will be updated based on the imported app. - Resources (App, Agents, Tools, Examples, Guardrails, Toolsets) in the imported app that have the same display name as existing resources will overwrite the existing ones. - Imported resources with new display names will be created. - Existing resources that do not have a matching display name in the imported app will remain untouched. |
OVERWRITE |
Overwrite existing data with imported data. If an app with the same app_id already exists, its content will be overwritten with the imported app. - Existing resources (Agents, Tools, Examples, Guardrails, Toolsets) in the app will be deleted. - Imported resources will be created as new resources. |
ImportAppResponse
Response message for AgentService.ImportApp.
| Fields | |
|---|---|
name |
The resource name of the app that was imported. |
warnings[] |
Warning messages generated during the import process. If errors occur for specific resources, they will not be included in the imported app and the error will be mentioned here. |
ImportEvaluationsOperationMetadata
Represents the metadata of the long-running operation for EvaluationService.ImportEvaluations.
| Fields | |
|---|---|
create_time |
Output only. The time the operation was created. |
end_time |
Output only. The time the operation finished running. |
status_message |
Output only. Human-readable status of the operation, if any. |
ImportEvaluationsRequest
Request message for EvaluationService.ImportEvaluations.
| Fields | |
|---|---|
parent |
Required. The app to import the evaluations into. Format: |
import_options |
Optional. Options governing the import process for the evaluations. |
Union field source. The source of the evaluations to import from. source can be only one of the following: |
|
conversation_list |
The conversations to import the evaluations from. |
gcs_uri |
The Google Cloud Storage URI from which to import evaluations. The format of this URI must be |
csv_content |
Raw bytes representing the csv file with the evaluations structure. |
ConversationList
A list of conversation resource names.
| Fields | |
|---|---|
conversations[] |
Optional. Conversation resource names. |
ImportOptions
Configuration options for the evaluation import process. These options control how the import behaves, particularly when conflicts arise with existing evaluations data.
| Fields | |
|---|---|
conflict_resolution_strategy |
Optional. The strategy to use when resolving conflicts during import. |
ConflictResolutionStrategy
Defines the strategy for handling conflicts when an evaluation with the same evaluation ID already exists in the app.
| Enums | |
|---|---|
CONFLICT_RESOLUTION_STRATEGY_UNSPECIFIED |
The conflict resolution strategy is unspecified. |
OVERWRITE |
Overwrite the existing evaluation with the new one. |
SKIP |
Keep the existing evaluation and skip the new one. |
DUPLICATE |
Keep the existing evaluation and duplicate the new one as a new evaluation. |
ImportEvaluationsResponse
Response message for EvaluationService.ImportEvaluations.
| Fields | |
|---|---|
evaluations[] |
The list of evaluations that were imported into the app. |
evaluation_results[] |
The list of evaluation results that were imported into the app. |
evaluation_runs[] |
The list of evaluation runs that were imported into the app. |
error_messages[] |
Optional. A list of error messages associated with evaluations that failed to be imported. |
import_failure_count |
The number of evaluations that either failed to import entirely or completed import with one or more errors. |
evaluation_result_import_failure_count |
The number of evaluation results that either failed to import entirely or completed import with one or more errors. |
evaluation_run_import_failure_count |
The number of evaluation runs that either failed to import entirely or completed import with one or more errors. |
InputAudioConfig
InputAudioConfig configures how the CES agent should interpret the incoming audio data.
| Fields | |
|---|---|
audio_encoding |
Required. The encoding of the input audio data. |
sample_rate_hertz |
Required. The sample rate (in Hertz) of the input audio data. |
noise_suppression_level |
Optional. Whether to enable noise suppression on the input audio. Available values are "low", "moderate", "high", "very_high". |
InterruptionSignal
Indicates the agent's audio response has been interrupted. The client should immediately stop any current audio playback (e.g., due to user barge-in or a new agent response being generated).
| Fields | |
|---|---|
barge_in |
Whether the interruption is caused by a user barge-in event. |
LanguageSettings
Language settings of the app.
| Fields | |
|---|---|
default_language_code |
Optional. The default language code of the app. |
supported_language_codes[] |
Optional. List of languages codes supported by the app, in addition to the |
enable_multilingual_support |
Optional. Enables multilingual support. If true, agents in the app will use pre-built instructions to improve handling of multilingual input. |
fallback_action |
Optional. Deprecated: This feature is no longer supported. Use This can be a predefined action or a custom tool call. Valid values are: - A tool's full resource name, which triggers a specific tool execution. - A predefined system action, such as "escalate" or "exit", which triggers an |
LatencyReport
Latency report for the evaluation run.
| Fields | |
|---|---|
tool_latencies[] |
Output only. Unordered list. Latency metrics for each tool. |
callback_latencies[] |
Output only. Unordered list. Latency metrics for each callback. |
guardrail_latencies[] |
Output only. Unordered list. Latency metrics for each guardrail. |
llm_call_latencies[] |
Output only. Unordered list. Latency metrics for each LLM call. |
session_count |
Output only. The total number of sessions considered in the latency report. |
CallbackLatency
Latency metrics for a single callback.
| Fields | |
|---|---|
stage |
Output only. The stage of the callback. |
latency_metrics |
Output only. The latency metrics for the callback. |
GuardrailLatency
Latency metrics for a single guardrail.
| Fields | |
|---|---|
guardrail |
Output only. The name of the guardrail. Format: |
guardrail_display_name |
Output only. The display name of the guardrail. |
latency_metrics |
Output only. The latency metrics for the guardrail. |
LatencyMetrics
Latency metrics for a component.
| Fields | |
|---|---|
p50_latency |
Output only. The 50th percentile latency. |
p90_latency |
Output only. The 90th percentile latency. |
p99_latency |
Output only. The 99th percentile latency. |
call_count |
Output only. The number of times the resource was called. |
LlmCallLatency
Latency metrics for a single LLM call.
| Fields | |
|---|---|
model |
Output only. The name of the model. |
latency_metrics |
Output only. The latency metrics for the LLM call. |
ToolLatency
Latency metrics for a single tool.
| Fields | |
|---|---|
tool_display_name |
Output only. The display name of the tool. |
latency_metrics |
Output only. The latency metrics for the tool. |
Union field tool_identifier. The identifier of the tool. tool_identifier can be only one of the following: |
|
tool |
Output only. Format: |
toolset_tool |
Output only. The toolset tool identifier. |
ListAgentsRequest
Request message for AgentService.ListAgents.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list agents from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the agents. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time" is supported. See https://google.aip.dev/132#ordering for more details. |
ListAgentsResponse
Response message for AgentService.ListAgents.
| Fields | |
|---|---|
agents[] |
The list of agents. |
next_page_token |
A token that can be sent as |
ListAppVersionsRequest
Request message for AgentService.ListAppVersions.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list app versions from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the app versions. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time" is supported. See https://google.aip.dev/132#ordering for more details. |
ListAppVersionsResponse
Response message for AgentService.ListAppVersions.
| Fields | |
|---|---|
app_versions[] |
The list of app versions. |
next_page_token |
A token that can be sent as |
ListAppsRequest
Request message for AgentService.ListApps.
| Fields | |
|---|---|
parent |
Required. The resource name of the location to list apps from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the apps. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time" is supported. See https://google.aip.dev/132#ordering for more details. |
ListAppsResponse
Response message for AgentService.ListApps.
| Fields | |
|---|---|
apps[] |
The list of apps. |
next_page_token |
A token that can be sent as |
unreachable[] |
Unordered list. Locations that could not be reached. |
ListChangelogsRequest
Request message for AgentService.ListChangelogs.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list changelogs from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the changelogs. See https://google.aip.dev/160 for more details. The filter string can be used to filter by Examples: * |
order_by |
Optional. Field to sort by. Only "name" and "create_time" is supported. See https://google.aip.dev/132#ordering for more details. |
ListChangelogsResponse
Response message for AgentService.ListChangelogs.
| Fields | |
|---|---|
changelogs[] |
The list of changelogs. |
next_page_token |
A token that can be sent as |
ListConversationsRequest
Request message for AgentService.ListConversations.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list conversations from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the conversations. See https://google.aip.dev/160 for more details. |
source |
Optional. Indicate the source of the conversation. If not set, Source.Live will be applied by default. Will be deprecated in favor of |
sources[] |
Optional. Indicate the sources of the conversations. If not set, all available sources will be applied by default. |
ListConversationsResponse
Response message for AgentService.ListConversations.
| Fields | |
|---|---|
conversations[] |
The list of conversations. |
next_page_token |
A token that can be sent as |
ListDeploymentsRequest
Request message for AgentService.ListDeployments.
| Fields | |
|---|---|
parent |
Required. The parent app. Format: |
page_size |
Optional. The maximum number of deployments to return. The service may return fewer than this value. If unspecified, at most 50 deployments will be returned. The maximum value is 1000; values above 1000 will be coerced to 1000. |
page_token |
Optional. A page token, received from a previous When paginating, all other parameters provided to |
order_by |
Optional. Field to sort by. Only "name" and "create_time" is supported. See https://google.aip.dev/132#ordering for more details. |
ListDeploymentsResponse
Response message for AgentService.ListDeployments.
| Fields | |
|---|---|
deployments[] |
The list of deployments. |
next_page_token |
A token, which can be sent as |
ListEvaluationDatasetsRequest
Request message for EvaluationService.ListEvaluationDatasets.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list evaluation datasets from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the evaluation datasets. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time", and "update_time" are supported. Time fields are ordered in descending order, and the name field is ordered in ascending order. If not included, "update_time" will be the default. See https://google.aip.dev/132#ordering for more details. |
ListEvaluationDatasetsResponse
Response message for EvaluationService.ListEvaluationDatasets.
| Fields | |
|---|---|
evaluation_datasets[] |
The list of evaluation datasets. |
next_page_token |
A token that can be sent as |
ListEvaluationExpectationsRequest
Request message for EvaluationService.ListEvaluationExpectations.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list evaluation expectations from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the evaluation expectations. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time", and "update_time" are supported. Time fields are ordered in descending order, and the name field is ordered in ascending order. If not included, "update_time" will be the default. See https://google.aip.dev/132#ordering for more details. |
ListEvaluationExpectationsResponse
Response message for EvaluationService.ListEvaluationExpectations.
| Fields | |
|---|---|
evaluation_expectations[] |
The list of evaluation expectations. |
next_page_token |
A token that can be sent as |
ListEvaluationResultsRequest
Request message for EvaluationService.ListEvaluationResults.
| Fields | |
|---|---|
parent |
Required. The resource name of the evaluation to list evaluation results from. To filter by evaluation run, use |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the evaluation results. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time", and "update_time" are supported. Time fields are ordered in descending order, and the name field is ordered in ascending order. If not included, "update_time" will be the default. See https://google.aip.dev/132#ordering for more details. |
ListEvaluationResultsResponse
Response message for EvaluationService.ListEvaluationResults.
| Fields | |
|---|---|
evaluation_results[] |
The list of evaluation results. |
next_page_token |
A token that can be sent as |
ListEvaluationRunsRequest
Request message for EvaluationService.ListEvaluationRuns.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list evaluation runs from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the evaluation runs. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time", and "update_time" are supported. Time fields are ordered in descending order, and the name field is ordered in ascending order. If not included, "update_time" will be the default. See https://google.aip.dev/132#ordering for more details. |
ListEvaluationRunsResponse
Response message for EvaluationService.ListEvaluationRuns.
| Fields | |
|---|---|
evaluation_runs[] |
The list of evaluation runs. |
next_page_token |
A token that can be sent as |
ListEvaluationsRequest
Request message for EvaluationService.ListEvaluations.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list evaluations from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Deprecated: Use evaluation_filter and evaluation_run_filter instead. |
evaluation_filter |
Optional. Filter to be applied on the evaluation when listing the evaluations. See https://google.aip.dev/160 for more details. Supported fields: evaluation_datasets |
evaluation_run_filter |
Optional. Filter string for fields on the associated EvaluationRun resources. See https://google.aip.dev/160 for more details. Supported fields: create_time, initiated_by, app_version_display_name |
order_by |
Optional. Field to sort by. Only "name" and "create_time", and "update_time" are supported. Time fields are ordered in descending order, and the name field is ordered in ascending order. If not included, "update_time" will be the default. See https://google.aip.dev/132#ordering for more details. |
last_ten_results |
Optional. Whether to include the last 10 evaluation results for each evaluation in the response. |
ListEvaluationsResponse
Response message for EvaluationService.ListEvaluations.
| Fields | |
|---|---|
evaluations[] |
The list of evaluations. |
next_page_token |
A token that can be sent as |
ListExamplesRequest
Request message for AgentService.ListExamples.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list examples from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the examples. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time" is supported. See https://google.aip.dev/132#ordering for more details. |
ListExamplesResponse
Response message for AgentService.ListExamples.
| Fields | |
|---|---|
examples[] |
The list of examples. |
next_page_token |
A token that can be sent as |
ListGuardrailsRequest
Request message for AgentService.ListGuardrails.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list guardrails from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the guardrails. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time" is supported. See https://google.aip.dev/132#ordering for more details. |
ListGuardrailsResponse
Response message for AgentService.ListGuardrails.
| Fields | |
|---|---|
guardrails[] |
The list of guardrails. |
next_page_token |
A token that can be sent as |
ListScheduledEvaluationRunsRequest
Request message for EvaluationService.ListScheduledEvaluationRuns.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list scheduled evaluation runs from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the scheduled evaluation runs. See https://google.aip.dev/160 for more details. Currently supports filtering by: * request.evaluations:evaluation_id * request.evaluation_dataset:evaluation_dataset_id |
order_by |
Optional. Field to sort by. Supported fields are: "name" (ascending), "create_time" (descending), "update_time" (descending), "next_scheduled_execution" (ascending), and "last_completed_run.create_time" (descending). If not included, "update_time" will be the default. See https://google.aip.dev/132#ordering for more details. |
ListScheduledEvaluationRunsResponse
Response message for EvaluationService.ListScheduledEvaluationRuns.
| Fields | |
|---|---|
scheduled_evaluation_runs[] |
The list of scheduled evaluation runs. |
next_page_token |
A token that can be sent as |
ListToolsRequest
Request message for AgentService.ListTools.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list tools from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the tools. Use "include_system_tools=true" to include system tools in the response. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time" is supported. See https://google.aip.dev/132#ordering for more details. |
ListToolsResponse
Response message for AgentService.ListTools.
| Fields | |
|---|---|
tools[] |
The list of tools. |
next_page_token |
A token that can be sent as |
ListToolsetsRequest
Request message for AgentService.ListToolsets.
| Fields | |
|---|---|
parent |
Required. The resource name of the app to list toolsets from. |
page_size |
Optional. Requested page size. Server may return fewer items than requested. If unspecified, server will pick an appropriate default. |
page_token |
Optional. The |
filter |
Optional. Filter to be applied when listing the toolsets. See https://google.aip.dev/160 for more details. |
order_by |
Optional. Field to sort by. Only "name" and "create_time" is supported. See https://google.aip.dev/132#ordering for more details. |
ListToolsetsResponse
Response message for AgentService.ListToolsets.
| Fields | |
|---|---|
toolsets[] |
The list of toolsets. |
next_page_token |
A token that can be sent as |
LoggingSettings
Settings to describe the logging behaviors for the app.
| Fields | |
|---|---|
redaction_config |
Optional. Configuration for how sensitive data should be redacted. |
audio_recording_config |
Optional. Configuration for how audio interactions should be recorded. |
bigquery_export_settings |
Optional. Settings to describe the BigQuery export behaviors for the app. The conversation data will be exported to BigQuery tables if it is enabled. |
cloud_logging_settings |
Optional. Settings to describe the Cloud Logging behaviors for the app. |
conversation_logging_settings |
Optional. Settings to describe the conversation logging behaviors for the app. |
evaluation_audio_recording_config |
Optional. Configuration for how audio interactions should be recorded for the evaluation. By default, audio recording is not enabled for evaluation sessions. |
metric_analysis_settings |
Optional. Settings to describe the conversation data collection behaviors for the LLM analysis pipeline for the app. |
McpTool
An MCP tool. See https://modelcontextprotocol.io/specification/2025-06-18/server/tools for more details.
| Fields | |
|---|---|
name |
Required. The name of the MCP tool. |
description |
Optional. The description of the MCP tool. |
input_schema |
Optional. The schema of the input arguments of the MCP tool. |
output_schema |
Optional. The schema of the output arguments of the MCP tool. |
server_address |
Required. The server address of the MCP server, e.g., "https://example.com/mcp/". If the server is built with the MCP SDK, the url should be suffixed with "/mcp/". Only Streamable HTTP transport based servers are supported. This is the same as the server_address in the McpToolset. See https://modelcontextprotocol.io/specification/2025-03-26/basic/transports#streamable-http for more details. |
api_authentication |
Optional. Authentication information required to execute the tool against the MCP server. For bearer token authentication, the token applies only to tool execution, not to listing tools. This requires that tools can be listed without authentication. |
tls_config |
Optional. The TLS configuration. Includes the custom server certificates that the client should trust. |
service_directory_config |
Optional. Service Directory configuration for VPC-SC, used to resolve service names within a perimeter. |
custom_headers |
Optional. The custom headers to send in the request to the MCP server. The values must be in the format |
McpToolset
A toolset that contains a list of tools that are offered by the MCP server.
| Fields | |
|---|---|
server_address |
Required. The address of the MCP server, for example, "https://example.com/mcp/". If the server is built with the MCP SDK, the url should be suffixed with "/mcp/". Only Streamable HTTP transport based servers are supported. See https://modelcontextprotocol.io/specification/2025-03-26/basic/transports#streamable-http for more details. |
api_authentication |
Optional. Authentication information required to access tools and execute a tool against the MCP server. For bearer token authentication, the token applies only to tool execution, not to listing tools. This requires that tools can be listed without authentication. |
service_directory_config |
Optional. Service Directory configuration for VPC-SC, used to resolve service names within a perimeter. |
tls_config |
Optional. The TLS configuration. Includes the custom server certificates that the client should trust. |
custom_headers |
Optional. The custom headers to send in the request to the MCP server. The values must be in the format |
Message
A message within a conversation.
| Fields | |
|---|---|
role |
Optional. The role within the conversation, e.g., user, agent. |
chunks[] |
Optional. Content of the message as a series of chunks. |
event_time |
Optional. Timestamp when the message was sent or received. Should not be used if the message is part of an |
MetricAnalysisSettings
Settings to describe the conversation data collection behaviors for LLM analysis metrics pipeline.
| Fields | |
|---|---|
llm_metrics_opted_out |
Optional. Whether to collect conversation data for llm analysis metrics. If true, conversation data will not be collected for llm analysis metrics; otherwise, conversation data will be collected. |
MockConfig
Mock tool calls configuration for the session.
| Fields | |
|---|---|
mocked_tool_calls[] |
Optional. All tool calls to mock for the duration of the session. |
unmatched_tool_call_behavior |
Required. Beavhior for tool calls that don't match any args patterns in mocked_tool_calls. |
UnmatchedToolCallBehavior
What to do when a tool call doesn't match any mocked tool calls.
| Enums | |
|---|---|
UNMATCHED_TOOL_CALL_BEHAVIOR_UNSPECIFIED |
Default value. This value is unused. |
FAIL |
Throw an error for any tool calls that don't match a mock expected input pattern. |
PASS_THROUGH |
For unmatched tool calls, pass the tool call through to real tool. |
MockedToolCall
A mocked tool call.
Expresses the target tool + a pattern to match against that tool's args / inputs. If the pattern matches, then the mock response will be returned.
| Fields | |
|---|---|
tool |
Required. Deprecated. Use tool_identifier instead. |
expected_args_pattern |
Required. A pattern to match against the args / inputs of all dispatched tool calls. If the tool call inputs match this pattern, then mock output will be returned. |
mock_response |
Optional. The mock response / output to return if the tool call args / inputs match the pattern. |
Union field tool_identifier. The identifier of the tool to mock. tool_identifier can be only one of the following: |
|
tool_id |
Optional. The name of the tool to mock. Format: |
toolset |
Optional. The toolset to mock. |
ModelSettings
Model settings contains various configurations for the LLM model.
| Fields | |
|---|---|
model |
Optional. The LLM model that the agent should use. If not set, the agent will inherit the model from its parent agent. |
temperature |
Optional. If set, this temperature will be used for the LLM model. Temperature controls the randomness of the model's responses. Lower temperatures produce responses that are more predictable. Higher temperatures produce responses that are more creative. |
OAuthConfig
Configurations for authentication with OAuth.
| Fields | |
|---|---|
oauth_grant_type |
Required. OAuth grant types. |
client_id |
Required. The client ID from the OAuth provider. |
client_secret_version |
Required. The name of the SecretManager secret version resource storing the client secret. Format: Note: You should grant |
token_endpoint |
Required. The token endpoint in the OAuth provider to exchange for an access token. |
scopes[] |
Optional. The OAuth scopes to grant. |
OauthGrantType
OAuth grant types. Only client credential grant is supported.
| Enums | |
|---|---|
OAUTH_GRANT_TYPE_UNSPECIFIED |
Unspecified. Defaults to CLIENT_CREDENTIAL. |
CLIENT_CREDENTIAL |
Represents the client credential flow. |
Omnichannel
Represents an Omnichannel resource.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the omnichannel resource. Format: |
display_name |
Required. Display name of the omnichannel resource. |
description |
Optional. Human-readable description of the omnichannel resource. |
create_time |
Output only. Timestamp when the omnichannel resource was created. |
update_time |
Output only. Timestamp when the omnichannel resource was last updated. |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. |
integration_config |
Optional. The integration config for the omnichannel resource. |
OmnichannelIntegrationConfig
OmnichannelIntegrationConfig contains all App integration configs.
| Fields | |
|---|---|
channel_configs |
Optional. Various of configuration for handling App events. |
subscriber_configs |
Optional. Various of subscribers configs. |
routing_configs |
Optional. The key of routing_configs is a key of |
CesAppConfig
Configs for CES app.
| Fields | |
|---|---|
app |
The unique identifier of the CES app. Format: |
ChannelConfig
ChannelConfig contains config for various of app integration.
| Fields | |
|---|---|
Union field channel_config. The config for the app. channel_config can be only one of the following: |
|
whatsapp_config |
WhatsApp config. |
RoutingConfig
Routing config specify how/who to route app events to a subscriber.
| Fields | |
|---|---|
subscriber_key |
The key of the subscriber. |
SubscriberConfig
Configs of subscribers.
| Fields | |
|---|---|
Union field subscriber_config. The config for the subscriber. subscriber_config can be only one of the following: |
|
ces_app_config |
Ces app config. |
WhatsappConfig
How Omnichannel should receive/reply events from WhatsApp.
| Fields | |
|---|---|
phone_number_id |
The Phone Number ID associated with the WhatsApp Business Account. |
phone_number |
The phone number used for sending/receiving messages. |
whatsapp_business_account_id |
The customer's WhatsApp Business Account (WABA) ID. |
webhook_verify_token |
The verify token configured in the Meta App Dashboard for webhook verification. |
whatsapp_business_token |
The access token for authenticating API calls to the WhatsApp Cloud API. https://developers.facebook.com/docs/whatsapp/business-management-api/get-started/#business-integration-system-user-access-tokens |
meta_business_portfolio_id |
The Meta Business Portfolio (MBP) ID. https://www.facebook.com/business/help/1710077379203657 |
OmnichannelOperationMetadata
Represents the metadata of the long-running operation.
| Fields | |
|---|---|
create_time |
Output only. The time the operation was created. |
end_time |
Output only. The time the operation finished running. |
status_message |
Output only. Human-readable status of the operation, if any. |
requested_cancellation |
Output only. Identifies whether the user has requested cancellation of the operation. |
OpenApiTool
A remote API tool defined by an OpenAPI schema.
| Fields | |
|---|---|
open_api_schema |
Required. The OpenAPI schema in JSON or YAML format. |
name |
Optional. The name of the tool. If not provided, the name of the tool will be derived from the OpenAPI schema, from |
description |
Optional. The description of the tool. If not provided, the description of the tool will be derived from the OpenAPI schema, from |
api_authentication |
Optional. Authentication information required by the API. |
tls_config |
Optional. The TLS configuration. Includes the custom server certificates that the client will trust. |
service_directory_config |
Optional. Service Directory configuration. |
ignore_unknown_fields |
Optional. If true, the agent will ignore unknown fields in the API response. |
url |
Optional. The server URL of the Open API schema. This field is only set in tools in the environment dependencies during the export process if the schema contains a server url. During the import process, if this url is present in the environment dependencies and the schema has the $env_var placeholder, it will replace the placeholder in the schema. |
OpenApiToolset
A toolset that contains a list of tools that are defined by an OpenAPI schema.
| Fields | |
|---|---|
open_api_schema |
Required. The OpenAPI schema of the toolset. |
api_authentication |
Optional. Authentication information required by the API. |
tls_config |
Optional. The TLS configuration. Includes the custom server certificates |
service_directory_config |
Optional. Service Directory configuration. |
ignore_unknown_fields |
Optional. If true, the agent will ignore unknown fields in the API response for all operations defined in the OpenAPI schema. |
url |
Optional. The server URL of the Open API schema. This field is only set in toolsets in the environment dependencies during the export process if the schema contains a server url. During the import process, if this url is present in the environment dependencies and the schema has the $env_var placeholder, it will replace the placeholder in the schema. |
OperationMetadata
Represents the metadata of the long-running operation.
| Fields | |
|---|---|
create_time |
Output only. The time the operation was created. |
end_time |
Output only. The time the operation finished running. |
status_message |
Output only. Human-readable status of the operation, if any. |
requested_cancellation |
Output only. Identifies whether the user has requested cancellation of the operation. Operations that have been cancelled successfully have |
OptimizationConfig
Configuration for running the optimization step after the evaluation run.
| Fields | |
|---|---|
generate_loss_report |
Optional. Whether to generate a loss report. |
assistant_session |
Output only. The assistant session to use for the optimization based on this evaluation run. Format: |
report_summary |
Output only. The summary of the loss report. |
should_suggest_fix |
Output only. Whether to suggest a fix for the losses. |
status |
Output only. The status of the optimization run. |
error_message |
Output only. The error message if the optimization run failed. |
loss_report |
Output only. The generated loss report. |
OptimizationStatus
The status of the optimization run.
| Enums | |
|---|---|
OPTIMIZATION_STATUS_UNSPECIFIED |
Optimization status is not specified. |
RUNNING |
Optimization is running. |
COMPLETED |
Optimization has completed. |
ERROR |
Optimization failed due to an internal error. |
OutputAudioConfig
OutputAudioConfig configures how the CES agent should synthesize outgoing audio responses.
| Fields | |
|---|---|
audio_encoding |
Required. The encoding of the output audio data. |
sample_rate_hertz |
Required. The sample rate (in Hertz) of the output audio data. |
PersonaRunConfig
Configuration for running an evaluation for a specific persona.
| Fields | |
|---|---|
persona |
Optional. The persona to use for the evaluation. Format: |
task_count |
Optional. The number of tasks to run for the persona. |
PythonCodeCondition
Python code block to evaluate the condition.
| Fields | |
|---|---|
python_code |
Required. The python code to execute. |
PythonFunction
A Python function tool.
| Fields | |
|---|---|
name |
Optional. The name of the Python function to execute. Must match a Python function name defined in the python code. Case sensitive. If the name is not provided, the first function defined in the python code will be used. |
python_code |
Optional. The Python code to execute for the tool. |
description |
Output only. The description of the Python function, parsed from the python code's docstring. |
QualityReport
The report describing any identified quality issues in the app.
| Fields | |
|---|---|
issues[] |
Optional. The issues grouped by agent. |
evaluation_runs[] |
Optional. A list of evaluation runs used to generate the quality report. Format: |
general_issues[] |
Optional. General issues not specific to any agent. |
AgentIssues
Issues identified for a single agent.
| Fields | |
|---|---|
agent |
Optional. The name of the agent to which the issues are related. Format: |
issues[] |
Optional. List of issues found for this agent. |
Issue
The issue identified.
| Fields | |
|---|---|
description |
Optional. Description of the issue found. |
occurrence_count |
Optional. How many times this issue occurred. |
proposed_solution |
Optional. Proposed solution to fix the issue by modifying instructions or tools. |
RecognitionResult
Speech recognition result for the audio input.
| Fields | |
|---|---|
transcript |
Optional. Concatenated user speech segments captured during the current turn. |
RedactionConfig
Configuration to instruct how sensitive data should be handled.
| Fields | |
|---|---|
enable_redaction |
Optional. If true, redaction will be applied in various logging scenarios, including conversation history, Cloud Logging and audio recording. |
inspect_template |
Optional. DLP inspect template name to configure detection of sensitive data types. Format: |
deidentify_template |
Optional. DLP deidentify template name to instruct on how to de-identify content. Format: |
RestoreAppVersionRequest
Request message for AgentService.RestoreAppVersion
| Fields | |
|---|---|
name |
Required. The resource name of the app version to restore. |
RestoreAppVersionResponse
This type has no fields.
Response message for AgentService.RestoreAppVersion
RetrieveToolSchemaRequest
Request message for ToolService.RetrieveToolSchema.
| Fields | |
|---|---|
parent |
Required. The resource name of the app which the tool/toolset belongs to. Format: |
Union field tool_identifier. The identifier of the tool to retrieve the schema for. It could be either a persisted tool or a tool from a toolset. tool_identifier can be only one of the following: |
|
tool |
Optional. The name of the tool to retrieve the schema for. Format: projects/{project}/locations/{location}/apps/{app}/tools/{tool} |
toolset_tool |
Optional. The toolset tool to retrieve the schema for. Only one tool should match the predicate from the toolset. Otherwise, an error will be returned. |
RetrieveToolSchemaResponse
Response message for ToolService.RetrieveToolSchema.
| Fields | |
|---|---|
input_schema |
The schema of the tool input parameters. |
output_schema |
The schema of the tool output parameters. |
Union field tool_identifier. The identifier of the tool that the schema is for. tool_identifier can be only one of the following: |
|
tool |
The name of the tool that the schema is for. Format: |
toolset_tool |
The toolset tool that the schema is for. |
RetrieveToolsRequest
Request message for ToolService.RetrieveTools.
| Fields | |
|---|---|
toolset |
Required. The name of the toolset to retrieve the tools for. Format: |
tool_ids[] |
Optional. The identifiers of the tools to retrieve from the toolset. If empty, all tools in the toolset will be returned. |
RetrieveToolsResponse
Response message for ToolService.RetrieveTools.
| Fields | |
|---|---|
tools[] |
The list of tools that are included in the specified toolset. |
RunEvaluationOperationMetadata
Operation metadata for EvaluationService.RunEvaluation.
| Fields | |
|---|---|
evaluations[] |
Output only. The list of evaluations that were run. Format: |
evaluation_run |
Output only. The evaluation run that was created. Format: |
create_time |
Output only. The time the operation was created. |
end_time |
Output only. The time the operation completed. |
verb |
Output only. The verb of the operation. |
cancel_requested |
Output only. Identifies whether the user has requested cancellation of the operation. Operations that have been cancelled successfully have |
RunEvaluationRequest
Request message for EvaluationService.RunEvaluation.
| Fields | |
|---|---|
app |
Required. The app to evaluate. Format: |
evaluations[] |
Optional. List of evaluations to run. Format: |
evaluation_dataset |
Optional. An evaluation dataset to run. Format: |
display_name |
Optional. The display name of the evaluation run. |
app_version |
Optional. The app version to evaluate. Format: |
config |
Optional. The configuration to use for the run. |
persona_run_configs[] |
Optional. The configuration to use for the run per persona. |
optimization_config |
Optional. Configuration for running the optimization step after the evaluation run. If not set, the optimization step will not be run. |
scheduled_evaluation_run |
Optional. The resource name of the If this field is set, the |
golden_run_method |
Optional. The method to run the evaluation if it is a golden evaluation. If not set, default to STABLE. |
generate_latency_report |
Optional. Whether to generate a latency report for the evaluation run. |
run_count |
Optional. The number of times to run the evaluation. If not set, the default value is 1 per golden, and 5 per scenario. |
RunEvaluationResponse
Response message for EvaluationService.RunEvaluation.
| Fields | |
|---|---|
evaluation_run |
The name of the evaluation run that was created. Format: |
RunSessionRequest
Request message for SessionService.RunSession.
| Fields | |
|---|---|
config |
Required. The configuration for the session. |
inputs[] |
Required. Inputs for the session. |
RunSessionResponse
Response message for SessionService.RunSession.
| Fields | |
|---|---|
outputs[] |
Outputs for the session. |
ScheduledEvaluationRun
Represents a scheduled evaluation run configuration.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the scheduled evaluation run config. Format: projects/{projectId}/locations/{locationId}/apps/{appId}/scheduledEvaluationRuns/{scheduledEvaluationRunId} |
display_name |
Required. User-defined display name of the scheduled evaluation run config. |
request |
Required. The RunEvaluationRequest to schedule |
description |
Optional. User-defined description of the scheduled evaluation run. |
scheduling_config |
Required. Configuration for the timing and frequency with which to execute the evaluations. |
active |
Optional. Whether this config is active |
last_completed_run |
Output only. The last successful EvaluationRun of this scheduled execution. Format: |
total_executions |
Output only. The total number of times this run has been executed |
next_scheduled_execution_time |
Output only. The next time this is scheduled to execute |
create_time |
Output only. Timestamp when the scheduled evaluation run was created. |
created_by |
Output only. The user who created the scheduled evaluation run. |
update_time |
Output only. Timestamp when the evaluation was last updated. |
last_updated_by |
Output only. The user who last updated the evaluation. |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
SchedulingConfig
Eval scheduling configuration details
| Fields | |
|---|---|
frequency |
Required. The frequency with which to run the eval |
start_time |
Required. Timestamp when the eval should start. |
days_of_week[] |
Optional. The days of the week to run the eval. Applicable only for Weekly and Biweekly frequencies. 1 is Monday, 2 is Tuesday, ..., 7 is Sunday. |
Frequency
The frequencies evals can be run at
| Enums | |
|---|---|
FREQUENCY_UNSPECIFIED |
The frequency is unspecified. |
NONE |
Indicates a one-time scheduled run that should not repeat |
DAILY |
Run the evaluation daily. |
WEEKLY |
Run the evaluation weekly. |
BIWEEKLY |
Run the evaluation biweekly. |
Schema
Represents a select subset of an OpenAPI 3.0 schema object.
| Fields | |
|---|---|
type |
Required. The type of the data. |
properties |
Optional. Properties of Type.OBJECT. |
required[] |
Optional. Required properties of Type.OBJECT. |
description |
Optional. The description of the data. |
items |
Optional. Schema of the elements of Type.ARRAY. |
nullable |
Optional. Indicates if the value may be null. |
unique_items |
Optional. Indicate the items in the array must be unique. Only applies to TYPE.ARRAY. |
prefix_items[] |
Optional. Schemas of initial elements of Type.ARRAY. |
additional_properties |
Optional. Can either be a boolean or an object, controls the presence of additional properties. |
any_of[] |
Optional. The value should be validated against any (one or more) of the subschemas in the list. |
enum[] |
Optional. Possible values of the element of primitive type with enum format. Examples: 1. We can define direction as : {type:STRING, format:enum, enum:["EAST", NORTH", "SOUTH", "WEST"]} 2. We can define apartment number as : {type:INTEGER, format:enum, enum:["101", "201", "301"]} |
default |
Optional. Default value of the data. |
ref |
Optional. Allows indirect references between schema nodes. The value should be a valid reference to a child of the root For example, the following schema defines a reference to a schema node named "Pet": The value of the "pet" property is a reference to the schema node named "Pet". See details in https://json-schema.org/understanding-json-schema/structuring. |
defs |
Optional. A map of definitions for use by |
title |
Optional. The title of the schema. |
min_items |
Optional. Minimum number of the elements for Type.ARRAY. |
max_items |
Optional. Maximum number of the elements for Type.ARRAY. |
minimum |
Optional. Minimum value for Type.INTEGER and Type.NUMBER. |
maximum |
Optional. Maximum value for Type.INTEGER and Type.NUMBER. |
Type
OpenAPI data types.
| Enums | |
|---|---|
TYPE_UNSPECIFIED |
Type unspecified. |
STRING |
String type. |
INTEGER |
Integer type. |
NUMBER |
Number type. |
BOOLEAN |
Boolean type. |
OBJECT |
Object type. |
ARRAY |
Array type. |
SecuritySettings
Project/Location level security settings for CES.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the security settings. Format: |
endpoint_control_policy |
Optional. Endpoint control related settings. |
create_time |
Output only. Create time of the security settings. |
update_time |
Output only. Last update time of the security settings. |
etag |
Output only. Etag of the security settings. |
ServiceAccountAuthConfig
Configurations for authentication using a custom service account.
| Fields | |
|---|---|
service_account |
Required. The email address of the service account used for authentication. CES uses this service account to exchange an access token and the access token is then sent in the The service account must have the |
scopes[] |
Optional. The OAuth scopes to grant. If not specified, the default scope |
ServiceAgentIdTokenAuthConfig
This type has no fields.
Configurations for authentication with ID token generated from service agent.
ServiceDirectoryConfig
Configuration for tools using Service Directory.
| Fields | |
|---|---|
service |
Required. The name of Service Directory service. Format: |
SessionConfig
The configuration for the session.
| Fields | |
|---|---|
session |
Required. The unique identifier of the session. Format: |
input_audio_config |
Optional. Configuration for processing the input audio. |
output_audio_config |
Optional. Configuration for generating the output audio. |
historical_contexts[] |
Optional. The historical context of the session, including user inputs, agent responses, and other messages. Typically, CES agent would manage session automatically so client doesn't need to explicitly populate this field. However, client can optionally override the historical contexts to force the session start from certain state. |
entry_agent |
Optional. The entry agent to handle the session. If not specified, the session will be handled by the |
deployment |
Optional. The deployment of the app to use for the session. Format: |
time_zone |
Optional. The time zone of the user. If provided, the agent will use the time zone for date and time related variables. Otherwise, the agent will use the time zone specified in the App.time_zone_settings. The format is the IANA Time Zone Database time zone, e.g. "America/Los_Angeles". |
use_tool_fakes |
Optional. Whether to use tool fakes for the session. If this field is set, the agent will attempt use tool fakes instead of calling the real tools. |
remote_dialogflow_query_parameters |
Optional. QueryParameters to send to the remote Dialogflow agent when the session control is transferred to the remote agent. |
enable_text_streaming |
Optional. Whether to enable streaming text outputs from the model. By default, text outputs from the model are collected before sending to the client. NOTE: This is only supported for text (non-voice) sessions via |
RemoteDialogflowQueryParameters
QueryParameters to send to the remote Dialogflow agent when the session control is transferred to the remote agent.
| Fields | |
|---|---|
webhook_headers |
Optional. The HTTP headers to be sent as webhook_headers in QueryParameters. |
payload |
Optional. The payload to be sent in QueryParameters. |
end_user_metadata |
Optional. The end user metadata to be sent in QueryParameters. |
SessionInput
Input for the session.
| Fields | |
|---|---|
will_continue |
Optional. A flag to indicate if the current message is a fragment of a larger input in the bidi streaming session. When set to NOTE: This field does not apply to audio and DTMF inputs, as they are always processed automatically based on the endpointing signal. |
Union field input_type. The type of the input. input_type can be only one of the following: |
|
text |
Optional. Text data from the end user. |
dtmf |
Optional. DTMF digits from the end user. |
audio |
Optional. Audio data from the end user. |
tool_responses |
Optional. Execution results for the tool calls from the client. |
image |
Optional. Image data from the end user. |
blob |
Optional. Blob data from the end user. |
variables |
Optional. Contextual variables for the session, keyed by name. Only variables declared in the app will be used by the CES agent. Unrecognized variables will still be sent to the [Dialogflow agent][Agent.RemoteDialogflowAgent] as additional session parameters. |
event |
Optional. Event input. |
SessionOutput
Output for the session.
| Fields | |
|---|---|
turn_index |
Indicates the sequential order of conversation turn to which this output belongs to, starting from 1. |
turn_completed |
If true, the CES agent has detected the end of the current conversation turn and will provide no further output for this turn. |
diagnostic_info |
Optional. Diagnostic information contains execution details during the processing of the input. Only populated in the last SessionOutput (with |
Union field output_type. The type of the output. output_type can be only one of the following: |
|
text |
Output text from the CES agent. |
audio |
Output audio from the CES agent. |
tool_calls |
Request for the client to execute the tools. |
citations |
Citations that provide the source information for the agent's generated text. |
google_search_suggestions |
The suggestions returned from Google Search as a result of invoking the |
end_session |
Indicates the session has ended. |
payload |
Custom payload with structured output from the CES agent. |
DiagnosticInfo
Contains execution details during the processing.
| Fields | |
|---|---|
messages[] |
List of the messages that happened during the processing. |
root_span |
A trace of the entire request processing, represented as a root span. This span can contain nested child spans for specific operations. |
Span
A span is a unit of work or a single operation during the request processing.
| Fields | |
|---|---|
name |
Output only. The name of the span. |
start_time |
Output only. The start time of the span. |
end_time |
Output only. The end time of the span. |
duration |
Output only. The duration of the span. |
attributes |
Output only. Key-value attributes associated with the span. |
child_spans[] |
Output only. The child spans that are nested under this span. |
SynthesizeSpeechConfig
Configuration for how the agent response should be synthesized.
| Fields | |
|---|---|
voice |
Optional. The name of the voice. If not set, the service will choose a voice based on the other parameters such as language_code. For the list of available voices, please refer to Supported voices and languages from Cloud Text-to-Speech. |
speaking_rate |
Optional. The speaking rate/speed in the range [0.25, 2.0]. 1.0 is the normal native speed supported by the specific voice. 2.0 is twice as fast, and 0.5 is half as fast. Values outside of the range [0.25, 2.0] will return an error. |
SystemTool
Pre-defined system tool.
| Fields | |
|---|---|
name |
Required. The name of the system tool. |
description |
Output only. The description of the system tool. |
TestPersonaVoiceRequest
Request message for EvaluationService.TestPersonaVoice.
| Fields | |
|---|---|
app |
Required. the resource name of the app to test the persona voice for. Format: |
persona_id |
Required. The persona ID to test the voice for. Also accepts "default". |
text |
Required. The text to test the voice for. |
TestPersonaVoiceResponse
Response message for EvaluationService.TestPersonaVoice.
| Fields | |
|---|---|
audio |
The audio data bytes of the synthesized voice. |
TimeZoneSettings
TimeZone settings of the app.
| Fields | |
|---|---|
time_zone |
Optional. The time zone of the app from the time zone database, e.g., America/Los_Angeles, Europe/Paris. |
TlsConfig
The TLS configuration.
| Fields | |
|---|---|
ca_certs[] |
Required. Specifies a list of allowed custom CA certificates for HTTPS verification. |
CaCert
The CA certificate.
| Fields | |
|---|---|
display_name |
Required. The name of the allowed custom CA certificates. This can be used to disambiguate the custom CA certificates. |
cert |
Required. The allowed custom CA certificates (in DER format) for HTTPS verification. This overrides the default SSL trust store. If this is empty or unspecified, CES will use Google's default trust store to verify certificates. N.B. Make sure the HTTPS server certificates are signed with "subject alt name". For instance a certificate can be self-signed using the following command: |
Tool
A tool represents an action that the CES agent can take to achieve certain goals.
| Fields | |
|---|---|
name |
Identifier. The resource name of the tool. Format:
These tools are dynamic and output-only; they cannot be referenced directly where a tool is expected. |
display_name |
Output only. The display name of the tool, derived based on the tool's type. For example, display name of a [ClientFunction][Tool.ClientFunction] is derived from its |
execution_type |
Optional. The execution type of the tool. |
create_time |
Output only. Timestamp when the tool was created. |
update_time |
Output only. Timestamp when the tool was last updated. |
etag |
Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
generated_summary |
Output only. If the tool is generated by the LLM assistant, this field contains a descriptive summary of the generation. |
tool_fake_config |
Optional. Configuration for tool behavior in fake mode. |
Union field tool_type. The type of the tool. tool_type can be only one of the following: |
|
client_function |
Optional. The client function. |
open_api_tool |
Optional. The open API tool. |
google_search_tool |
Optional. The google search tool. |
connector_tool |
Optional. The Integration Connector tool. |
data_store_tool |
Optional. The data store tool. |
python_function |
Optional. The python function tool. |
mcp_tool |
Optional. The MCP tool. An MCP tool cannot be created or updated directly and is managed by the MCP toolset. |
file_search_tool |
Optional. The file search tool. |
system_tool |
Optional. The system tool. |
agent_tool |
Optional. The agent tool. |
widget_tool |
Optional. The widget tool. |
ToolCall
Request for the client or the agent to execute the specified tool.
| Fields | |
|---|---|
id |
Optional. The unique identifier of the tool call. If populated, the client should return the execution result with the matching ID in |
display_name |
Output only. Display name of the tool. |
args |
Optional. The input parameters and values for the tool in JSON object format. |
Union field tool_identifier. The identifier of the tool to execute. It could be either a persisted tool or a tool from a toolset. tool_identifier can be only one of the following: |
|
tool |
Optional. The name of the tool to execute. Format: |
toolset_tool |
Optional. The toolset tool to execute. |
ToolCalls
Request for the client to execute the tools and return the execution results before continuing the session.
| Fields | |
|---|---|
tool_calls[] |
Optional. The list of tool calls to execute. |
ToolFakeConfig
Configuration for tool behavior in fake mode.
| Fields | |
|---|---|
enable_fake_mode |
Optional. Whether the tool is using fake mode. |
Union field tool_response. The response is either static or it is provided by a python function. tool_response can be only one of the following: |
|
code_block |
Optional. Code block which will be executed instead of a real tool call. |
ToolResponse
The execution result of a specific tool from the client or the agent.
| Fields | |
|---|---|
id |
Optional. The matching ID of the |
display_name |
Output only. Display name of the tool. |
response |
Required. The tool execution result in JSON object format. Use "output" key to specify tool response and "error" key to specify error details (if any). If "output" and "error" keys are not specified, then whole "response" is treated as tool execution result. |
Union field tool_identifier. The identifier of the tool that got executed. It could be either a persisted tool or a tool from a toolset. tool_identifier can be only one of the following: |
|
tool |
Optional. The name of the tool to execute. Format: |
toolset_tool |
Optional. The toolset tool that got executed. |
ToolResponses
Execution results for the requested tool calls from the client.
| Fields | |
|---|---|
tool_responses[] |
Optional. The list of tool execution results. |
Toolset
A toolset represents a group of dynamically managed tools that can be used by the agent.
| Fields | |
|---|---|
name |
Identifier. The unique identifier of the toolset. Format: |
display_name |
Optional. The display name of the toolset. Must be unique within the same app. |
description |
Optional. The description of the toolset. |
create_time |
Output only. Timestamp when the toolset was created. |
update_time |
Output only. Timestamp when the toolset was last updated. |
etag |
ETag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
execution_type |
Optional. The execution type of the tools in the toolset. |
tool_fake_config |
Optional. Configuration for tools behavior in fake mode. |
Union field toolset_type. The type of the toolset. toolset_type can be only one of the following: |
|
mcp_toolset |
Optional. A toolset that contains a list of tools that are offered by the MCP server. |
open_api_toolset |
Optional. A toolset that contains a list of tools that are defined by an OpenAPI schema. |
connector_toolset |
Optional. A toolset that generates tools from an Integration Connectors Connection. |
ToolsetTool
A tool that is created from a toolset.
| Fields | |
|---|---|
toolset |
Required. The resource name of the Toolset from which this tool is derived. Format: |
tool_id |
Optional. The tool ID to filter the tools to retrieve the schema for. |
TransferRule
Rule for transferring to a specific agent.
| Fields | |
|---|---|
child_agent |
Required. The resource name of the child agent the rule applies to. Format: |
direction |
Required. The direction of the transfer. |
Union field rule_type. The rule type. rule_type can be only one of the following: |
|
deterministic_transfer |
Optional. A rule that immediately transfers to the target agent when the condition is met. |
disable_planner_transfer |
Optional. Rule that prevents the planner from transferring to the target agent. |
DeterministicTransfer
Deterministic transfer rule. When the condition evaluates to true, the transfer occurs.
| Fields | |
|---|---|
Union field condition_type. The condition to evaluate. condition_type can be only one of the following: |
|
expression_condition |
Optional. A rule that evaluates a session state condition. If the condition evaluates to true, the transfer occurs. |
python_code_condition |
Optional. A rule that uses Python code block to evaluate the conditions. If the condition evaluates to true, the transfer occurs. |
Direction
The direction of the transfer.
| Enums | |
|---|---|
DIRECTION_UNSPECIFIED |
Unspecified direction. |
PARENT_TO_CHILD |
Transfer from the parent agent to the child agent. |
CHILD_TO_PARENT |
Transfer from the child agent to the parent agent. |
DisablePlannerTransfer
A rule that prevents the planner from transferring to the target agent.
| Fields | |
|---|---|
expression_condition |
Required. If the condition evaluates to true, planner will not be allowed to transfer to the target agent. |
TriggerAction
Action that is taken when a certain precondition is met.
| Fields | |
|---|---|
Union field action. The action to take. action can be only one of the following: |
|
respond_immediately |
Optional. Immediately respond with a preconfigured response. |
transfer_agent |
Optional. Transfer the conversation to a different agent. |
generative_answer |
Optional. Respond with a generative answer. |
GenerativeAnswer
The agent will immediately respond with a generative answer.
| Fields | |
|---|---|
prompt |
Required. The prompt to use for the generative answer. |
RespondImmediately
The agent will immediately respond with a preconfigured response.
| Fields | |
|---|---|
responses[] |
Required. The canned responses for the agent to choose from. The response is chosen randomly. |
Response
Represents a response from the agent.
| Fields | |
|---|---|
text |
Required. Text for the agent to respond with. |
disabled |
Optional. Whether the response is disabled. Disabled responses are not used by the agent. |
TransferAgent
The agent will transfer the conversation to a different agent.
| Fields | |
|---|---|
agent |
Required. The name of the agent to transfer the conversation to. The agent must be in the same app as the current agent. Format: |
UpdateAgentRequest
Request message for AgentService.UpdateAgent.
| Fields | |
|---|---|
agent |
Required. The agent to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateAppRequest
Request message for AgentService.UpdateApp.
| Fields | |
|---|---|
app |
Required. The app to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateDeploymentRequest
Request message for AgentService.UpdateDeployment.
| Fields | |
|---|---|
deployment |
Required. The deployment to update. |
update_mask |
Optional. The list of fields to update. |
UpdateEvaluationDatasetRequest
Request message for EvaluationService.UpdateEvaluationDataset.
| Fields | |
|---|---|
evaluation_dataset |
Required. The evaluation dataset to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateEvaluationExpectationRequest
Request message for EvaluationService.UpdateEvaluationExpectation.
| Fields | |
|---|---|
evaluation_expectation |
Required. The evaluation expectation to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateEvaluationRequest
Request message for EvaluationService.UpdateEvaluation.
| Fields | |
|---|---|
evaluation |
Required. The evaluation to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateExampleRequest
Request message for AgentService.UpdateExample.
| Fields | |
|---|---|
example |
Required. The example to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateGuardrailRequest
Request message for AgentService.UpdateGuardrail.
| Fields | |
|---|---|
guardrail |
Required. The guardrail to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateScheduledEvaluationRunRequest
Request message for EvaluationService.UpdateScheduledEvaluationRun.
| Fields | |
|---|---|
scheduled_evaluation_run |
Required. The scheduled evaluation run to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateSecuritySettingsRequest
Request message for AgentService.UpdateSecuritySettings.
| Fields | |
|---|---|
security_settings |
Required. The security settings to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateToolRequest
Request message for AgentService.UpdateTool.
| Fields | |
|---|---|
tool |
Required. The tool to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UpdateToolsetRequest
Request message for AgentService.UpdateToolset.
| Fields | |
|---|---|
toolset |
Required. The toolset to update. |
update_mask |
Optional. Field mask is used to control which fields get updated. If the mask is not present, all fields will be updated. |
UploadEvaluationAudioRequest
Request message for EvaluationService.UploadEvaluationAudio.
| Fields | |
|---|---|
name |
Required. The resource name of the Evaluation for which to upload the evaluation audio. Format: |
audio_content |
Required. The raw audio bytes. The format of the audio must be single-channel LINEAR16 with a sample rate of 16kHz (default InputAudioConfig). |
previous_audio_gcs_uri |
Optional. The Google Cloud Storage URI of the previously uploaded audio file to be deleted. Format: |
UploadEvaluationAudioResponse
Response message for EvaluationService.UploadEvaluationAudio.
| Fields | |
|---|---|
audio_gcs_uri |
The Google Cloud Storage URI where the uploaded audio file is stored. Format: |
transcript |
The transcript of the audio, generated by Cloud Speech-to-Text. |
duration |
The duration of the audio. |
WebSearchQuery
Represents a single web search query and its associated search uri.
| Fields | |
|---|---|
query |
The search query text. |
uri |
The URI to the Google Search results page for the query. |
WidgetTool
Represents a widget tool that the agent can invoke. When the tool is chosen by the agent, agent will return the widget to the client. The client is responsible for processing the widget and generating the next user query to continue the interaction with the agent.
| Fields | |
|---|---|
name |
Required. The display name of the widget tool. |
description |
Optional. The description of the widget tool. |
widget_type |
Optional. The type of the widget tool. If not specified, the default type will be CUSTOMIZED. |
ui_config |
Optional. Configuration for rendering the widget. |
data_mapping |
Optional. The mapping that defines how data from a source tool is mapped to the widget's input parameters. |
Union field input. The input of the widget tool. input can be only one of the following: |
|
parameters |
Optional. The input parameters of the widget tool. |
DataMapping
Configuration for mapping data from a source tool to the widget's input parameters.
| Fields | |
|---|---|
source_tool_name |
Optional. The resource name of the tool that provides the data for the widget (e.g., a search tool or a custom function). Format: |
field_mappings |
Optional. A map of widget input parameter fields to the corresponding output fields of the source tool. |
python_function |
Optional. Configuration for a Python function used to transform the source tool's output into the widget's input format. |
mode |
Optional. The mode of the data mapping. |
python_script |
Deprecated: Use |
Mode
The strategy used to map data from the source tool to the widget.
| Enums | |
|---|---|
MODE_UNSPECIFIED |
Unspecified mode. |
FIELD_MAPPING |
Use the field_mappings map for data transformation. |
PYTHON_SCRIPT |
Use the python_script for data transformation. |
WidgetType
All available widget types. New values may be added to this enum in the future.
| Enums | |
|---|---|
WIDGET_TYPE_UNSPECIFIED |
Unspecified widget type. |
CUSTOM |
Custom widget type. |
PRODUCT_CAROUSEL |
Product carousel widget. |
PRODUCT_DETAILS |
Product details widget. |
QUICK_ACTIONS |
Quick actions widget. |
PRODUCT_COMPARISON |
Product comparison widget. |
ADVANCED_PRODUCT_DETAILS |
Advanced product details widget. |
SHORT_FORM |
Short form widget. |
OVERALL_SATISFACTION |
Overall satisfaction widget. |
ORDER_SUMMARY |
Order summary widget. |
APPOINTMENT_DETAILS |
Appointment details widget. |
APPOINTMENT_SCHEDULER |
Appointment scheduler widget. |
CONTACT_FORM |
Contact form widget. |