Skip to main content

AI Agent Metric Definition Document

Metric Category: llm-client Entity Category: System Service Covered Entity Models: Service / Service Instance


1. MCP Client Metrics

1.1 MCP Client Operation Duration

AttributeDescription
Metric ID (Service Instance)one.service.instance.mcp.client.operation.duration
Metric ID (Service)one.service.mcp.client.operation.duration
Metric NameMCP Client Operation Duration
Metric TypeHistogram
Display / Reporting Unitseconds (s)
Decimal Places2
Metric SourceOTEL Native Metric
Basic JudgmentLower is better
Anomaly TypeSlowness
Related EntitiesService, Service Instance, Host (Instance Level); Service (Service Level)

Description

The duration of the MCP request or notification observed by the sender, from the moment the message is sent until the response or acknowledgment is received.

Related Dimensions

Dimension FieldDescription
mcp.method.nameMCP method name
error.typeError type
gen_ai.prompt.namePrompt name
gen_ai.tool.nameTool name
rpc.response.status_codeRPC response status code
gen_ai.operation.nameOperation type
jsonrpc.protocol.versionJSON-RPC protocol version
mcp.protocol.versionMCP protocol version
network.protocol.nameNetwork protocol name
network.protocol.versionNetwork protocol version
network.transportTransport protocol
mcp.resource.uriMCP Resource URI

1.2 MCP Client Call Count

AttributeDescription
Metric ID (Service Instance)one.service.instance.mcp.client.call.count
Metric ID (Service)one.service.mcp.client.call.count
Metric NameMCP Client Call Count
Metric TypeSUM
Display / Reporting Unitcount
Decimal Places2
Metric SourceONE Platform Custom Metric
Basic JudgmentHigher is better
Anomaly TypeThroughput
Related EntitiesService, Service Instance, Host (Instance Level); Service (Service Level)

Description

The number of requests initiated by the MCP client.

Related Dimensions

Same as 1.1 MCP Client Operation Duration.


2. Generative AI Client Metrics

2.1 Generative AI Token Usage

AttributeDescription
Metric ID (Service Instance)one.service.instance.gen_ai.client.token.usage
Metric ID (Service)one.service.gen_ai.client.token.usage
Metric NameGenerative AI Token Usage
Metric TypeHistogram
Display / Reporting Unittoken
Decimal Places2
Metric SourceStandard Metric
Basic JudgmentNone
Anomaly TypeResource
Related EntitiesService, Service Instance, Host (Instance Level); Service (Service Level)

Description

Token consumption of AI tools.

Related Dimensions

Dimension FieldDescription
gen_ai.operation.nameOperation type, e.g. chat / embeddings
gen_ai.provider.nameAI provider, e.g. openai, anthropic
gen_ai.token.typeToken type (input / output)
gen_ai.request.modelRequest model name

2.2 Generative AI Client Operation Duration

AttributeDescription
Metric ID (Service Instance)one.service.instance.gen_ai.client.operation.duration
Metric ID (Service)one.service.gen_ai.client.operation.duration
Metric NameGenerative AI Client Operation Duration
Metric TypeHistogram
Display / Reporting Unitseconds (s)
Decimal Places2
Metric SourceOTEL Native Metric
Basic JudgmentLower is better
Anomaly TypeSlowness
Related EntitiesService, Service Instance, Host (Instance Level); Service (Service Level)

Description

The total request time from client initiation to server response completion.

Related Dimensions

Dimension FieldDescription
gen_ai.operation.nameOperation type
gen_ai.provider.nameAI provider
error.typeError type
gen_ai.request.modelRequest model name

2.3 Generative AI Client Call Count

AttributeDescription
Metric ID (Service Instance)one.service.instance.gen_ai.client.call.count
Metric ID (Service)one.service.gen_ai.client.call.count
Metric NameGenerative AI Client Call Count
Metric TypeSUM
Display / Reporting Unitcount
Decimal Places2
Metric SourceONE Platform Custom Metric
Basic JudgmentHigher is better
Anomaly TypeThroughput
Related EntitiesService, Service Instance, Host (Instance Level); Service (Service Level)

Description

The number of large model invocations initiated by the client.

Related Dimensions (Service Instance Level)

Dimension FieldDescription
gen_ai.operation.nameOperation type
gen_ai.provider.nameAI provider
error.typeError type
gen_ai.request.modelRequest model name
gen_ai.session.idSession ID
gen_ai.user.idUser ID

Note: Service-level metrics do NOT include gen_ai.session.id and gen_ai.user.id.


3. Metric Summary

Metric NameService Instance Metric IDService Metric IDTypeUnit
MCP Client Operation Durationone.service.instance.mcp.client.operation.durationone.service.mcp.client.operation.durationHistograms
MCP Client Call Countone.service.instance.mcp.client.call.countone.service.mcp.client.call.countSUMcount
Generative AI Token Usageone.service.instance.gen_ai.client.token.usageone.service.gen_ai.client.token.usageHistogramtoken
Generative AI Client Operation Durationone.service.instance.gen_ai.client.operation.durationone.service.gen_ai.client.operation.durationHistograms
Generative AI Client Call Countone.service.instance.gen_ai.client.call.countone.service.gen_ai.client.call.countSUMcount