Go SDKAPI ReferenceModels

PercentileThroughputCutoffs - Go SDK

PercentileThroughputCutoffs type definition

The Go SDK and docs are currently in beta. Report issues on GitHub.

Percentile-based throughput cutoffs. All specified cutoffs must be met for an endpoint to be preferred.

Fields

FieldTypeRequiredDescription
P50optionalnullable.OptionalNullable[float64]➖Minimum p50 throughput (tokens/sec)
P75optionalnullable.OptionalNullable[float64]➖Minimum p75 throughput (tokens/sec)
P90optionalnullable.OptionalNullable[float64]➖Minimum p90 throughput (tokens/sec)
P99optionalnullable.OptionalNullable[float64]➖Minimum p99 throughput (tokens/sec)