AI SDK
DocsProvidersGuides
DocumentationReferenceTroubleshootingProvidersGuidesChangelog
DocsProvidersGuidesAPI reference

Text

generateTextstreamTextstreamTextDeltas

Structured output

generateEnumgenerateJSONgenerateObjectgenerateObjectArraystreamObject

Embeddings and ranking

cosineSimilarityembedembedManyrerank

Images, audio, and video

detectAudioMediaTypedetectImageMediaTypegenerateImagegenerateSpeechgenerateVideostreamTranscribetranscribe

Loop control

hasToolCallisLoopFinishedisStepCountstepCountIs

Context

filterActiveToolspruneMessages

Middleware and providers

customProviderwrapEmbeddingModelwrapImageModelwrapLanguageModelwrapProvider

UI and transports

consumeStreamconvertToModelMessageslastAssistantMessageIsCompleteWithApprovalResponseslastAssistantMessageIsCompleteWithToolCallsreadUIMessageStreamsafeValidateUIMessagessmoothStreamvalidateUIMessages

MCP

detectToolDriftfingerprintTools

Audio buffers

decodePCM16encodePCM16resampleAudio

Utilities

createIdGeneratorgenerateIdgetRealtimeToolDefinitionsuploadFile

Building blocks

AgentContentPartMessageTool

Results

GenerateTextResultStreamTextResult

Configuration

CompactedContextCompactionGenerationTimeoutStopConditionTelemetrySettingsToolApprovalPolicyToolChoice

UI

ChatSession

Values

JSONValueMCPClient

Errors

Errors

encodePCM16

Encode samples as 16-bit PCM.

Packs float samples into little-endian 16-bit PCM, the format realtime providers accept.

let data = encodePCM16(samples)

Signature

func encodePCM16(
    _ samples: [Float]
) -> Data

Defined in Sources/AI/Realtime/AudioResampling.swift.

Parameters

ParameterTypeDefault
_[Float]required

Returns

Data of 16-bit little-endian PCM.

See also

  • Realtime voice

decodePCM16

Decode 16-bit PCM into samples.

resampleAudio

Resample PCM audio between sample rates.

On this page

SignatureParametersReturnsSee also